mirror of
https://github.com/volcengine/OpenViking.git
synced 2026-09-30 01:08:26 +08:00
tuofangandfang
2d56bd71f4
* add CachedFileSystem + CacheProvider trait and Mooncake/Yuanrong Provide add CachedFileSystem + CacheProvider trait and Mooncake/Yuanrong Provide * Handle poisoned known_keys mutexes in cache providers * Add configurable cache support to ragfs python * Add Redis cache provider support * Prune native cache providers from default build * Add RAGFS cache guides in Chinese and English * delete .cargo/config.toml * Fix stale cache invalidation across shared wrappers * Document Yuanrong native concurrency limits * add CachedFileSystem + CacheProvider trait and Mooncake/Yuanrong Provide add CachedFileSystem + CacheProvider trait and Mooncake/Yuanrong Provide * Handle poisoned known_keys mutexes in cache providers * Add configurable cache support to ragfs python * Add Redis cache provider support * Prune native cache providers from default build * Add RAGFS cache guides in Chinese and English * delete .cargo/config.toml * Fix stale cache invalidation across shared wrappers * Document Yuanrong native concurrency limits * Limit directory cache entries and add regression test * docs: add TOS s3fs backend test design * Add runtime cache config override * add build guides for mooncake and yuanrong * fix _FakeConfig test with cache * fix(ragfs): cache encrypted data below the encryption layer - pass runtime cache config to the Rust binding - cache ciphertext instead of decrypted content - disable cache for encrypted multi-write mounts - update tests and provider build documentation * fix(ragfs): invalidate cache after same-mount raw copy Ensure copy_within_mount invalidates the cached destination file and parent directory after the raw backend fast path writes data directly. This prevents stale reads and stale directory metadata when cache is enabled and Python cp() uses the same-mount copy optimization. Add a regression test covering overwrite copy followed by read/list. * fix(ragfs): preserve multi-write discovery through cache layer Allow MountableFS::as_multiwrite() to unwrap CachedFileSystem when discovering the underlying MultiWriteWrappedFS. This preserves multi-write admin paths and same-mount copy behavior for cache-enabled, unencrypted multi-write mounts. Add a regression test covering sync status, sync retry, same-mount copy, and unmount behavior for cached unencrypted multi-write mounts. * feat(ragfs): add cache-aware tree traversal mode - add configurable tree traversal mode to cache policy - keep default tree behavior delegated to backend - allow cached traversal to reuse read_dir directory cache - bypass cached traversal for multi-write backends - add regression coverage for tree cache behavior and fallbacks * docs: design cache-aware grep traversal * feat(ragfs): add cache-aware grep traversal Introduce a shared cache traversal mode for recursive APIs and use it to optionally run grep through CachedFileSystem. - add CacheTraversalMode with backend and cached_traversal modes - keep CacheTreeMode as a compatibility alias - route tree and grep through cached traversal only when explicitly enabled - reuse cached read_dir entries and full-file reads during grep traversal - keep multi-write traversal on the backend path - expose storage.agfs.cache.traversal_mode in Python config - raise max cached directory entries threshold to 4096 - add regression tests for grep cache traversal and traversal config * Optimize cached grep generation validation * Parallelize cached grep file scanning --------- Co-authored-by: fang <fang@fangMacBook-Air.local>