Add zstd at-rest CAS compression with byte-for-byte wire passthrough - #2641

Open

walter-zeromatter wants to merge 27 commits into

TraceMachina:mainfrom

Reactor-Inc:user/wgray/zstd-store

Commits on Jul 30, 2026

feat(store): add Store::downcast_ref_immediate non-recursive downcast

walter-zeromatter
and
claude
committed
14dfb71
feat(config): add ZstdStoreSpec and StoreSpec::ZstdStore
walter-zeromatter
committed
da9e18e
feat(store): add ZstdStore skeleton with identity read/write paths

walter-zeromatter
and
claude
committed
c92afa6
feat(store): register ZstdStore in store_factory
walter-zeromatter
committed
e997661
fix(store): drain inner stream on ranged reads; zero-digest has; validation tests

walter-zeromatter
and
claude
committed
8c614a6
feat(store): ZstdStore zstd fast-path methods and validated staging

walter-zeromatter
and
claude
committed
dbdb6cd
fix(store): arm temp-file guard before create; post_init probe; batch concat-frame test
walter-zeromatter
committed
89c6b19
feat(service): ZstdStore byte-for-byte fast path in bytestream read/write

walter-zeromatter
and
claude
committed
d4065f6
feat(service): ZstdStore fast path in BatchRead/BatchUpdate

walter-zeromatter
and
claude
committed
3ff9a8b
fix(service): gate BatchUpdate zstd fast path on remote_cache_compression
walter-zeromatter
committed
36864e7
test(store): ZstdStore cross-wrapper integration coverage

walter-zeromatter
and
claude
committed
b11a0a0
docs: ZstdStore example config and operator guidance
walter-zeromatter
committed
de39ea5
refactor(store): add Store::downcast_arc_immediate; use at ZstdStore fast-path sites

walter-zeromatter
and
claude
committed
a230a3a
refactor(util): add blocking buf_channel adapters for ZstdStore

walter-zeromatter
and
claude
committed
cdc914c
refactor(store): consolidate whole-buffer zstd decode helper in ZstdStore

walter-zeromatter
and
claude
committed
817dcfa
fix(build): add zstd Bazel dep to store integration tests

walter-zeromatter
and
claude
committed
79939c3
fix(zstd-store): bound decode, prevent upload starvation, descriptor-pinned staging

walter-zeromatter
and
claude
committed
8904aa8
fix(zstd-store): harden staging and validation
walter-zeromatter
committed
3917848
refactor(store): configure zstd as compression algorithm
walter-zeromatter
committed
ef7f5f1
fix(zstd-store): address review findings

walter-zeromatter
and
claude
committed
22bf38b
fix(zstd-store): satisfy rustfmt, Vale, and the generated stores-config

walter-zeromatter
and
claude
committed
32b65d4

Commits on Aug 6, 2026

fix(zstd-store): enforce admission and decoder bounds
walter-zeromatter
committed
54d9954

Navigation Menu

Uh oh!

Add zstd at-rest CAS compression with byte-for-byte wire passthrough - #2641

Add zstd at-rest CAS compression with byte-for-byte wire passthrough#2641
walter-zeromatter wants to merge 27 commits into
TraceMachina:mainfrom
Reactor-Inc:user/wgray/zstd-store

Commits on Jul 30, 2026

feat(store): add Store::downcast_ref_immediate non-recursive downcast

feat(config): add ZstdStoreSpec and StoreSpec::ZstdStore

feat(store): add ZstdStore skeleton with identity read/write paths

feat(store): register ZstdStore in store_factory

fix(store): drain inner stream on ranged reads; zero-digest has; validation tests

feat(store): ZstdStore zstd fast-path methods and validated staging

fix(store): arm temp-file guard before create; post_init probe; batch concat-frame test

feat(service): ZstdStore byte-for-byte fast path in bytestream read/write

feat(service): ZstdStore fast path in BatchRead/BatchUpdate

fix(service): gate BatchUpdate zstd fast path on remote_cache_compression

test(store): ZstdStore cross-wrapper integration coverage

docs: ZstdStore example config and operator guidance

refactor(store): add Store::downcast_arc_immediate; use at ZstdStore fast-path sites

refactor(util): add blocking buf_channel adapters for ZstdStore

refactor(store): consolidate whole-buffer zstd decode helper in ZstdStore

fix(build): add zstd Bazel dep to store integration tests

fix(zstd-store): bound decode, prevent upload starvation, descriptor-pinned staging

fix(zstd-store): harden staging and validation

refactor(store): configure zstd as compression algorithm

fix(zstd-store): address review findings

fix(zstd-store): satisfy rustfmt, Vale, and the generated stores-config

Commits on Aug 6, 2026

fix(zstd-store): enforce admission and decoder bounds

Commits on Aug 11, 2026

Merge branch 'main' into user/wgray/zstd-store

fix(zstd-store): satisfy CI rustfmt aspect and Vale spelling

fix(zstd-store): add tracing-test dep to unit_test target

Commits on Aug 14, 2026

Merge branch 'main' into user/wgray/zstd-store

Merge branch 'main' into user/wgray/zstd-store