Add 9 bytes of metadata to FlatKV store#3163

Draft

cody-littley wants to merge 137 commits intomainfrom

cjl/9-byte-metadata

Commits on Mar 5, 2026

Created a cache for flatKV.
Cody Littley
committed
checkpoint
Cody Littley
committed
incremental progress
Cody Littley
committed
address feedback
Cody Littley
committed
more fixes
Cody Littley
committed
bugfix
Cody Littley
committed
wire in cache
Cody Littley
committed

Commits on Mar 6, 2026

Merge branch 'main' into cjl/flatkv-cache
Cody Littley
committed
incremental improvements
Cody Littley
committed
checkin
Cody Littley
committed
Moved where the cache sits
Cody Littley
committed
bugfix
Cody Littley
committed
Batch update the cache
Cody Littley
committed
Add batch read to cache
Cody Littley
committed
Add batch get to db interface
Cody Littley
committed
integrate batch reads
Cody Littley
committed
wire in cache
Cody Littley
committed
Introduce work pool, size caches differently
Cody Littley
committed
bugfix
Cody Littley
committed

Commits on Mar 9, 2026

Add unit constants
Cody Littley
committed
refactor threading utils
Cody Littley
committed
cleanup
Cody Littley
committed
Cleanup, fix race condition
Cody Littley
committed
cleanup
Cody Littley
committed
cleanup
Cody Littley
committed
use pool
Cody Littley
committed
fix ctx lifecycle
Cody Littley
committed
Merge branch 'main' into cjl/flatkv-cache
Cody Littley
committed
rename package
Cody Littley
committed
Clean up string copies
Cody Littley
committed
simplify gc
Cody Littley
committed
better error handling
Cody Littley
committed
use config to configure cache params
Cody Littley
committed
Allow flatkv config to be set in tests
Cody Littley
committed

Commits on Mar 10, 2026

tweak config
Cody Littley
committed
incremental progress
Cody Littley
committed
move data dir into config
Cody Littley
committed
fix config file
Cody Littley
committed
cleanup
Cody Littley
committed
move pebble metrics to proper location
Cody Littley
committed
clean up metrics
Cody Littley
committed
updated dashboard
Cody Littley
committed
fix histograms
Cody Littley
committed
threading tests
Cody Littley
committed
test lru queue
Cody Littley
committed
unit tests for shard
Cody Littley
committed
cache tests
Cody Littley
committed
moar unit tests
Cody Littley
committed
cleanup
Cody Littley
committed
Merge branch 'main' into cjl/flatkv-cache
Cody Littley
committed
Merge branch 'main' into cjl/flatkv-cache
Cody Littley
committed

Commits on Mar 11, 2026

Merge branch 'main' into cjl/flatkv-cache
Cody Littley
committed
unit test fixes
Cody Littley
committed
fix hash bug
Cody Littley
committed
fixed path bug
Cody Littley
committed
Helper files for flatKV cache
Cody Littley
committed
add missing struct
Cody Littley
committed

Commits on Mar 12, 2026

Merge branch 'main' into cjl/cache-auxilery
Cody Littley
committed
made suggested changes
Cody Littley
committed
fix tests
Cody Littley
committed
Merge branch 'main' into cjl/flatkv-cache
Cody Littley
committed
Merge branch 'cjl/cache-auxilery' into cjl/flatkv-cache
Cody Littley
committed

Commits on Mar 13, 2026

Maded suggested change to cache structure
Cody Littley
committed
rename cache -> dbcache to avoid gitignore
Cody Littley
committed
Helper files for the flatKV cache implementation
Cody Littley
committed
bugfix
Cody Littley
committed

Commits on Mar 16, 2026

Merge branch 'cjl/cache-auxilery-2' into cjl/flatkv-cache
Cody Littley
committed
fix merge problems
Cody Littley
committed
refactor API
Cody Littley
committed
made suggested changes
Cody Littley
committed
made suggested changes
Cody Littley
committed
fix bug
Cody Littley
committed
Merge branch 'main' into cjl/flatkv-cache
Cody Littley
committed
Implement a standard cache.
Cody Littley
committed
cleanup
Cody Littley
committed

Commits on Mar 17, 2026

Merge branch 'main' into cjl/cache-impl
Cody Littley
committed
made suggested changes
Cody Littley
committed
made suggested change
Cody Littley
committed
made suggested changes
Cody Littley
committed
fix unit test
Cody Littley
committed
fix unit test
Cody Littley
committed
Merge branch 'cjl/cache-impl' into cjl/flatkv-cache
Cody Littley
committed

Commits on Mar 20, 2026

Merge branch 'main' into cjl/flatkv-cache
Cody Littley
committed
fixed merge bugs
Cody Littley
committed
fix teardown race
Cody Littley
committed
Add logging metric, clean up log files before/after run
Cody Littley
committed
fix unit test
Cody Littley
committed
fix unit tests
Cody Littley
committed
fix unit test
Cody Littley
committed

Commits on Mar 25, 2026

made suggested changes
Cody Littley
committed
config changes
Cody Littley
committed
made suggested changes
Cody Littley
committed
Merge branch 'main' into cjl/flatkv-cache
Cody Littley
committed

Commits on Mar 26, 2026

rearranged files
Cody Littley
committed

Commits on Mar 27, 2026

basic data structures
Cody Littley
committed
bugfix
Cody Littley
committed
Basic impl and unit tests
Cody Littley
committed
config
Cody Littley
committed
block generator
Cody Littley
committed

Commits on Mar 30, 2026

created struct for account data
Cody Littley
committed
added structs
Cody Littley
committed
Merge branch 'cjl/flatkv-cache' into cjl/9-byte-metadata
Cody Littley
committed
incremental progress
Cody Littley
committed
cleanup
Cody Littley
committed
don't ignore errors from batch get
Cody Littley
committed
Merge branch 'main' into cjl/flatkv-cache
Cody Littley
committed
Merge branch 'cjl/flatkv-cache' into cjl/9-byte-metadata
Cody Littley
committed
incremental progress
Cody Littley
committed
cleanup
Cody Littley
committed
cleanup
Cody Littley
committed
incremental progress
Cody Littley
committed
convert code data to new format
Cody Littley
committed

Commits on Mar 31, 2026

made suggested changes
Cody Littley
committed
Merge branch 'main' into cjl/flatkv-cache
Cody Littley
committed
Merge branch 'main' into cjl/flatkv-cache
Cody Littley
committed
Merge branch 'cjl/flatkv-cache' into cjl/9-byte-metadata
Cody Littley
committed
incremental progress
Cody Littley
committed

Commits on Apr 1, 2026

make suggested change to pool
Cody Littley
committed
Merge branch 'cjl/flatkv-cache' into cjl/9-byte-metadata
Cody Littley
committed
started big refactor
Cody Littley
committed
incremental progress
Cody Littley
committed
incremental progress
Cody Littley
committed
fix parsing
Cody Littley
committed
fix store read
Cody Littley
committed
Merge branch 'main' into cjl/flatkv-cache
Cody Littley
committed
fix merge problem
Cody Littley
committed
Merge branch 'cjl/flatkv-cache' into cjl/9-byte-metadata
Cody Littley
committed
bugfixes
Cody Littley
committed
fix compile issues
Cody Littley
committed
Merge branch 'main' into cjl/9-byte-metadata
Cody Littley
committed
lint
Cody Littley
committed
test cleanup
Cody Littley
committed
clean up interface
Cody Littley
committed
check for bad keys
Cody Littley
committed
better handling of variable sized data
Cody Littley
committed
Improve codehash serialization
Cody Littley
committed
cleanup
Cody Littley
committed