Skip to content

refactor(decoder): unify .generate() behind KVCacheBackend and default CUDA to IoBinding. - #11

Merged
talmago merged 2 commits into
mainfrom
talmago/kv_cache_backend
Aug 17, 2026
Merged

refactor(decoder): unify .generate() behind KVCacheBackend and default CUDA to IoBinding.#11
talmago merged 2 commits into
mainfrom
talmago/kv_cache_backend

Update README

5863f1b
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Checks
succeeded Aug 17, 2026 in 1m 13s