(https://github.com/microsoft/sarathi-serve/blob/3a210e76f5fb0be82b568097d45486401119a967/sarathi/model_executor/attention/flashinfer_attention_wrapper.py#L38-L40) why not use "BatchDecodeWithPagedKVCacheWrapper" ?[](url)
(
sarathi-serve/sarathi/model_executor/attention/flashinfer_attention_wrapper.py
Lines 38 to 40 in 3a210e7
why not use "BatchDecodeWithPagedKVCacheWrapper" ?