[None][fix] Require Python transceiver for mixed Mamba#16428
[None][fix] Require Python transceiver for mixed Mamba#16428VALLIS-NERIA wants to merge 4 commits into
Conversation
|
/bot run |
|
PR_Github #59454 [ run ] triggered by Bot. Commit: |
|
PR_Github #59454 [ run ] completed with state
|
|
/bot run |
|
PR_Github #59465 [ run ] triggered by Bot. Commit: |
|
PR_Github #59465 [ run ] completed with state
|
Signed-off-by: Xiwen Yu <13230610+VALLIS-NERIA@users.noreply.github.com>
Signed-off-by: Xiwen Yu <13230610+VALLIS-NERIA@users.noreply.github.com>
Signed-off-by: Xiwen Yu <13230610+VALLIS-NERIA@users.noreply.github.com>
Signed-off-by: Xiwen Yu <13230610+VALLIS-NERIA@users.noreply.github.com>
c9f2b1f to
562e6ec
Compare
|
/bot run |
|
PR_Github #59611 [ run ] triggered by Bot. Commit: |
|
PR_Github #59611 [ run ] completed with state
|
|
This change has been folded into #16427 together with its Mixed + Python/NIXL runtime guard and test coverage. Closing this draft as superseded so review and CI can continue on the combined PR. |
@coderabbitai summary
Description
MixedMambaHybridCacheManagerowns attention KV cache and Python-managed Mamba state in separate pools. Its supported disaggregated-transfer route is therefore the Python transceiver with the NIXL backend. Sending it through the C++/default runtime reaches an unsupported unified-pool path and fails late during construction.This PR:
MixedMambaHybridCacheManagerwhenever the effective transceiver runtime is notPYTHON, including explicitCPPand unresolvedauto/default routing;This PR is independent of the V2 Mamba cache-manager stack.
Test Coverage
11 passed)pre-commit run --from-ref origin/main --to-ref HEADPR Checklist