perf(sample-support): add packed base64 transport#1915

Open

dyurk-lila wants to merge 9 commits into

NovaSky-AI:mainfrom

dyurk-lila:upstream/sample-support-packed-wire

Commits on Jul 16, 2026

fix(r3): align routed-expert metadata and padding
dyurk-lila
committed
perf(r3): accelerate routed-expert transport with packed arrays

dyurk-lila
and
claude
committed
perf(r3): expand replay routes to local layers only

dyurk-lila
and
claude
committed
refactor(inference): extract reusable RemoteInferenceGenerator

dyurk-lila
and
claude
committed
refactor(generators): assemble routed-expert traces incrementally

dyurk-lila
and
claude
committed
feat(megatron): add bounded sampler-support replay

dyurk-lila
and
claude
committed

Commits on Jul 17, 2026