perf(vllm): batch MXFP8 MoE refit shuffles - #3478

Merged

terrykong merged 17 commits into

NVIDIA-NeMo:mainfrom

seonjinn:sna/mxfp8-batched-moe-shuffle

Aug 11, 2026

Commits on Aug 3, 2026

perf(vllm): batch MXFP8 MoE refit shuffles
seonjinn
committed
5ee7704

Commits on Aug 5, 2026

test(vllm): cover MXFP8 refit dispatch
seonjinn
committed
c795650
Merge remote-tracking branch 'origin/main' into sna/mxfp8-batched-moe-shuffle
seonjinn
committed
7812b5e
test(vllm): validate MXFP8 refit invariants
seonjinn
committed
3404e6f
test(vllm): require MXFP8 MoE kernel initialization
seonjinn
committed
7125606
fix(vllm): initialize MXFP8 MoE kernel after loading
seonjinn
committed
c3ec212
test(vllm): preserve MXFP8 kernel state across refits
seonjinn
committed
494952d
fix(vllm): preserve MXFP8 kernel across refits
seonjinn
committed
17953ce
test(vllm): isolate MXFP8 kernel lifecycle
seonjinn
committed
4ac5012
Merge remote-tracking branch 'origin/main' into sna/mxfp8-batched-moe-shuffle
seonjinn
committed
3099836
test(vllm): cover gated MXFP8 refit
seonjinn
committed
2a2a35a
test(vllm): compare gated shuffle storage
seonjinn
committed
a74113d
fix(vllm): release MXFP8 shuffle temporaries
seonjinn
committed
6b5eeaa
test(vllm): detect retained MXFP8 shuffle buffers
seonjinn
committed
52f30c7

Commits on Aug 8, 2026