feat(moe_ep): MXFP8 x BF16 integration - #4604

Open

djns99 wants to merge 34 commits into

flashinfer-ai:mainfrom

djns99:djns99/mxfp8-bf16-pr4386

Commits on Sep 16, 2026

MXFP8 x BF16 integration
djns99
committed
37a0962
Changed quantize_input semantics to be ignored for BF16
djns99
committed
a83ef9c
Clarify transformed weight todo
djns99
committed
afb70bb
Cleanup and deduplicate common datatype utilities
djns99
committed
812af19
Tidy up megamoe bf16 config base class
djns99
committed
cfc1d8a
Test tidy ups and autotuner support
djns99
committed
f94e268
Add missing tests
djns99
committed
c0e28eb
Fix bad knobs expansion
djns99
committed
5577b3c
Fix lint errors
djns99
committed
e03b305
Fix duplicate tests
djns99
committed
bf6f4f7
Multirank tests
djns99
committed
7e2f22e
Clear symm buffer in mixed mxfp8 destroy
djns99
committed
05d2b70
Cleanups
djns99
committed
d39f3c9
Refactor the autotuner to reject invalid knob combinations
djns99
committed
90382a9
Review iterations
djns99
committed
ca96753
Sweep epi_flag_batch
djns99
committed
5b851a3
Add workspace view output tensor
djns99
committed
fa9beeb
Properly default token back mode for BF16
djns99
committed
7481b49
Remove unused token_back_mode in autotuner
djns99
committed
f759af3
Address review comments
djns99
committed
44247dd
Remove extra duplicated valid impls
djns99
committed
5288a74
Autotuner refactor for BF16 and BF16xMXFP8 to support IKR and token-back cleanly
djns99
committed
1a62d4a
Remove bad comment
djns99
committed
7dd0a14
Change output view to allocate space in symmetric buffer to allow it to work with ikr off
djns99
committed
dc3d0d9
Fix comments in knobs
djns99
committed
c39c7fa
Fix comments
djns99
committed
1357a7a
Simplify reduce into output tensor
djns99
committed
602c5b3
Comment fixes
djns99
committed
8ee306f
Comment fixes
djns99
committed
18e14e0
Remove old NOTE
djns99
committed
813f1cf
Skip 12.9 tests for BF16xMXFP8
djns99
committed
ac27b69
Fix precommit issues
djns99
committed
c69aab7
Relax restriction to CUDA 13+
djns99
committed
c9701fd
Skip A10G tests
djns99
committed
e4147f7