Repository navigation

[Archive #39210 2026-10-11] NVFP4 W4A16 MegaMoE before rebase - #8

Draft

zianglih wants to merge 21 commits into

archive/pr39210-20261011-basefrom

archive/pr39210-20261011-head

Draft

[Archive #39210 2026-10-11] NVFP4 W4A16 MegaMoE before rebase#8
zianglih wants to merge 21 commits into
archive/pr39210-20261011-basefrom
archive/pr39210-20261011-head

Commits on Oct 10, 2026
- Add opt-in FlashInfer NVFP4 W4A16 MegaMoE integration
  zianglih
  committed
  9f92821
- Preserve W4A16 MegaMoE output and reload lifecycle
  zianglih
  committed
  50f311c
- Use BF16 source for online NVFP4 MegaMoE reload coverage
  zianglih
  committed
  914036e
- Allow GLM DSA models to use FlashInfer MegaMoE
  zianglih
  committed
  8dc61f7
- Honor FlashInfer MegaMoE FC2 reduction and current weight API
  zianglih
  committed
  a85ce38
- Enable startup autotuning for FlashInfer MegaMoE
  zianglih
  committed
  ecb1b18
- Trim MegaMoE autotune test scaffolding
  zianglih
  committed
  f21d495
- Prepare target MegaMoE decode and prefill profiles by default
  zianglih
  committed
  eca7f7d
- Keep MegaMoE profile sizing in the autotune runner
  zianglih
  committed
  c945d8a
- Reuse FlashInfer autotune cache for MegaMoE startup profiles
  zianglih
  committed
  f2c9589
- Align MegaMoE startup tests with upstream cache lifecycle
  zianglih
  committed
  f86fdcb
- Set backend explicitly in the generic autotune cache fixture
  zianglih
  committed
  d8795bc
- fix: bypass NVSHMEM proxy for local MegaMoE W4A16
  zianglih
  committed
  5608a33
- Isolate MegaMoE autotune caches by physical GPU
  zianglih
  committed
  655f96f
- Explain MegaMoE autotune cache writer isolation
  zianglih
  committed
  2ae41f0
- fix: initialize neutral NVFP4 dummy weight scales
  zianglih
  committed
  8c56df1
- fix: apply local NVSHMEM defaults to all MegaMoE formats
  zianglih
  committed
  5750d8d
- test: trim MegaMoE configuration checks
  zianglih
  committed
  d59f2fe
- feat: wire Kimi K3 SiTU into NVFP4 MegaMoE
  zianglih
  committed
  e2c0a08
- Align MegaMoE with upstream topology and activation contracts
  zianglih
  committed
  68ff82e
- Simplify MegaMoE integration for FlashInfer 0.7.1
  zianglih
  committed
  3811493

Commits

Commits on Oct 10, 2026