Repository navigation

[Model][Experimental] DeepSeek V4 w4a4 MegaMoE support - #42844

Closed

wuudiz wants to merge 4 commits into

vllm-project:mainfrom

wuudiz:deepseek-v4

Closed

[Model][Experimental] DeepSeek V4 w4a4 MegaMoE support#42844
wuudiz wants to merge 4 commits into
vllm-project:mainfrom
wuudiz:deepseek-v4

Commits on May 25, 2026
- [Env] Add VLLM_DEEPGEMM_MEGA_MOE_USE_FP4_ACTS / USE_MXF4_KIND env vars
  wuddiz
  committed
  bfd819e
- [DeepGEMM][MegaMoE] Add env-forwarding helper and conditional deep_gemm import in get_symm_buffer
  wuddiz
  committed
  43127fc
- [DeepGEMM][MegaMoE] Add FP4 acts dispatch via mega_moe_pre_dispatch (experimental)
  wuddiz
  committed
  aaf6d9b
- [DeepGEMM][MegaMoE] Refine comments to reflect PoC nature and sgl-deep-gemm dependency
  wuddiz
  committed
  a0a0e63