Implement SM120 DeepSeek V4 flashinfer_mxfp4 moe runner backend + TP2 - #30272

Merged

Fridge003 merged 25 commits into

sgl-project:mainfrom

lucifer1004:dsv4

Jul 18, 2026

Commits on Jul 10, 2026

[fix] Handle masked expert blocks in the marlin MoE gemm without expert_map

lucifer1004
and
claude
committed
2941388
[feature] Route SM120 MXFP4 experts to the FlashInfer cutlass MoE method

lucifer1004
and
claude
committed
ef96354
[fix] Release loader-format scales after MXFP4 marlin preparation

lucifer1004
and
claude
committed
26367b6
[fix] Route SM120 extend through the FlashInfer sparse-MLA path

lucifer1004
and
claude
committed
28d089f
[fix] Route the SM120 sparse-MLA wrapper through FlashInfer's dispatcher

lucifer1004
and
claude
committed
5e90ba3
[fix] Chunk the torch SM120 fp8 paged-MQA logits fallback

lucifer1004
and
claude
committed
286b1b5
[fix] Lift the tilelang MQA-logits staging buffers to 2-D

lucifer1004
and
claude
committed
98c2f86
[fix] Default the tilelang indexer on SM120 for DeepSeek V4

lucifer1004
and
claude
committed
4622cc1
[fix] Register MXFP4 marlin loader scales at the checkpoint dtype

lucifer1004
and
claude
committed
a7748ff
feat(mxfp4): use native W4A8 FlashInfer MoE on SM120
lucifer1004
committed
23e5658
fix(mxfp4): default DSv4 SM120 to FlashInfer
lucifer1004
committed
44cdb00
chore(review): remove reviewer-requested comments
lucifer1004
committed
c470444
fix(mxfp4): address FlashInfer review feedback
lucifer1004
committed
46112e5

Commits on Jul 11, 2026

docs(dsv4): update RTX PRO 6000 cookbook
lucifer1004
committed
4e2c0e0

Commits on Jul 14, 2026

chore(dsv4): merge upstream main
lucifer1004
committed
1754606
fix(ci): add SM120 test entry point
lucifer1004
committed
c3b1ea3

Commits on Jul 15, 2026

Commits on Jul 16, 2026

fix(quantization): simplify mxfp4 architecture check
lucifer1004
committed
c3f9bd6
Merge remote-tracking branch 'origin/dsv4' into dsv4
lucifer1004
committed
ddb0c45
test(mxfp4): restore SM90 test comments
lucifer1004
committed
bdad8c2

Commits on Jul 18, 2026

Merge branch 'main' into dsv4
Fridge003
authored
a966bb8
Merge branch 'main' into dsv4
Fridge003
authored
754b78f