Repository navigation
[Fix] dsv41: Revert MegaGate routing in prefill - #46242
Merged
Merged
Conversation
hnyls2002
requested review from
BBuf,
Edwardf0t1,
Fridge003,
HaiShaw,
Ying1123,
ch-wan,
ispobock and
merrymercy
as code owners
October 24, 2026 04:14
Collaborator
Author
|
/rerun-test test_mega_moe_deepgemm_api.py |
Contributor
|
🚀 |
Open
5 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Reverts #46232.
With
SGLANG_OPT_DEEPGEMM_MEGA_GATE=1, #46232 let MegaGate run on extend batches again, including inside breakable prefill CUDA graphs. That brings back the prefill capture failure #45969 fixed: on GB300 (DeepSeek-V4.1-Flash, DP attention 4 with MegaMoE, prefill graphs at 4096 and 8192 rows), the second shape's capture fails withCUDA error: unspecified launch failureon the non-zero DP ranks, so the server does not start. It reproduces withsgl-deep-gemm0.2.3.post2.This restores the decode / target-verify gate and its 2048-row cap exactly as before #46232. Prefill MegaGate can return once the capture failure is understood.
Verification
mega_gate.pyandtest_mega_moe_deepgemm_api.pyare byte-identical to the parent of [Perf] dsv41: Run MegaGate routing in prefill #46232; the MegaGate admission tests pass.CI States
Latest PR Test (Base): ❌ Run #40061584100
Latest PR Test (Extra): ❌ Run #40061583800
Latest PR Test (AMD ROCm 10): ❌ Run #40061583748