Skip to content

fix the deepep 8 gpu unit test #14601

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Fridge003 merged 7 commits into from
Dec 9, 2025
Merged

fix the deepep 8 gpu unit test #14601

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
6a58d9f
fix the deepep 8 gpu unit test
rainj-me Dec 8, 2025
0fe4aec
Merge branch 'main' into dev/deepep-8gpu-unittest-bugfix
rainj-me Dec 8, 2025
8be07ff
Merge branch 'main' into dev/deepep-8gpu-unittest-bugfix
rainj-me Dec 8, 2025
3d2e32d
Merge branch 'main' into dev/deepep-8gpu-unittest-bugfix
rainj-me Dec 8, 2025
af91ba8
Merge branch 'main' into dev/deepep-8gpu-unittest-bugfix
rainj-me Dec 8, 2025
edfb54c
Merge branch 'main' into dev/deepep-8gpu-unittest-bugfix
rainj-me Dec 8, 2025
203faa3
Merge branch 'main' into dev/deepep-8gpu-unittest-bugfix
rainj-me Dec 8, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion python/sglang/srt/layers/moe/utils.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -284,7 +284,7 @@ def speculative_moe_a2a_backend_context():
global MOE_A2A_BACKEND
original_backend = MOE_A2A_BACKEND
try:
MOE_A2A_BACKEND = MoeA2ABackend.NONE
MOE_A2A_BACKEND = get_speculative_moe_a2a_backend()
yield
finally:
MOE_A2A_BACKEND = original_backend
Expand Down
5 changes: 4 additions & 1 deletion test/srt/ep/test_deepep_large.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,8 @@ def setUpClass(cls):
"--enable-dp-lm-head",
"--moe-a2a-backend",
"deepep",
"--moe-runner-backend",
"deep_gemm",
"--enable-two-batch-overlap",
"--ep-num-redundant-experts",
"32",
Expand Down Expand Up @@ -72,7 +74,6 @@ def test_gsm8k(self):
self.assertGreater(metrics["accuracy"], 0.92)


@unittest.skip("Skipping this test until it's fixed.")
class TestDeepseekMTP(CustomTestCase):
@classmethod
def setUpClass(cls):
Expand All @@ -94,6 +95,8 @@ def setUpClass(cls):
"--enable-dp-lm-head",
"--moe-a2a-backend",
"deepep",
"--moe-runner-backend",
"deep_gemm",
"--enable-two-batch-overlap",
"--ep-num-redundant-experts",
"32",
Expand Down
Loading