Skip to content

test: reduce Kimi K3 B300 MegaMoE memory pressure - #41228

Closed
alphabetc1 wants to merge 1 commit into
sgl-project:mainfrom
alphabetc1:fix/kimi-k3-b300-megamoe-headroom-main
Closed

alphabetc1 wants to merge 1 commit into
sgl-project:mainfrom
alphabetc1:fix/kimi-k3-b300-megamoe-headroom-main

Conversation

@alphabetc1

@alphabetc1 alphabetc1 commented Sep 25, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

  • lower the Kimi-K3 B300 MegaMoE test static memory fraction from 0.85 to 0.82
  • explicitly cap DSPARK max running requests and decode CUDA graph batch size to the CI GSM8K load
  • keep the existing GSM8K accuracy gate while leaving headroom for FlashInfer autotune and CUDA graph capture

Context

PR #41092 hit CUDA OOM during FlashInfer MLA autotune in TestKimiK3B300MegaMoE.setUpClass, then NCCL _REDUCE_SCATTER_BASE timed out and rank 6 aborted:
https://github.com/sgl-project/sglang/actions/runs/36016352823/job/107760312725?pr=41092

This PR isolates the CI memory-headroom adjustment on top of main so we can validate it independently.

Test

  • python3 -m py_compile test/registered/e2e/models/test_kimi_k3_b300.py
  • git diff --check upstream/main..HEAD

CI States

Latest PR Test (Base): ⏳ Run #36105970820
Latest PR Test (Extra): 🚫 Run #36106026251
Latest PR Test (AMD ROCm 10): ⏳ Run #36105970745

@alphabetc1 alphabetc1 added run-ci CI: run the baseline test suite on this PR run-ci-extra CI: also run the extra suite (requires run-ci) labels Sep 25, 2026
@mmangkad

Copy link
Copy Markdown
Collaborator

Fixed by #41138

@alphabetc1 alphabetc1 closed this Sep 25, 2026
@alphabetc1
alphabetc1 deleted the fix/kimi-k3-b300-megamoe-headroom-main branch September 25, 2026 07:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

run-ci CI: run the baseline test suite on this PR run-ci-extra CI: also run the extra suite (requires run-ci)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants