Skip to content

[Doc] cookbook: Refresh SemiAnalysis AgentX launches to InferenceX main ea8b3439 - #47464

Merged
nvpohanh merged 1 commit into
sgl-project:mainfrom
nvpohanh:pohanh/cookbook-agentx-refresh-1030
Oct 30, 2026
Merged

nvpohanh merged 1 commit into
sgl-project:mainfrom
nvpohanh:pohanh/cookbook-agentx-refresh-1030

Conversation

@nvpohanh

@nvpohanh nvpohanh commented Oct 30, 2026 •

Copy link
Copy Markdown
Collaborator

[by Claude Code]

Motivation

The cookbook's Agentic Long-Context Deployment sections (#42726, #43083, #43799, #43983, #44065, #44228, #44654, #44712, #45039, #45111, #45311, #45513, #45749, #46005, #46506, #46547, #46807, #46948, #47027, #47214, #47303) mirror SemiAnalysis InferenceX AgentX submissions as raw launch commands, each linked to the run that measured it. The configurations are mirrored from SemiAnalysis submissions. This PR:

  1. Syncs to InferenceX main (ea8b3439). Three PRs have merged, and their lanes now come from their dashboard runs instead of the PRs:
  2. Adds Muse Spark Open updates from two in-progress InferenceX PRs:
  3. Keeps the DeepSeek-V4.1-Flash GB300 overlays (InferenceX #4603, and InferenceX #4595 at its new head) and the Qwen3.5 GB300 overlay (InferenceX #4333).

Source

InferenceX main (ea8b3439), with these InferenceX PRs overlaid:

PR Page Lanes Pinned to
#4670 Muse Spark Open GB200 SGLang, retuned per concurrency Muse Spark Open musespark-fp4-gb200-sglang-agentic-dflash no /use yet: in progress at head 5692839d
#4454 Muse Spark Open NVFP4 GB300 SGLang Muse Spark Open new musespark-fp4-gb300-sglang-agentic-dflash-multinode, -dflash-nightly1019 no /use yet: in progress at head a73b274a
#4603 DeepSeek-V4.1-Flash GB300 SGLang, 20261029 nightly, TP4 c1 megakernel DeepSeek-V4.1 dsv41flash-fp4-gb300-sglang-agentic-dspark no /use yet: in progress at head 9bd047ac
#4595 DeepSeek-V4.1-Flash GB300 Dynamo+SGLang, bonus-fixed nightlies DeepSeek-V4.1 dsv41flash-fp4-gb300-dynamo-sglang-agentic-agg, -dspark-disagg-hicache; retires -dspark-disagg no /use yet: in progress at head 4145e263
#4333 Qwen3.5 NVFP4 GB300 Dynamo+SGLang Qwen3.5 qwen3.5-fp4-gb300-dynamo-sglang-agentic-agg, -disagg; retires -agg-pareto, -pp-pareto run 39355392627, named by the PR's /use comment (head 02b72dc0, unchanged), verified

"In progress" lanes are rendered at the PR head and labeled "In progress in SA InferenceX AgentX". A later sync pins them once the PR gets a /use run or merges.

What this PR does

Page Lanes Deployments Points Hardware
MiniMax-M3.1 4 19 (17 in #47214) 65 (59 in #47214) GB300, GB200, B300, B200
GLM-5.2 14 34 75 GB300, GB200, B300, B200, H200
GLM-5.3 1 1 10 B300
DeepSeek-V4 unchanged
DeepSeek-V4.1 10 21 65 GB300, GB200, B300, B200, H200, H100
Qwen3.5 16 51 220 GB300, GB200, B300, B200, H200, H100
Qwen3.8-Flash-Next 4 5 24 GB300, B300, B200, H200
Muse Spark Open 8 (was 6) 11 (was 9) 70 (was 66) GB300, GB200, B300, B200, H200
  • No new keep / remove rules were needed. The GLM-5.2, GLM-5.3, Qwen3.5 and Qwen3.8-Flash-Next data change only in their shared source block (the InferenceX main SHA and the overlay list).

Validation

  • Browser checks: every page this PR changes was rendered in a headless browser (mint dev, Mintlify as in CI).

    • Every hardware / checkpoint / deployment / concurrency / KV tier / router combination renders exactly the decoded commands: 2,868 command sets, 0 mismatches, 0 unseen, no browser errors.
    • Every tab was clicked, and every "Copy link" URL was reopened.
    • The section links from the Deployment panels (DeepSeek-V4 included) and the copy buttons were also checked.
  • Decode and KV-flag checks:

    • The component's own decoder reproduces every generated plan (2,868 router × KV-tier variants).
    • Every KV flag exists in its image's SGLang commit (218 image × flag pairs).
    • The round-trip / leak check reports 0 problems.
  • Arg-parse in the submission images: all 96 commands not validated in an earlier round parse with their image's own parsers:

    Image Commands
    dev-minimax-m31-flash 36
    nightly-dev-20261026-8252e3af 48
    nightly-dev-cu13-20261020-ab580b2e 12

    The amd64 and arm64 builds of each nightly come from the same SGLang commit.

  • node scripts/check_cookbook_configs.mjs, mint broken-links --check-anchors --check-redirects, mint validate and pre-commit run --all-files (in lmsysorg/sglang:dev-cu13) pass.

🤖 Generated with Claude Code


CI States

Latest PR Test (Base): ✅ Run #41046383160
Latest PR Test (Extra): ❌ Run #41046383120
Latest PR Test (AMD ROCm 10): ➖ No AMD PR run found for this commit.

…in ea8b3439

Mirror the SemiAnalysis InferenceX AgentX SGLang / Dynamo+SGLang lanes at
InferenceX main ea8b3439 (DeepSeek-V4.1-Flash B300 and MiniMax-M3.1-Flash
B300 TP2, including the shortest-prefill-first points, now from their
dashboard runs), with InferenceX PRs sgl-project#4670 (Muse Spark Open GB200),
sgl-project#4454 (Muse Spark Open GB300), sgl-project#4603 sgl-project#4595 (DeepSeek-V4.1-Flash GB300) and
sgl-project#4333 (Qwen3.5 GB300) overlaid. The DeepSeek-V4 page is unchanged:
InferenceX sgl-project#4664 retired DeepSeek-V4-Pro.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@mintlify

mintlify Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

✅ Preview approved

@nvpohanh approved a Mintlify preview for commit 6a9e8b1.

@mintlify

mintlify Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated
sglang-doc 🟢 Ready View Preview Oct 30, 2026, 11:19 AM

💡 Tip: Enable Automations to automatically generate PRs for you.

@nvpohanh

Copy link
Copy Markdown
Collaborator Author

Preview looks good. Merge to unblock SA AgentX submission

@nvpohanh
nvpohanh merged commit 9691e71 into sgl-project:main Oct 30, 2026
115 of 120 checks passed
Yuxingwang-intel pushed a commit to Yuxingwang-intel/sglang that referenced this pull request Nov 6, 2026
…in ea8b3439 (sgl-project#47464)

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>

This branch was successfully deployed

1 active deployment
staging - docs — 6a9e8b1b Deployed Oct 30, 2026 by mintlify[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

deepseek documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant