Skip to content

[Doc] cookbook: Add Nemotron 3.5 Super VL - #44510

Merged
zijiexia merged 5 commits into
mainfrom
docs/nemotron35-super-vl-upstream-20261015
Oct 15, 2026
Merged

zijiexia merged 5 commits into
mainfrom
docs/nemotron35-super-vl-upstream-20261015

Conversation

@Jiminator

@Jiminator Jiminator commented Oct 15, 2026 •

Copy link
Copy Markdown
Collaborator

Motivation

Add an interactive Nemotron 3.5 Super VL cookbook at /cookbook/autoregressive/NVIDIA/Nemotron3.5-Super. The SGLang model source is on the nemotron3-super-dev-20261015 branch.

Modifications

  • Add single-node B200, H200, RTX PRO 6000, and DGX Spark recipes. B200 offers NVFP4 and BF16, H200 offers BF16, and RTX PRO 6000 and DGX Spark offer NVFP4.
  • Add a Mamba SSM DType selector with bfloat16 and float32. High Throughput omits MTP; Low Latency enables EAGLE MTP.
  • Keep --moe-runner-backend triton on H200. Omit the explicit attention backend, maximum running requests, and static memory fraction from B200 recipes; omit the last two limits from H200 recipes.
  • Show GSM8K accuracy only in the selected recipe's Benchmark card. All non-Spark float32 selections are verified; Spark float32 remains unverified.
  • Add the page to navigation and the NVIDIA homepage card; move the NEW tag from the prior NVIDIA page.

Accuracy Tests

The bfloat16 Mamba-state source runs cover all ten supported hardware/quantization/strategy cells. All eight non-Spark float32 selections completed 300-question text-only GSM8K runs with zero request errors. Spark float32 testing was stopped before completing the cohort.

The completed results used the early-access NGC weights and source at 2c7511f6f7cf1cdf9ae568ad0fb25f291edb10da. The command panel uses the public lmsysorg/sglang:nemotron3-5-super tag and the requested public Hugging Face checkpoint IDs. Those public artifacts have not been verified by the accuracy runs.

Speed Tests and Profiling

Not applicable to this documentation change. The strategy labels do not assert measured throughput or latency gains.

Validation

  • node docs/scripts/check_cookbook_configs.mjs passed.
  • mint validate passed.
  • mint broken-links passed.
  • git diff --check passed.

CI States

Latest PR Test (Base): ✅ Run #38761659422
Latest PR Test (Extra): ❌ Run #38761659039
Latest PR Test (AMD ROCm 10): ➖ No AMD PR run found for this commit.

@mintlify

mintlify Bot commented Oct 15, 2026 •

Copy link
Copy Markdown
Contributor

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated
sglang-doc 🟢 Ready View Preview Oct 15, 2026, 3:32 PM

💡 Tip: Enable Automations to automatically generate PRs for you.

@github-actions github-actions Bot added the documentation Improvements or additions to documentation label Oct 15, 2026
@Jiminator
Jiminator marked this pull request as ready for review October 15, 2026 15:24
@zijiexia
zijiexia merged commit 05cbe24 into main Oct 15, 2026
108 of 112 checks passed
@zijiexia
zijiexia deleted the docs/nemotron35-super-vl-upstream-20261015 branch October 15, 2026 15:39

This branch was successfully deployed

1 active deployment
staging - docs — 6d4c9720 Deployed Oct 15, 2026 by mintlify[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants