Repository navigation
[Docs] Add GB300 NVFP4 multi-node GLM-5.2 recipe - #42829
Closed
Ankur-singh wants to merge 2 commits into
Closed
Ankur-singh wants to merge 2 commits into
Ankur-singh wants to merge 2 commits into
Conversation
Ankur-singh
requested review from
JustinTong0323,
sogalin,
wisclmy0611 and
zijiexia
as code owners
October 6, 2026 23:00
Contributor
Author
|
@faradawn Can you please help review this? |
5 of 11 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Motivation
The GLM-5.2 Deployment selector has no GB300/NVFP4/Low-Latency multi-node cell, so it disables Multi-Nodes. This adds a compact recipe for one TP8 worker spanning two four-GPU GB300 nodes.
Modifications
Source and qualification
Derived from InferenceX #3659's TP8 C4 recipe at e79239ba, tested in run 36997573694, attempt 2.
That sweep used Dynamo and
lmsysorg/sglang:nightly-dev-20260914-4358a161. This simplified standalone command uses the cookbook's existing GB300 image selection (lmsysorg/sglang:latest) and does not reproduce the full benchmark configuration. The standalone adaptation and current image have not been tested on GPUs.Related #42726 covers broader Dynamo/disaggregated recipes. This patch addresses the existing selector and does not claim to complete all of #3659's recipe requirements.
Accuracy Tests
GPU startup and model evaluation were not run. The recipe remains unverified.
Speed Tests and Profiling
Not run; no benchmark numbers are added.
Checklist
Prepared with Codex (GPT-6); the exact runtime model version was not exposed.
CI States
Latest PR Test (Base): ✅ Run #37545675299
Latest PR Test (Extra): ❌ Run #37545675082
Latest PR Test (AMD ROCm 10): ➖ No AMD PR run found for this commit.