Skip to content

add B200 FP8 GLM5 sglang-dynamo disagg sweep configs - #262

Closed
yeswanthk-26 wants to merge 4 commits into
NVIDIA:llmb/inf-betafrom
yeswanthk-26:yeswanthk/glm5_b200_fp8_disagg
Closed

yeswanthk-26 wants to merge 4 commits into
NVIDIA:llmb/inf-betafrom
yeswanthk-26:yeswanthk/glm5_b200_fp8_disagg

Conversation

@yeswanthk-26

@yeswanthk-26 yeswanthk-26 commented Jul 13, 2026

Copy link
Copy Markdown
  • 1k_1k/hightpt.yaml (4 points)
  • 1k_1k/lowlat.yaml (2 points)
  • 8k_1k/hightpt.yaml (3 points)
  • 8k_1k/lowlat.yaml (6 points)
  • 16k_512/hightpt.yaml (3 points)
  • 16k_512/lowlat.yaml (6 points)

All 24 points were validated end-to-end on B200.

@ishandhanani

Copy link
Copy Markdown
Collaborator

Closing with the 2.0 merge (#407): recipe trees no longer live in this repository. Recipes live in the downstream InferenceMAX tree (benchmarks/multi_node/srt-slurm-recipes/), and the in-repo corpus is the curated examples/ matrix. srtctl migrate -f <recipe> --in-place rewrites a v1 recipe to the 2.0 layout. Please reopen these downstream if they are still current.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants