Skip to content

[NV] Add B200 FP4 SGlang STP configs - #672

Merged
csahithi merged 2 commits into
mainfrom
nv/dsr1-fp4-b200-dynamo-sgl
Feb 11, 2026
Merged

[NV] Add B200 FP4 SGlang STP configs#672
csahithi merged 2 commits into
mainfrom
nv/dsr1-fp4-b200-dynamo-sgl

Conversation

@csahithi

@csahithi csahithi commented Feb 10, 2026

Copy link
Copy Markdown
Collaborator

Summary

Add DeepSeek-R1 FP4 B200 Dynamo SGLang STP (disaggregated) benchmark configurations.

Config key: dsr1-fp4-b200-dynamo-sglang
Image: lmsysorg/sglang:v0.5.8.post1-cu130-runtime
Model: deepseek-r1-fp4
Runner: b200-multinode-slurm

Configurations

1k1k (ISL=1024, OSL=1024):

Mode Topology Concurrencies
Low-latency DEP 1P (EP4) + 5D (TP8) 16, 128
Low-latency DEP 1P (EP4) + 6D (TP8) 32, 64, 256
Max-throughput DEP 1P (EP4) + 1D (EP8, dp-attn) 512
Max-throughput DEP 1P (EP4) + 2D (EP8, dp-attn) 512

8k1k (ISL=8192, OSL=1024):

Mode Topology Concurrencies
Low-latency DEP/TEP 1P (EP4) + 1D (TP8) 64, 128
Low-latency DEP/TEP 1P (EP4) + 5D (TP8) 8
Low-latency DEP/TEP 2P (EP4) + 5D (TP8) 4, 128
Low-latency TEP 1P (TP4) + 1D (TP8) 4, 8, 16, 64
Max-throughput DEP 7P (EP4) + 2D (EP8, dp-attn) 1024, 2048

@cquil11

cquil11 commented Feb 10, 2026

Copy link
Copy Markdown
Collaborator

@claude please add a PR description for posterity, mainly based on perf changelog

@Klaud-Cold

Klaud-Cold commented Feb 10, 2026

Copy link
Copy Markdown
Collaborator

Claude finished @cquil11's task in 31s —— View job


Adding PR Description

  • Read perf-changelog and config changes
  • Draft and update PR description

Updated the PR description with a summary of the new dsr1-fp4-b200-dynamo-sglang config, including a breakdown of all 1k1k and 8k1k recipes with their topologies and concurrency ranges.

Comment thread .github/configs/nvidia-master.yaml

@cquil11 cquil11 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Development

Successfully merging this pull request may close these issues.

4 participants