Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion configs/nvidia-master.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -1541,7 +1541,7 @@ dsr1-fp8-b200-trt-mtp:
- { tp: 8, ep: 1, conc-start: 4, conc-end: 256, spec-decoding: mtp }

dsr1-fp8-h200-sglang:
image: lmsysorg/sglang:v0.5.12-cu130
image: lmsysorg/sglang:v0.5.19-cu130
model: deepseek-ai/DeepSeek-R1-0528
model-prefix: dsr1
runner: h200
Expand Down
6 changes: 6 additions & 0 deletions perf-changelog.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -7286,3 +7286,9 @@
description:
- "Use thinking-on golden synthetic AL 3.51 for five-token DSpark throughput; disable adaptive verification and retain real verification for evals"
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/2974

- config-keys:
- dsr1-fp8-h200-sglang
description:
- "Update the DeepSeek-R1-0528 FP8 H200 SGLang image from v0.5.12-cu130 to v0.5.19-cu130. Model, TP8 topology, 8k1k workload, concurrency grid, launch flags and evals are unchanged."
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/3010
Loading