Skip to content

Update NVIDIA DeepSeek sglang Docker image from v0.5.5 to v0.5.6 #276

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
cquil11 merged 15 commits into from
Dec 31, 2025
Merged

Update NVIDIA DeepSeek sglang Docker image from v0.5.5 to v0.5.6 #276

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
ffa4a55
Initial plan
Copilot Dec 4, 2025
a572298
Update NVIDIA DeepSeek sglang from v0.5.5 to v0.5.6
Copilot Dec 4, 2025
3064ab9
Merge branch 'main' into copilot/update-nvidia-deepseek-sglang
cquil11 Dec 4, 2025
edb7fad
Merge branch 'main' into copilot/update-nvidia-deepseek-sglang
cquil11 Dec 15, 2025
e83f837
Merge branch 'main' into copilot/update-nvidia-deepseek-sglang
cquil11 Dec 17, 2025
6e2f27a
make changes to perf changelog
cquil11 Dec 17, 2025
6264749
Merge branch 'main' into copilot/update-nvidia-deepseek-sglang
Ankur-singh Dec 22, 2025
757319e
fix perf-change file
Ankur-singh Dec 22, 2025
55e0178
fix delete line error
Ankur-singh Dec 22, 2025
49e7569
remove resource cleanup
Ankur-singh Dec 23, 2025
c4cff77
update perf-change logs
Ankur-singh Dec 30, 2025
02bea98
Merge branch 'main' into copilot/update-nvidia-deepseek-sglang
Ankur-singh Dec 30, 2025
099904c
Merge branch 'main' into copilot/update-nvidia-deepseek-sglang
cquil11 Dec 31, 2025
c98390c
Merge branch 'main' into copilot/update-nvidia-deepseek-sglang
cquil11 Dec 31, 2025
e55faff
Merge branch 'main' into copilot/update-nvidia-deepseek-sglang
cquil11 Dec 31, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions .github/configs/nvidia-master.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
dsr1-fp4-b200-sglang:
image: lmsysorg/sglang:v0.5.5-cu129-amd64
image: lmsysorg/sglang:v0.5.6-cu129-amd64
model: nvidia/DeepSeek-R1-0528-FP4-V2
model-prefix: dsr1
runner: b200
Expand Down Expand Up @@ -75,7 +75,7 @@ dsr1-fp4-b200-trt:
- { tp: 8, ep: 8, dp-attn: true, conc-start: 64, conc-end: 256 }

dsr1-fp8-b200-sglang:
image: lmsysorg/sglang:v0.5.5-cu129-amd64
image: lmsysorg/sglang:v0.5.6-cu129-amd64
model: deepseek-ai/DeepSeek-R1-0528
model-prefix: dsr1
runner: b200
Expand Down Expand Up @@ -124,7 +124,7 @@ dsr1-fp8-b200-trt:
- { tp: 8, ep: 8, conc-start: 4, conc-end: 64 }

dsr1-fp8-h200-sglang:
image: lmsysorg/sglang:v0.5.5-cu129-amd64
image: lmsysorg/sglang:v0.5.6-cu129-amd64
model: deepseek-ai/DeepSeek-R1-0528
model-prefix: dsr1
runner: h200
Expand Down
8 changes: 8 additions & 0 deletions perf-changelog.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -116,3 +116,11 @@
description:
- "Updating MI355x Deepseek-R1 FP4 SGLang Image to upstream v0.5.6.post2"
pr-link: https://github.com/InferenceMAX/InferenceMAX/pull/369

- config-keys:
- dsr1-fp4-b200-sglang
- dsr1-fp8-b200-sglang
- dsr1-fp8-h200-sglang
description:
- "Update NVIDIA DeepSeek sglang Docker image from v0.5.5 to v0.5.6"
pr-link: https://github.com/InferenceMAX/InferenceMAX/pull/276
Loading