Update NVIDIA DeepSeek sglang Docker image from v0.5.5 to v0.5.6 - #276
Conversation
Co-authored-by: functionstackx <47992694+functionstackx@users.noreply.github.com>
|
@kedarpotdar-nv cc @ankursingh-nv results here https://github.com/InferenceMAX/InferenceMAX/actions/runs/19933312619 |
|
We're reviewing - please hold on merging. |
|
@kedarpotdar-nv @ankursingh-nv Reminder:
So for this PR, you will add something like the following entry to the bottom of - config-keys:
- dsr1-fp4-b200-sglang
- dsr1-fp8-b200-sglang
- dsr1-fp8-h200-sglang
description: |
- Update NVIDIA DeepSeek sglang Docker image from v0.5.5 to v0.5.6
PR: https://github.com/InferenceMAX/InferenceMAX/pull/276Then add the |
cquil11
left a comment
There was a problem hiding this comment.
please see comment about perf changelog
|
@ankursingh-nv where are we on this? I made changes to perf changelog and kicked off test run |
|
Thanks @cquil11, a few jobs failing. Need to look into it before we merge. |
| done | ||
| fi | ||
|
|
||
| sudo find . -not -user $USER -exec rm -rf {} + |
There was a problem hiding this comment.
Cleanup command accidentally removed from workflow
The line sudo find . -not -user $USER -exec rm -rf {} + was removed from the cleanup section, but this change is not mentioned in the PR description which only discusses Docker image version updates. The identical cleanup command still exists in benchmark-multinode-tmpl.yml, suggesting this removal is accidental. This command removes files not owned by the current user before checkout, and its absence could cause permission-related issues during git checkout or subsequent workflow runs.
Pin the GB300 DeepSeek-V4 AgentX path to NVIDIA/srt-slurm PR #276 through the upstream pull ref, verify its immutable head, and log whether srt-slurm supplied AIPerf worker metrics endpoints. 中文:将 GB300 DeepSeek-V4 AgentX 路径通过上游 Pull Request 引用固定到 NVIDIA/srt-slurm PR #276,校验不可变的 Head Commit,并在日志中明确标识 AIPerf Worker 指标端点是否由 srt-slurm 提供。
Updates all NVIDIA DeepSeek sglang configurations to use the latest Docker image version.
Changes
lmsysorg/sglang:v0.5.5-cu129-amd64tolmsysorg/sglang:v0.5.6-cu129-amd64in.github/configs/nvidia-master.yamldsr1-fp4-b200-sglangdsr1-fp8-b200-sglangdsr1-fp8-h200-sglangOriginal prompt
💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.
Note
Updates NVIDIA DeepSeek SGLang configs to latest Docker image.
.github/configs/nvidia-master.yaml, changeimagefromlmsysorg/sglang:v0.5.5-cu129-amd64tolmsysorg/sglang:v0.5.6-cu129-amd64fordsr1-fp4-b200-sglang,dsr1-fp8-b200-sglang, anddsr1-fp8-h200-sglangperf-changelog.yamldocumenting the image bump and PR linkWritten by Cursor Bugbot for commit e55faff. This will update automatically on new commits. Configure here.