Skip to content

[Klaud Cold] Update glm5.2-fp8-h200-dynamo-sglang-agentic-mtp-agg SGLang image to v0.5.20-cu130 / 将 glm5.2-fp8-h200-dynamo-sglang-agentic-mtp-agg 的 SGLang 镜像更新至 v0.5.20-cu130 #3271

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
adibarra wants to merge 1 commit into from
Closed

[Klaud Cold] Update glm5.2-fp8-h200-dynamo-sglang-agentic-mtp-agg SGLang image to v0.5.20-cu130 / 将 glm5.2-fp8-h200-dynamo-sglang-agentic-mtp-agg 的 SGLang 镜像更新至 v0.5.20-cu130 #3271

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 7 additions & 6 deletions ...arks/multi_node/srt-slurm-recipes/glm5.2/sglang/h200-fp8/agentx/agg-h200-tp8-mtp-c12.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,22 +6,23 @@ name: agg-h200-tp8-mtp-c12

model:
path: hf:zai-org/GLM-5.2-FP8
container: lmsysorg/sglang:nightly-dev-20260914-4358a161
container: lmsysorg/sglang:v0.5.20-cu130@sha256:06e4f2ed21afde4ff513cda65070124e727ba23ccaeff7712b8c40e1097d611f
precision: fp8

identity:
model:
repo: zai-org/GLM-5.2-FP8
revision: f33c6dc501ee5a2c7e35155653b1b1abbc320951
container:
image: lmsysorg/sglang:nightly-dev-20260914-4358a161
image: lmsysorg/sglang:v0.5.20-cu130@sha256:06e4f2ed21afde4ff513cda65070124e727ba23ccaeff7712b8c40e1097d611f
frameworks:
dynamo: 1.5.0.dev20260913
sglang: 4358a1617cad734fc37bf53d9e5c2092bd43d075
dynamo: 1.5.0.dev20260917
# SGLang v0.5.20 release tag, commit 94602c9c2b7cbdb8efd5c52802dac6a1c180089e.
sglang: 0.5.20

dynamo:
# This nightly includes the matching Dynamo adapter. Reinstalling an older
# wheel removes compatibility with this SGLang commit.
# The v0.5.20 release image bundles ai-dynamo 1.5.0.dev20260917. Reinstalling
# an older wheel removes compatibility with this SGLang release.
install: false

resources:
Expand Down
13 changes: 7 additions & 6 deletions ...arks/multi_node/srt-slurm-recipes/glm5.2/sglang/h200-fp8/agentx/agg-h200-tp8-mtp-c16.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,22 +6,23 @@ name: agg-h200-tp8-mtp-c16

model:
path: hf:zai-org/GLM-5.2-FP8
container: lmsysorg/sglang:nightly-dev-20260914-4358a161
container: lmsysorg/sglang:v0.5.20-cu130@sha256:06e4f2ed21afde4ff513cda65070124e727ba23ccaeff7712b8c40e1097d611f
precision: fp8

identity:
model:
repo: zai-org/GLM-5.2-FP8
revision: f33c6dc501ee5a2c7e35155653b1b1abbc320951
container:
image: lmsysorg/sglang:nightly-dev-20260914-4358a161
image: lmsysorg/sglang:v0.5.20-cu130@sha256:06e4f2ed21afde4ff513cda65070124e727ba23ccaeff7712b8c40e1097d611f
frameworks:
dynamo: 1.5.0.dev20260913
sglang: 4358a1617cad734fc37bf53d9e5c2092bd43d075
dynamo: 1.5.0.dev20260917
# SGLang v0.5.20 release tag, commit 94602c9c2b7cbdb8efd5c52802dac6a1c180089e.
sglang: 0.5.20

dynamo:
# This nightly includes the matching Dynamo adapter. Reinstalling an older
# wheel removes compatibility with this SGLang commit.
# The v0.5.20 release image bundles ai-dynamo 1.5.0.dev20260917. Reinstalling
# an older wheel removes compatibility with this SGLang release.
install: false

resources:
Expand Down
13 changes: 7 additions & 6 deletions ...marks/multi_node/srt-slurm-recipes/glm5.2/sglang/h200-fp8/agentx/agg-h200-tp8-mtp-c2.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,22 +6,23 @@ name: agg-h200-tp8-mtp-c2

model:
path: hf:zai-org/GLM-5.2-FP8
container: lmsysorg/sglang:nightly-dev-20260914-4358a161
container: lmsysorg/sglang:v0.5.20-cu130@sha256:06e4f2ed21afde4ff513cda65070124e727ba23ccaeff7712b8c40e1097d611f
precision: fp8

identity:
model:
repo: zai-org/GLM-5.2-FP8
revision: f33c6dc501ee5a2c7e35155653b1b1abbc320951
container:
image: lmsysorg/sglang:nightly-dev-20260914-4358a161
image: lmsysorg/sglang:v0.5.20-cu130@sha256:06e4f2ed21afde4ff513cda65070124e727ba23ccaeff7712b8c40e1097d611f
frameworks:
dynamo: 1.5.0.dev20260913
sglang: 4358a1617cad734fc37bf53d9e5c2092bd43d075
dynamo: 1.5.0.dev20260917
# SGLang v0.5.20 release tag, commit 94602c9c2b7cbdb8efd5c52802dac6a1c180089e.
sglang: 0.5.20

dynamo:
# This nightly includes the matching Dynamo adapter. Reinstalling an older
# wheel removes compatibility with this SGLang commit.
# The v0.5.20 release image bundles ai-dynamo 1.5.0.dev20260917. Reinstalling
# an older wheel removes compatibility with this SGLang release.
install: false

resources:
Expand Down
13 changes: 7 additions & 6 deletions ...marks/multi_node/srt-slurm-recipes/glm5.2/sglang/h200-fp8/agentx/agg-h200-tp8-mtp-c4.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,22 +6,23 @@ name: agg-h200-tp8-mtp-c4

model:
path: hf:zai-org/GLM-5.2-FP8
container: lmsysorg/sglang:nightly-dev-20260914-4358a161
container: lmsysorg/sglang:v0.5.20-cu130@sha256:06e4f2ed21afde4ff513cda65070124e727ba23ccaeff7712b8c40e1097d611f
precision: fp8

identity:
model:
repo: zai-org/GLM-5.2-FP8
revision: f33c6dc501ee5a2c7e35155653b1b1abbc320951
container:
image: lmsysorg/sglang:nightly-dev-20260914-4358a161
image: lmsysorg/sglang:v0.5.20-cu130@sha256:06e4f2ed21afde4ff513cda65070124e727ba23ccaeff7712b8c40e1097d611f
frameworks:
dynamo: 1.5.0.dev20260913
sglang: 4358a1617cad734fc37bf53d9e5c2092bd43d075
dynamo: 1.5.0.dev20260917
# SGLang v0.5.20 release tag, commit 94602c9c2b7cbdb8efd5c52802dac6a1c180089e.
sglang: 0.5.20

dynamo:
# This nightly includes the matching Dynamo adapter. Reinstalling an older
# wheel removes compatibility with this SGLang commit.
# The v0.5.20 release image bundles ai-dynamo 1.5.0.dev20260917. Reinstalling
# an older wheel removes compatibility with this SGLang release.
install: false

resources:
Expand Down
13 changes: 7 additions & 6 deletions ...marks/multi_node/srt-slurm-recipes/glm5.2/sglang/h200-fp8/agentx/agg-h200-tp8-mtp-c8.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,22 +6,23 @@ name: agg-h200-tp8-mtp-c8

model:
path: hf:zai-org/GLM-5.2-FP8
container: lmsysorg/sglang:nightly-dev-20260914-4358a161
container: lmsysorg/sglang:v0.5.20-cu130@sha256:06e4f2ed21afde4ff513cda65070124e727ba23ccaeff7712b8c40e1097d611f
precision: fp8

identity:
model:
repo: zai-org/GLM-5.2-FP8
revision: f33c6dc501ee5a2c7e35155653b1b1abbc320951
container:
image: lmsysorg/sglang:nightly-dev-20260914-4358a161
image: lmsysorg/sglang:v0.5.20-cu130@sha256:06e4f2ed21afde4ff513cda65070124e727ba23ccaeff7712b8c40e1097d611f
frameworks:
dynamo: 1.5.0.dev20260913
sglang: 4358a1617cad734fc37bf53d9e5c2092bd43d075
dynamo: 1.5.0.dev20260917
# SGLang v0.5.20 release tag, commit 94602c9c2b7cbdb8efd5c52802dac6a1c180089e.
sglang: 0.5.20

dynamo:
# This nightly includes the matching Dynamo adapter. Reinstalling an older
# wheel removes compatibility with this SGLang commit.
# The v0.5.20 release image bundles ai-dynamo 1.5.0.dev20260917. Reinstalling
# an older wheel removes compatibility with this SGLang release.
install: false

resources:
Expand Down
2 changes: 1 addition & 1 deletion configs/nvidia-master.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6733,7 +6733,7 @@ glm5.2-fp8-h200-dynamo-sglang-agentic-mtp-1p1d-hicache:
# concurrency uses an individual recipe so max-running-requests and CUDA graph
# capture are capped at twice the trajectory concurrency.
glm5.2-fp8-h200-dynamo-sglang-agentic-mtp-agg:
image: lmsysorg/sglang:nightly-dev-20260914-4358a161
image: lmsysorg/sglang:v0.5.20-cu130@sha256:06e4f2ed21afde4ff513cda65070124e727ba23ccaeff7712b8c40e1097d611f
model: zai-org/GLM-5.2-FP8
model-prefix: glm5.2
runner: cluster:h200-dgxc
Expand Down
Loading