Repository navigation
[Klaud Cold] Update Qwen3.5 FP4 GB200 Dynamo-SGLang AgentX MTP image to v0.5.22-cu130 / [Klaud Cold] 将 Qwen3.5 FP4 GB200 Dynamo-SGLang AgentX MTP 镜像更新至 v0.5.22-cu130 - #4278
Conversation
Pin lmsysorg/sglang:v0.5.22-cu130 by digest. v0.5.22 removed the --cuda-graph-max-bs and --mamba-scheduler-strategy aliases, so use --cuda-graph-max-bs-decode and --mamba-radix-cache-strategy. Dynamo 1.4.2 imports sglang.srt.server_args_config_parser, which moved to sglang.srt.utils; Dynamo 1.5.1 resolves either location. 将 GB200 FP4 Dynamo-SGLang AgentX 更新到 SGLang v0.5.22,并按摘要固定 lmsysorg/sglang:v0.5.22-cu130。v0.5.22 移除了 --cuda-graph-max-bs 和 --mamba-scheduler-strategy 别名,因此改用 --cuda-graph-max-bs-decode 和 --mamba-radix-cache-strategy。Dynamo 1.4.2 导入的 sglang.srt.server_args_config_parser 已移至 sglang.srt.utils;Dynamo 1.5.1 可兼容两个位置。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Thanks for the contribution!
中文感谢你的贡献!
|
|
Initial attempt · Failed · Run 39128853814 / attempt 1 · 2026-10-18 12:58 UTC Next: Repair 1 pins the Dynamo wheel to 1.6.0.dev20261015, the version bundled in the v0.5.22 image. 中文初次尝试 · 失败 · Run 39128853814 / attempt 1 · 2026-10-18 12:58 UTC |
Dynamo 1.5.1 calls ServerArgs.get_model_config(), which SGLang v0.5.22 removed. Pin 1.6.0.dev20261015, the version shipped in the v0.5.22 image. Dynamo 1.5.1 调用了 SGLang v0.5.22 已移除的 ServerArgs.get_model_config()。 改为固定 v0.5.22 镜像自带的 1.6.0.dev20261015。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Repair 1/5 · Failed · Run 39129509704 / attempt 1 · 2026-10-18 13:18 UTC Next: Repair 2 sets linear-replayssm-cache-len to 16, the v0.5.22 default and the minimum the commit kernel compiles with, in the four ReplaySSM variants. 中文修复 1/5 · 失败 · Run 39129509704 / attempt 1 · 2026-10-18 13:18 UTC |
SGLang v0.5.22 sizes the GDN ReplaySSM ring by linear-replayssm-cache-len, and its commit kernel's tl.dot needs an inner dimension of at least 16. Use 16, the v0.5.22 default. SGLang v0.5.22 按 linear-replayssm-cache-len 分配 GDN ReplaySSM 环形缓冲区, 其提交内核中的 tl.dot 要求内维至少为 16。改用 v0.5.22 默认值 16。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Repair 2/5 · Passed · Run 39130985168 / attempt 1 · 2026-10-18 14:42 UTC
Note: AgentX c1 PTP4x1/DTP4x0 dd714f, AgentX c2 PTP4x1/DTP4x0 f99308, AgentX c24 PTP4x1/DTP4x0 95bb75: Δ N/A: dataset/scenario/statistic mismatch.
Next: Smoke benchmarks and evals passed, so append the perf-changelog entry and run the full-sweep-fail-fast final sweep. 中文修复 2/5 · 已通过 · Run 39130985168 / attempt 1 · 2026-10-18 14:42 UTC |
新增 Qwen3.5 GB200 SGLang v0.5.22 的 perf-changelog 条目。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Final full sweep · Queued · Run 39137200943 / attempt 1 · 2026-10-18 14:43 UTC Next: Wait for complete final-sweep coverage, then verify artifacts against the frozen baseline. 中文最终完整 sweep · 排队中 · Run 39137200943 / attempt 1 · 2026-10-18 14:43 UTC |
|
View unofficial run (performance): https://inferencex.semianalysis.com/inference?unofficialRun=39145685012 View unofficial run (accuracy): https://inferencex.semianalysis.com/evaluation?unofficialRun=39145685012 |
|
Final full sweep · Failed · Run 39137200943 / attempt 2 · 2026-10-18 15:14 UTC Next: Repair 3 sets dynamo install to false so workers use the identical ai-dynamo 1.6.0.dev20261015 already in the v0.5.22 image and skip the flaky host download. 中文最终完整 sweep · 失败 · Run 39137200943 / attempt 2 · 2026-10-18 15:14 UTC |
Staging the identical 1.6.0.dev20261015 wheel from PyPI on the host failed intermittently with IncompleteRead; skip the install and use the image's copy. 在主机上从 PyPI 预取相同的 1.6.0.dev20261015 wheel 时会间歇性出现 IncompleteRead;跳过安装,直接使用镜像内置的版本。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Repair 3/5 · Passed · Run 39139577662 / attempt 1 · 2026-10-18 16:34 UTC
Note: AgentX c1 PTP4x1/DTP4x0 dd714f, AgentX c2 PTP4x1/DTP4x0 f99308, AgentX c24 PTP4x1/DTP4x0 95bb75: Δ N/A: dataset/scenario/statistic mismatch.
Next: Rerun the full-sweep-fail-fast final sweep at this head. 中文修复 3/5 · 已通过 · Run 39139577662 / attempt 1 · 2026-10-18 16:34 UTC |
|
Final full sweep · Queued · Run 39145685012 / attempt 1 · 2026-10-18 16:36 UTC Next: Wait for complete final-sweep coverage, then verify artifacts against the frozen baseline. 中文最终完整 sweep · 排队中 · Run 39145685012 / attempt 1 · 2026-10-18 16:36 UTC |
|
Final full sweep · Passed · Run 39145685012 / attempt 2 · 2026-10-19 00:35 UTC
Note: AgentX c1 PTP4x1/DTP4x0 dd714f, AgentX c2 PTP4x1/DTP4x0 f99308, AgentX c4 PTP4x1/DTP4x0 e25615, AgentX c8 PTP4x1/DTP4x0 adb59a, AgentX c12 PTP4x1/DTP4x0 2a9acc, AgentX c20 PTP4x1/DTP4x0 36ba59, AgentX c24 PTP4x1/DTP4x0 95bb75: Δ N/A: dataset/scenario/statistic mismatch.
Next: Mark ready for maintainer review. 中文最终完整 sweep · 已通过 · Run 39145685012 / attempt 2 · 2026-10-19 00:35 UTC |
|
resumed · The session ended before finishing; attempt 2 of its planner run continues it. 中文resumed · 会话未完成即已结束;其规划运行的第 2 次尝试将继续该会话。 |
|
validated · Repairs: unknown · Runs: 39128853814, 39129509704, 39130985168, 39137102013, 39137200943, 39139559001, 39139574348, 39139577662, 39145685012 中文validated · 修复次数:unknown · 运行:39128853814, 39129509704, 39130985168, 39137102013, 39137200943, 39139559001, 39139574348, 39139577662, 39145685012 |
Resolve conflicts: take main's refactored recipes and re-apply this PR's non-image edits; take main's perf-changelog.yaml and re-append this PR's entry. 中文:合并 origin/main;配方采用 main 重构后的版本并重新应用本 PR 的非镜像改动,perf-changelog.yaml 采用 main 版本并在末尾重新追加本 PR 的条目。
|
/use 39145685012 |
|
/reuse-sweep-run 39145685012 |
|
@adibarra staged run 39145685012. This run remains available across future |
Goal: Update SGLang image from lmsysorg/sglang:nightly-dev-20260818-c0b6474b to lmsysorg/sglang:v0.5.22-cu130.
Baseline: 2026-09-11 ·
lmsysorg/sglang:nightly-dev-20260818-c0b6474bMean latency · Sources: API 1, API 2, API 3
Note: AgentX c22 PTP2x1/DTP2x0 ddd472, AgentX c32 PTP2x1/DTP2x0 474621, AgentX c40 PTP2x1/DTP2x0 2aa262, AgentX c48 PTP2x1/DTP2x0 d5567a: unavailable.
Stop: Add the
klaud-abortlabel at any time to stop this candidate now; Klaud cancels its runs, closes this PR and does not retry it. Remove the label to let the planner pick it up again.中文
**目标:**将 SGLang 镜像从 lmsysorg/sglang:nightly-dev-20260818-c0b6474b 更新至 lmsysorg/sglang:v0.5.22-cu130。
**基线:**2026-09-11 ·
lmsysorg/sglang:nightly-dev-20260818-c0b6474b平均延迟 · 来源: API 1, API 2, API 3;数值及异常说明见上表。
**停止:**随时添加
klaud-abort标签即可立即停止该候选:Klaud 会取消其运行、关闭此 PR 且不再重试。移除该标签后,规划器会在下次扫描时重新考虑它。