Repository navigation
[Klaud Cold] Update DeepSeek-V4.1-Flash FP4 GB300 Dynamo-SGLang AgentX disagg image to nightly-dev-cu13-20261025-65633129 / [Klaud Cold] 将 DeepSeek-V4.1-Flash FP4 GB300 Dynamo-SGLang AgentX disagg 镜像更新至 nightly-dev-cu13-20261025-65633129 - #4515
Conversation
…nightly-dev-cu13-20261025-65633129 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Thanks for the contribution!
中文感谢你的贡献！
|
|
Initial attempt · Failed · Run 40212135762 / attempt 1 · 2026-10-26 06:56 UTC
Note: AgentX c1228 PTP2x3/DTP16x1 1aed7b, AgentX c2884 PTP2x5/DTP16x1 e5b420: cancelled.
Note: gsm8k/em_strict · c1228: unavailable. Next: Rerun the failed and cancelled jobs on the same head as infrastructure retry 1 for the NVLink hardware fault. 中文初次尝试 · 失败 · Run 40212135762 / attempt 1 · 2026-10-26 06:56 UTC |
|
parked · Session 1 is waiting on 40212135762. Recovery reruns preempted runs and starts the next session once they end. 中文parked · 第 1 个会话正在等待 40212135762。恢复流程会重跑被抢占的运行，并在运行结束后启动下一个会话。 |
|
resumed · The session ended before finishing; session 2 continues it in a new run of its planner. 中文resumed · 会话未完成即已结束；第 2 个会话将在其规划运行的新运行中继续。 |
|
Infrastructure retry 1/2 · Passed · Run 40212135762 / attempt 2 · 2026-10-26 11:33 UTC
Next: Append the perf-changelog entry and dispatch the full-sweep-fail-fast final sweep. 中文基础设施重试 1/2 · 已通过 · Run 40212135762 / attempt 2 · 2026-10-26 11:33 UTC |
|
parked · Session 2 is waiting on 40212135762. Recovery reruns preempted runs and starts the next session once they end. 中文parked · 第 2 个会话正在等待 40212135762。恢复流程会重跑被抢占的运行，并在运行结束后启动下一个会话。 |
|
resumed · The session ended before finishing; session 3 continues it in a new run of its planner. 中文resumed · 会话未完成即已结束；第 3 个会话将在其规划运行的新运行中继续。 |
…34609f-3e969744d35314be
…isagg AgentX image update Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Klaud-Cold
added
the
full-sweep-fail-fast
|
Final full sweep · Passed · Run 40316025285 / attempt 1 · 2026-10-26 14:57 UTC
Note: AgentX c2884 PTP2x5/DTP16x1 e5b420: 1 request error.
Next: Mark ready for maintainer review. 中文最终完整 sweep · 已通过 · Run 40316025285 / attempt 1 · 2026-10-26 14:57 UTC |
|
parked · Session 3 is waiting on 40316025285. Recovery reruns preempted runs and starts the next session once they end. 中文parked · 第 3 个会话正在等待 40316025285。恢复流程会重跑被抢占的运行，并在运行结束后启动下一个会话。 |
|
View unofficial run (performance): https://inferencex.semianalysis.com/inference?unofficialRun=40316025285 View unofficial run (accuracy): https://inferencex.semianalysis.com/evaluation?unofficialRun=40316025285 |
|
validated · Repairs: unknown · Runs: 40212135762, 40315973196, 40316025285 中文validated · 修复次数：未知 · 运行：40212135762, 40315973196, 40316025285 |
![claude[bot]](https://avatars.githubusercontent.com/in/1236702?s=60&v=4){kind=small}
| frameworks: | ||
| dynamo: "1.6.0.dev20261019" | ||
| sglang: "0.0.0.dev1+gc1c287a42" | ||
| dynamo: "1.6.0" |
There was a problem hiding this comment.
🟡 (optional) Published disagg results will carry a stale router label, dynamo-router 1.6.0.dev20261019, while the recipe now says the image ships dynamo 1.6.0. The recipe identity moves dynamo to "1.6.0". The master key's router at configs/nvidia-master.yaml:9548 still says "1.6.0.dev20261019". Fix: set that router version to "1.6.0" so both match the pinned image, and mention the Dynamo change in the new perf-changelog entry. Before this PR the two values matched.
Why this was flagged
The key dsv41flash-fp4-gb300-dynamo-sglang-agentic-dspark-disagg uses dynamo: install: false (disagg-variants.yaml:11-12), so Dynamo comes from the image. This PR changes the recipe identity to dynamo: "1.6.0" for the new 20261025 image. The master entry keeps router: { name: dynamo-router, version: "1.6.0.dev20261019" } (nvidia-master.yaml:9548). CONFIGS.md:145 says router versions "label what the image ships". generate.py:53 exports the point's router as ROUTER_METADATA, and results/agentic/init.py:214 writes it into each result's router field. So after merge, every c1228/c2884/c4096 result is tagged with the old Dynamo dev build. On the base branch both values were 1.6.0.dev20261019, the version the 10853 changelog entry says the c1c287a4 image ships. No check catches this. workload.py _bind_components only checks the router version when a repo setup script installs it, and this recipe installs nothing. The new changelog entry (perf-changelog.yaml:11217) also leaves out the Dynamo version change.
Verification: Trigger: any sweep of dsv41flash-fp4-gb300-dynamo-sglang-agentic-dspark-disagg on the new image. disagg-variants.yaml changes the identity to dynamo: "1.6.0", but configs/nvidia-master.yaml:9548 still has router version "1.6.0.dev20261019". On the base both said 1.6.0.dev20261019. No validator compares the router version with the recipe identity.
|
/use 40316025285 |
|
@adibarra staged run 40316025285. This run remains available across future |
Resolve perf-changelog.yaml by taking main's file and re-appending this PR's entry. 中文：合并 origin/main；perf-changelog.yaml 采用 main 版本，并在末尾重新追加本 PR 的条目。
|
Ingest report — ✅ Results ingested into the Ingest workflow · Merge Ingest run · Benchmark source run
benchmarkFiles 3, rawBenchmarkRows 3, coveredByPerJobFiles 0, purgedPoints 0, failedRunRows 0, runStatsNew 0, runStatsDuplicate 0, evalSamplesNew 3957, gpuMetricSamplesNew 0, powerPublicationPoints 3, changelogEntriesWritten 1 Counts cover only this run. Rows: benchmark_results, eval_results, agentic rows linked to a trace, gpu_metrics series. This comment updates if the ingest is rerun. 中文Ingest 报告 — ✅ 结果已写入 上表仅统计本次运行写入的数据，各行单位依次为 benchmark_results 行、eval_results 行、已关联 trace 的 agentic 行和 gpu_metrics 序列。重新运行 ingest 时本评论会原地更新。 |
|
[by Claude Code] The SGLang cookbook integration of this PR's AgentX config ( The commands mirror the launch measured in run 40316025285, pinned by this PR's |
|
[by Claude Code] sgl-project/sglang#46807 has been merged. This PR's AgentX config ( The commands mirror the launch measured in run 40316025285, pinned by this PR's |
|
[by Claude Code] The SGLang cookbook update of this PR's AgentX config ( The commands mirror the launch measured in run 40316025285, pinned by this PR's |
|
[by Claude Code] sgl-project/sglang#46948 has been merged. This PR's AgentX config ( The commands mirror the launch measured in run 40316025285, pinned by this PR's |
Goal: Update SGLang image from lmsysorg/sglang:nightly-dev-cu13-20261021-c1c287a4 to lmsysorg/sglang:nightly-dev-cu13-20261025-65633129.
Baseline: 2026-10-22 ·
lmsysorg/sglang:nightly-dev-cu13-20261021-c1c287a4@sha256:b0473834763b2753e069cb96c1acaf235ba7fd632ccd9bbeb44da809c437fdebMean latency · Sources: API 1, API 2, API 3, API 4
Stop: Close this PR at any time to stop this candidate now; Klaud cancels its runs and deletes its branch.
中文
**目标：**将 SGLang 镜像从 lmsysorg/sglang:nightly-dev-cu13-20261021-c1c287a4 更新至 lmsysorg/sglang:nightly-dev-cu13-20261025-65633129。
**基线：**2026-10-22 ·
lmsysorg/sglang:nightly-dev-cu13-20261021-c1c287a4@sha256:b0473834763b2753e069cb96c1acaf235ba7fd632ccd9bbeb44da809c437fdeb平均延迟 · 来源： API 1, API 2, API 3, API 4；数值及异常说明见上表。
**停止：**随时关闭此 PR 即可立即停止该候选：Klaud 会取消其运行并删除其分支。