Skip to content

[Klaud Cold] Update qwen3.5-fp8-h200-sglang-agentic-hicache-mtp SGLang image to nightly-dev-cu13-20260927-425a1f8f / [Klaud Cold] 将 qwen3.5-fp8-h200-sglang-agentic-hicache-mtp 的 SGLang 镜像更新至 nightly-dev-cu13-20260927-425a1f8f - #3528

Closed
Klaud-Cold wants to merge 1 commit into
mainfrom
klaud/auto-8e051edc9c729447-62cd6fb27cbff374

Conversation

@Klaud-Cold

@Klaud-Cold Klaud-Cold commented Sep 28, 2026 •

Copy link
Copy Markdown
Collaborator

Goal: Update SGLang image from lmsysorg/sglang:nightly-dev-cu13-20260916-c9a8fba9 to lmsysorg/sglang:nightly-dev-cu13-20260927-425a1f8f@sha256:750718d6416b730c6ebbdd2d2f86c78d31878e4bd5cdddcd64dd1ab9f7d5537d.
Baseline: 2026-09-21 · lmsysorg/sglang:nightly-dev-cu13-20260916-c9a8fba9
Mean latency · Sources: API 1, API 2, API 3, API 4

Point Total tok/s/GPU ↑ Output tok/s/GPU ↑ TTFT ms ↓ TPOT ms ↓
AgentX c2 TP8 EP1 6ec487 2,301.02 24.86 787.46 3.74
AgentX c2 TP8 EP1 aad317 N/A N/A N/A N/A
AgentX c4 TP8 EP1 5436dd N/A N/A N/A N/A
AgentX c4 TP8 EP1 ed3ee9 2,997.8 32.28 674.88 4.04
AgentX c8 TP8 EP1 3a8341 4,946.13 48.46 798.79 5.1
AgentX c8 TP8 EP1 59587e N/A N/A N/A N/A
AgentX c10 TP8 EP1 2e8e2f 5,982.84 59.21 893.68 6.51
AgentX c10 TP8 EP1 e5dfcb N/A N/A N/A N/A
AgentX c12 TP8 EP1 0ff2ad N/A N/A N/A N/A
AgentX c12 TP8 EP1 a8098a 7,690.13 70.93 885.86 6.99
AgentX c16 TP8 EP1 1954ed N/A N/A N/A N/A
AgentX c16 TP8 EP1 4ca4b2 9,863.8 86.77 1,027.84 8.82
AgentX c20 TP8 EP1 3ce26e N/A N/A N/A N/A
AgentX c20 TP8 EP1 a27e53 11,695.98 99.83 1,072.41 10.34
AgentX c24 TP8 EP1 4df316 N/A N/A N/A N/A
AgentX c24 TP8 EP1 84d2be 13,501.73 109.79 1,187.81 13.21

Note: AgentX c2 TP8 EP1 aad317, AgentX c4 TP8 EP1 5436dd, AgentX c8 TP8 EP1 59587e, AgentX c10 TP8 EP1 e5dfcb, AgentX c12 TP8 EP1 0ff2ad, AgentX c16 TP8 EP1 1954ed, AgentX c20 TP8 EP1 3ce26e, AgentX c24 TP8 EP1 4df316: unavailable.

Eval Score ↑ Samples
gsm8k/em_strict · c24 97.57% 1,319
中文

**目标:**将 SGLang 镜像从 lmsysorg/sglang:nightly-dev-cu13-20260916-c9a8fba9 更新为 lmsysorg/sglang:nightly-dev-cu13-20260927-425a1f8f@sha256:750718d6416b730c6ebbdd2d2f86c78d31878e4bd5cdddcd64dd1ab9f7d5537d。
**基线:**2026-09-21 · lmsysorg/sglang:nightly-dev-cu13-20260916-c9a8fba9
平均延迟 · 来源: API 1, API 2, API 3, API 4;数值及异常说明见上表。

Update qwen3.5-fp8-h200-sglang-agentic-hicache-mtp and its
override_hicache_ep1 recipe variant from
lmsysorg/sglang:nightly-dev-cu13-20260916-c9a8fba9 to the digest-pinned
nightly-dev-cu13-20260927-425a1f8f.

将 qwen3.5-fp8-h200-sglang-agentic-hicache-mtp 及其 override_hicache_ep1
配方变体的 SGLang 镜像从 nightly-dev-cu13-20260916-c9a8fba9 更新为按摘要固定的
nightly-dev-cu13-20260927-425a1f8f。

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

Thanks for the contribution!

  • Review: If this PR changes files owned by someone other than a repository admin or @SemiAnalysisAI/core, ask one eligible CODEOWNER to complete the latest PR_REVIEW_CHECKLIST.md before contacting a core maintainer on Slack. Follow the template exactly, including As a PR reviewer and CODEOWNER, I have reviewed this and have, so sign-off verification triggers.
  • PR verification: Sweeps only run on labeled PRs. Add full-sweep-fail-fast (strongly recommended); use full-sweep-enabled only when matrix jobs should continue after a failure.
  • After merging: PR authors must ensure all GitHub Actions jobs pass. Transient failures often pass on rerun; see how to rerun failed jobs.
中文

感谢你的贡献!

  • **审阅:**如果 PR 修改的文件归属于仓库管理员及 @SemiAnalysisAI/core 之外的 CODEOWNER,请先联系一位有资格的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,再通过 Slack 联系核心维护者。必须严格遵循模板,并保留 As a PR reviewer and CODEOWNER, I have reviewed this and have,才能触发签核验证。
  • **PR 验证:**扫描仅在带有标签的 PR 上运行。强烈建议添加 full-sweep-fail-fast;仅当需要矩阵任务在失败后继续运行时才使用 full-sweep-enabled。
  • **合并后:**PR 作者必须确保所有 GitHub Actions 任务通过。临时性失败通常可以通过重新运行恢复;参见重新运行失败任务的说明。

@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

Stopped before GPU dispatch · baseline point mismatch
The frozen 2026-09-21 roster includes 8 producer points from run 35145000323 (f137552f) generated before the native SRT migration (#3428): AgentX c2/c4/c8/c10/c12/c16/c20/c24 TP8 EP1 6ec487, ed3ee9, 3a8341, 2e8e2f, a8098a, 4ca4b2, a27e53, 84d2be. Their identities differ from the current family only by srt-recipe, so the canonical final matrix cannot contain them without changing recipe references, and final validation would fail. No benchmark was run.

Source check: SGLang c9a8fba9...425a1f8f keeps every recipe flag; torch 2.13.0, flashinfer 0.6.18 and sglang-kernel 0.4.7 are unchanged; SGLANG_ENABLE_SPEC_V2 is a no-op in both images (the old image only warns).

中文

在 GPU 调度前停止 · 基线点不匹配
冻结的 2026-09-21 基线包含 run 35145000323 在原生 SRT 迁移(#3428)之前生成的 8 个点(见上方列表)。它们与当前 family 的差异仅为 srt-recipe,因此在不改动配方引用的前提下,最终矩阵无法包含这些点,最终验证必然失败。未运行任何基准测试。

**源码检查:**SGLang c9a8fba9...425a1f8f 保留了配方使用的全部参数;torch、flashinfer 与 sglang-kernel 版本未变;SGLANG_ENABLE_SPEC_V2 在两个镜像中均无实际作用(旧镜像仅发出警告)。

@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

failed · Cleanup pending. Stop and confirm owned runs before closing.

中文

failed · 清理待完成。先停止并确认自有运行结束,再关闭 PR。

@Klaud-Cold Klaud-Cold closed this Sep 28, 2026
@Klaud-Cold
Klaud-Cold deleted the klaud/auto-8e051edc9c729447-62cd6fb27cbff374 branch September 28, 2026 01:08
@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

failed · Reason: baseline-point-mismatch · Repairs: 0 · Runs: —
All owned runs ended. PR closed; branch deleted for retry.

中文

failed · 原因:baseline-point-mismatch · 修复次数:0 · 运行:—
所有自有运行均已结束。PR 已关闭;分支已删除,可重新尝试。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

1 participant