Skip to content

[Klaud Cold] Re-sweep Muse Spark Open B300 on the full trace corpus / [Klaud Cold] 在完整轨迹数据集上重新 sweep Muse Spark Open B300 - #4292

Merged
Oseltamivir merged 5 commits into
mainfrom
klaud/musespark-b300-full-corpus-resweep
Oct 19, 2026
Merged

Oseltamivir merged 5 commits into
mainfrom
klaud/musespark-b300-full-corpus-resweep

Conversation

@functionstackx

@functionstackx functionstackx commented Oct 18, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Re-sweeps musespark-fp4-b300-sglang-agentic-dflash on the full, uncapped AgentX trace corpus (semianalysis_cc_traces_weka_062126).

#4287 removed the Muse Spark 256k exception, so every Muse Spark AgentX point now replays the full corpus. That PR merged without a sweep. This PR appends one changelog entry for the B300 config so the published curve is re-measured on the new corpus. The image and search space are unchanged.

Fix after the first sweep: every rank hit Hugging Face 429 rate limits when looking up the RadixArk/Muse-Spark-Open-DFlash2 draft revision while several sweeps launched together. The recipe now sets HF_HUB_OFFLINE=1, the same setting the MI355X Muse Spark recipe already uses, so ranks load the draft from the shared HF cache with no Hub API calls.

This is one of seven per-SKU re-sweep PRs (H100, H200, B200, B300, GB200, GB300 and MI355X).

AI model disclosure
  • Model/version: claude-opus-5-5[1m] (Claude Opus 5.5, via Claude Code)
  • Role: wrote the changelog entry, opened this PR and is monitoring the sweep.
PR checklist and change type

Type of Change

  • Configuration change

Checklist

  • I have completed the AI model disclosure and kept it current
  • One new perf-changelog entry is appended for the affected config key
  • One primary sweep label: full-sweep-fail-fast
中文

摘要

在完整、未截断的 AgentX 轨迹数据集(semianalysis_cc_traces_weka_062126)上重新 sweep musespark-fp4-b300-sglang-agentic-dflash。

#4287 移除了 Muse Spark 的 256k 例外,所有 Muse Spark AgentX 点现在都回放完整数据集。该 PR 合并时没有运行 sweep。本 PR 为 B300 配置追加一条 changelog 记录,以便在新数据集上重新测量公开曲线。镜像和搜索空间均不变。

首次 sweep 后的修复: 多个 sweep 同时启动时,每个 rank 查询 RadixArk/Muse-Spark-Open-DFlash2 draft 版本都触发了 Hugging Face 429 限流。配方现设置 HF_HUB_OFFLINE=1(与 MI355X Muse Spark 配方一致),各 rank 从共享 HF 缓存加载 draft,不再调用 Hub API。

这是七个按 SKU 拆分的重新 sweep PR 之一(H100、H200、B200、B300、GB200、GB300 和 MI355X)。

AI 模型使用说明

  • 模型/版本:claude-opus-5-5[1m](Claude Opus 5.5,通过 Claude Code)
  • 工作内容:编写 changelog 记录,创建本 PR 并监控 sweep。

🤖 Generated with Claude Code

…sweep Muse Spark Open B300

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
@functionstackx
functionstackx requested a review from a team October 18, 2026 23:57
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

Thanks for the contribution!

  • Review: If this PR changes files owned by someone other than a repository admin or @SemiAnalysisAI/core, ask one eligible CODEOWNER to complete the latest PR_REVIEW_CHECKLIST.md before contacting a core maintainer on Slack. Follow the template exactly, including As a PR reviewer and CODEOWNER, I have reviewed this and have, so sign-off verification triggers.
  • PR verification: Sweeps run only when the PR appends an inferencex-e2e/perf-changelog.yaml entry and carries exactly one primary label: full-sweep-fail-fast (strongly recommended; canary plus per-matrix fail-fast), full-sweep-enabled (canary; matrix jobs continue after a failure), or non-canary-full-sweep-enabled (no canary or fail-fast). The modifiers all-evals, evals-only, and agentx-fast require a primary label. On fork PRs, a maintainer applies the label. See sweep labels and reuse.
  • After merging: PR authors must ensure all GitHub Actions jobs pass. Transient failures often pass on rerun; see how to rerun failed jobs.
中文

感谢你的贡献!

  • **审阅:**如果 PR 修改的文件归属于仓库管理员及 @SemiAnalysisAI/core 之外的 CODEOWNER,请先联系一位有资格的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,再通过 Slack 联系核心维护者。必须严格遵循模板,并保留 As a PR reviewer and CODEOWNER, I have reviewed this and have,才能触发签核验证。
  • **PR 验证:**只有当 PR 在 inferencex-e2e/perf-changelog.yaml 末尾追加了条目,并且恰好带有一个主标签时,才会运行扫描:full-sweep-fail-fast(强烈推荐;canary 加逐矩阵 fail-fast)、full-sweep-enabled(有 canary;矩阵任务在失败后继续运行)或 non-canary-full-sweep-enabled(无 canary,也无 fail-fast)。修饰标签 all-evals、evals-only 和 agentx-fast 必须与主标签一起使用。fork PR 的标签由维护者添加。参见扫描标签与复用。
  • **合并后:**PR 作者必须确保所有 GitHub Actions 任务通过。临时性失败通常可以通过重新运行恢复;参见重新运行失败任务的说明。

@functionstackx functionstackx added the full-sweep-fail-fast Full sweep with canary gate; first failure cancels the rest of that matrix (recommended) label Oct 18, 2026

@claude claude Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code review found no issues

No high-confidence issues detected in this change.

This review covers commit aad1e31, which is no longer the latest commit on this pull request; later commits are not covered by it.

@github-actions

github-actions Bot commented Oct 19, 2026 •

Copy link
Copy Markdown
Contributor

Concurrent launches tripped the Hub 429 API rate limit on the draft
revision lookup; mirror the MI355X recipe's HF_HUB_OFFLINE=1.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
@Oseltamivir

Copy link
Copy Markdown
Collaborator

/use 39181803276

@github-actions

github-actions Bot commented Oct 19, 2026 •

Copy link
Copy Markdown
Contributor

@Oseltamivir staged run 39181803276.

This run remains available across future /stage-results requests. Staging the same run ID again updates its staged data. Staging workflow

@Oseltamivir
Oseltamivir merged commit d892f56 into main Oct 19, 2026
3 checks passed
@Oseltamivir
Oseltamivir deleted the klaud/musespark-b300-full-corpus-resweep branch October 19, 2026 06:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

full-sweep-fail-fast Full sweep with canary gate; first failure cancels the rest of that matrix (recommended)

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants