Skip to content

[AgentX] Refresh Kimi K3 DSpark on B300 / [AgentX] 刷新 B300 上的 Kimi K3 DSpark - #2476

Merged
cquil11 merged 14 commits into
mainfrom
agent/refresh-kimik3-b300-dspark-agentx
Aug 11, 2026
Merged

[AgentX] Refresh Kimi K3 DSpark on B300 / [AgentX] 刷新 B300 上的 Kimi K3 DSpark#2476
cquil11 merged 14 commits into
mainfrom
agent/refresh-kimik3-b300-dspark-agentx

Conversation

@cquil11

@cquil11 cquil11 commented Aug 3, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Refresh the Kimi K3 DSpark AgentX submission for B300 on the corrected AgentX harness and digest-pinned upstream vLLM nightly.
  • Align the target model with the current published upstream Kimi K3 profile by using FlashInfer MLA prefill with prefill query quantization.
  • Preserve the nine-point TP8 search space: GPU-resident concurrency 1, 2, 4, and 8; SimpleCPUOffloadConnector concurrency 1, 2, 4, 8, and 16.
  • Keep throughput on DSpark K=2 probabilistic drafting with committed synthetic AL 2.51. The generated eval-only row uses real rejection_sample_method=block verification and no synthetic acceptance.

Validation

  • Generated nine throughput rows and one eval-only DRAM-offload concurrency-16 row.
  • pytest -q utils/matrix_logic/test_generate_sweep_configs.py -k 'multinode or agentic': 27 passed, 78 deselected.
  • Passed bash -n benchmarks/single_node/agentic/kimik3_fp4_b300_vllm_mtp.sh, git diff --check, and utils/validate_perf_changelog.py.
  • Current-head full sweep: run 31509160691.

中文说明

  • 基于已修正的 AgentX 测试框架和按 digest 固定的上游 vLLM nightly 镜像,刷新 B300 Kimi K3 DSpark AgentX 配置。
  • 对齐当前上游发布的 Kimi K3 配置,使用 FlashInfer MLA 预填充和预填充 query 量化。
  • 保留 9 个 TP8 搜索点:GPU 常驻并发 1、2、4 和 8;SimpleCPUOffloadConnector 并发 1、2、4、8 和 16。
  • 吞吐量测试继续使用 DSpark K=2 概率草稿和已提交的合成 AL 2.51。生成的 eval-only 配置使用真实 rejection_sample_method=block 验证,不使用合成接受率。

验证

  • 生成 9 个吞吐量配置和 1 个 DRAM 卸载并发 16 的 eval-only 配置。
  • pytest -q utils/matrix_logic/test_generate_sweep_configs.py -k 'multinode or agentic':27 passed、78 deselected。
  • 已通过 bash -n benchmarks/single_node/agentic/kimik3_fp4_b300_vllm_mtp.shgit diff --checkutils/validate_perf_changelog.py
  • 当前提交的完整扫描:run 31509160691

@cquil11
cquil11 requested a review from a team August 3, 2026 16:28
@github-actions

github-actions Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

Thanks for the contribution! Please reach out to respective companies' CODEOWNER to fill in the latest PR_REVIEW_CHECKLIST.md before pinging core maintainer on Slack for review. In order for the signoff PR check bot to trigger, you must follow the PR_REVIEW_CHECKLIST.md template correctly, including the phrase As a PR reviewer and CODEOWNER, I have reviewed this and have.

For PR verification, add the full-sweep-fail-fast label (strongly recommended) to this PR — the benchmark sweep only runs on labeled PRs. Use full-sweep-enabled only if you need matrix jobs to keep running past a failure.

PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. See GitHub's docs on re-running failed jobs


感谢你的贡献!请联系相应公司的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,然后再在 Slack 上联系核心维护者进行审阅。为了触发 signoff PR 检查机器人,你必须正确遵循 PR_REVIEW_CHECKLIST.md 模板,包括保留英文语句 As a PR reviewer and CODEOWNER, I have reviewed this and have

如需进行 PR 验证,请为此 PR 添加 full-sweep-fail-fast 标签(强烈推荐)— 基准测试 sweep 仅在带有标签的 PR 上运行。仅当需要矩阵任务在失败后继续运行时才使用 full-sweep-enabled

PR 作者有责任确保合并后所有 GitHub Action 任务完全通过。 很多时候失败只是偶发抖动(flake),重新运行失败的任务即可解决。参见 GitHub 关于重新运行失败任务的文档

@claude claude Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good — a straightforward, correctly-formatted perf-changelog entry refreshing an existing AgentX submission. The only finding is a non-functional metadata nit (missing bilingual PR title), which doesn't block this.

Extended reasoning...

Overview

The PR adds a single 5-line entry to perf-changelog.yaml, referencing the existing kimik3-fp4-b300-vllm-agentic-dspark config key (confirmed present in configs/nvidia-master.yaml) to record a refreshed AgentX submission for B300 Kimi K3 DSpark. No search-space, code, or config-key changes — purely a changelog/metadata append.

Security risks

None. The change is a static YAML changelog entry with no executable logic, no new config keys, no credentials, and no changes to auth/permissions paths.

Level of scrutiny

Minimal scrutiny is appropriate here — this is a mechanical, additive changelog entry following the exact structural pattern of the immediately preceding entries in the file (config-keys/description/pr-link), referencing a pre-existing, already-defined config key.

Other factors

The bug hunting system's only finding is a nit about the PR title lacking a required Simplified Chinese translation per AGENTS.md convention — a process/metadata gap, not a functional defect, and consistent with several recent adjacent commits in the log. The other candidate issue raised (placeholder pr-link) was already ruled out as expected/consistent with existing entries. No outstanding unaddressed reviewer comments exist in the timeline.

Comment thread perf-changelog.yaml
中文:将 main 合并到 B300 分支
中文:使用新版 Kimi nightly 镜像测试 B300
中文:补齐 Kimi 基准测试变更日志条目的末尾换行。
@github-actions

Copy link
Copy Markdown
Contributor

中文:将 Kimi GPU 常驻基准测试的并发上限设为 8,并保留 DRAM 卸载在并发 16 的容量测试点。
@github-actions

Copy link
Copy Markdown
Contributor

中文:合并 main 并解决冲突
中文:合并 main 后保留性能变更日志末尾换行
中文:排除发生不可纠正 NVLink 错误的 B300 节点,避免基准测试继续调度到故障硬件。
@github-actions

Copy link
Copy Markdown
Contributor

中文:让 B300 启动器把 SALLOC_EXCLUDE 传递给 Slurm,避免任务调度到已知故障节点。
@github-actions

Copy link
Copy Markdown
Contributor

中文:合并最新 main,并按追加规则保留 B300 Kimi K3 基准测试变更日志条目。
@github-actions

Copy link
Copy Markdown
Contributor

中文:将 Kimi K3 B300 的 MLA 预填充后端对齐到上游 FlashInfer 配置,并保留真实 block 验证的评估路径。
@adibarra adibarra changed the title [AgentX]: B300 Kimi K3 DSpark refresh [AgentX] Refresh Kimi K3 DSpark on B300 / [AgentX] 刷新 B300 上的 Kimi K3 DSpark Aug 11, 2026
@github-actions

Copy link
Copy Markdown
Contributor

1 similar comment
@github-actions

Copy link
Copy Markdown
Contributor

中文:将 main 合并到 B300 分支,并保留 Kimi K3 DSpark 配置及规范的性能变更日志顺序。
@cquil11

cquil11 commented Aug 11, 2026

Copy link
Copy Markdown
Collaborator Author

/stage-results 31509160691

@github-actions

github-actions Bot commented Aug 11, 2026

Copy link
Copy Markdown
Contributor

@cquil11 staged run 31509160691: https://inferencemax-app-git-staging-semianalysisai.vercel.app/inference?i_dates=2026-08-11~r31509160691

This run remains available across future /stage-results requests. Staging the same run ID again updates its staged data. Staging workflow

@cquil11 已将运行 31509160691 发布到预发布环境:https://inferencemax-app-git-staging-semianalysisai.vercel.app/inference?i_dates=2026-08-11~r31509160691

后续的 /stage-results 请求不会移除此运行;再次发布相同的运行 ID 会更新其预发布数据。预发布工作流

@github-actions

Copy link
Copy Markdown
Contributor

@cquil11

cquil11 commented Aug 11, 2026

Copy link
Copy Markdown
Collaborator Author

/reuse-sweep-run 31509160691

Remove the PR-specific Slurm exclusion changes and restore the unrelated benchmark comment so the PR stays focused on the Kimi K3 refresh.\n\n中文:移除本 PR 中与 Slurm 节点排除相关的改动,并恢复无关的基准测试注释,使 PR 仅聚焦于 Kimi K3 刷新。
@cquil11
cquil11 merged commit 28f934c into main Aug 11, 2026
5 checks passed
@cquil11
cquil11 deleted the agent/refresh-kimik3-b300-dspark-agentx branch August 11, 2026 21:07
ChangLiu0709 added a commit that referenced this pull request Aug 12, 2026
Keep both the PR #2557 Qwen3.5-FP8 disagg entry and the entries
added to main (PRs #2536, #2476, #2364, #2475).

Co-authored-by: Cursor <cursoragent@cursor.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Development

Successfully merging this pull request may close these issues.

2 participants