Skip to content

[Recipe][Docs] Add MXFP4 intermediate variable and scheduler delay advice for Kimi-K2 - #1566

Merged
valarLip merged 1 commit into
ROCm:mainfrom
benenzhu:patch-1
Jul 12, 2026
Merged

[Recipe][Docs] Add MXFP4 intermediate variable and scheduler delay advice for Kimi-K2#1566
valarLip merged 1 commit into
ROCm:mainfrom
benenzhu:patch-1

Conversation

@benenzhu

@benenzhu benenzhu commented Jul 12, 2026

Copy link
Copy Markdown
Contributor

Added environment variable for MXFP4 intermediate processing and recommended scheduler delay factor for large concs.

Motivation

Technical Details

Test Plan

Test Result

Submission Checklist

Added environment variable for MXFP4 intermediate processing and recommended scheduler delay factor for large concs.
@benenzhu benenzhu changed the title [Recipe] Add MXFP4 intermediate variable and scheduler delay advice for Kimi-K2 [Recipe][Docs] Add MXFP4 intermediate variable and scheduler delay advice for Kimi-K2 Jul 12, 2026
@github-actions

Copy link
Copy Markdown
Contributor

🏷️ CI Guide

Runs automatically on every eligible PR before approval:

  • ✅ Pre Checkin: Black, Ruff, catalog schema validation, non-GPU unit tests

Heavy model tests:

  • ✅ Run after the PR is approved and Pre Checkin passes
  • ✅ Run immediately when an approval review is submitted
  • ✅ Can be requested before approval with labels
Label Tests
ci:full Run all heavy PR model tests: native ATOM, vLLM, and SGLang
ci:atom Run native ATOM model accuracy tests
ci:vllm Run ATOM vLLM OOT model accuracy tests
ci:sglang Run ATOM SGLang model accuracy tests

Heavy jobs are skipped when the PR is not approved and no matching ci:* label is present.
Add labels via the sidebar or gh pr edit 1566 --add-label <label>

@valarLip
valarLip merged commit 9287622 into ROCm:main Jul 12, 2026
1 of 2 checks passed
wanzhenchn added a commit that referenced this pull request Jul 13, 2026
gyohuangxin pushed a commit that referenced this pull request Jul 14, 2026
…rting (#1580)

* [ci][mesh] isolate ATOMesh worker compile caches

* [ci][mesh] add kimi-k25-2p1d-dpa-tp4 case

adjust pd_worker_layout for kimi-2p1d-dpa

* Add ATOMesh case-level benchmark selection

* remove kimi-2.5 decode dpa and tbo conifg

* Revert "remove kimi-2.5 decode dpa and tbo conifg"

This reverts commit d04f3f8.

* Revert "[ci][mesh] add kimi-k25-2p1d-dpa-tp4 case"

This reverts commit 9a3c6a8.

* update Kimi-K2 env. config from PR ##1566

* fix Image source for dashboard

* fix dashboard rerun selection by throughput

* split atomesh dashboard charts by model

* fix ATOMesh pd rank mapping for Spur cluster

* fix code style

---------

Co-authored-by: yuechguo <yuechguo@amd.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants