You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[ASM][flydsl] opt mla kernel for dspr1(gfx1250) - #6087
Continuous KV ring across work items: a work item's last producer steps gather the next
item's first KV tiles, so its prologue no longer waits on HBM in series with the previous
item's epilogue.
Padded output staging: staged output rows carry 16 B of padding so the 16 heads of one ds_store do not share LDS banks; the TDM store's column extent drops the pad columns.
i32 KV tile loop counter (assignment-carried instead of range(init=)), and the
per-wave page indices of a tile loaded with one 8-dword scalar load.
Test Result
gfx1250, 256 CUs, B=1536, nhead=128, q_seq=1, FP8 Q/KV (--scales poc). Times are per decode
call (stage 1 + reduce).
All standard extended tests (excludes ci:atom_full)
Only add ci:atom_full for FlyDSL or Triton upgrades.
Add labels via the sidebar or gh pr edit 6087 --add-label <label>
One backend per PR:
A PR changes one kernel backend: [Triton/Gluon] (Triton and Gluon count as one), [HIP], [ASM], [CK], [OPUS] or [FlyDSL]. If the title ends up with two backend tags, split the PR -- as stacked pull requests when one part cannot merge without the other.
PR title tags & labels:
Component tags ([Triton/Gluon], [HIP], [CK], [ASM], ...) are added to the PR title and as PR labels automatically from the changed files and re-synced on every push — change-type tags like [fix]/[Perf], op tags like [MLA], and human labels (ci:*) are left untouched. Add the no-auto-title label to stop the title rewrites; labels stay in sync either way.
github-actionsBot
changed the title
[asm][flydsl] opt mla kernel for dspr1(gfx1250)
[ASM] opt mla kernel for dspr1(gfx1250)
Oct 2, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Motivation
Update the gfx1250 persistent PS1 (page size 1) FP8 MLA decode
Technical Details
item's first KV tiles, so its prologue no longer waits on HBM in series with the previous
item's epilogue.
ds_storedo not share LDS banks; the TDM store's column extent drops the pad columns.range(init=)), and theper-wave page indices of a tile loaded with one 8-dword scalar load.
Test Result
gfx1250, 256 CUs, B=1536, nhead=128, q_seq=1, FP8 Q/KV (
--scales poc). Times are per decodecall (stage 1 + reduce).
Submission Checklist