Skip to content
Merged
Changes from 5 commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
a7d8d99
[FlyDSL] gfx942 fp8_mqa_logits: let _auto_variant choose rows_per_block
jin-amd Aug 24, 2026
5691e17
[FlyDSL] gfx942 fp8_mqa_logits: pick RPB on element count, and keep i…
jin-amd Aug 24, 2026
d863e4d
[FlyDSL] gfx942 fp8_mqa_logits: trim _auto_variant comments per review
Aug 25, 2026
e93ee8f
Merge branch 'main' into gfx942-fp8-mqa-logits-rows-per-block
jin-amd Aug 31, 2026
6017a93
Merge branch 'main' into gfx942-fp8-mqa-logits-rows-per-block
jin-amd Sep 2, 2026
e9266fd
Merge branch 'main' into gfx942-fp8-mqa-logits-rows-per-block
jin-amd Sep 7, 2026
4ebbc6a
Merge branch 'main' into gfx942-fp8-mqa-logits-rows-per-block
jin-amd Sep 16, 2026
3151a7b
Merge branch 'main' into gfx942-fp8-mqa-logits-rows-per-block
jin-amd Sep 16, 2026
326a422
[FlyDSL] gfx942 fp8_mqa_logits: scope the _auto_variant step-down note
jin-amd Sep 16, 2026
3437167
[FlyDSL] gfx942 fp8_mqa_logits: unit-test the variant selector
jin-amd Sep 16, 2026
f612a26
Merge branch 'main' into gfx942-fp8-mqa-logits-rows-per-block
jin-amd Sep 21, 2026
2d56a4c
Merge branch 'main' into gfx942-fp8-mqa-logits-rows-per-block
jin-amd Sep 23, 2026
1a86298
Merge branch 'main' into gfx942-fp8-mqa-logits-rows-per-block
jin-amd Sep 25, 2026
095113b
[FlyDSL] gfx942 fp8_mqa_logits: put selector tests on the CI path
jin-amd Sep 25, 2026
feb833c
[FlyDSL] gfx942 fp8_mqa_logits: fold the selector pins into the op test
jin-amd Sep 25, 2026
daa7fed
Merge branch 'main' into gfx942-fp8-mqa-logits-rows-per-block
jin-amd Sep 25, 2026
0106d87
Merge branch 'main' into gfx942-fp8-mqa-logits-rows-per-block
jin-amd Sep 28, 2026
19bd10d
Merge branch 'main' into gfx942-fp8-mqa-logits-rows-per-block
coderfeli Sep 28, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 15 additions & 4 deletions aiter/ops/flydsl/kernels/mqa_logits/fp8_mqa_logits.py
Original file line number Diff line number Diff line change
Expand Up @@ -388,11 +388,22 @@ def _mk_builder(rpb, wpb):


def _auto_variant(seq_len, seq_len_kv):
"""Pick (RPB, WPB) from the problem shape: RPB=2 always; WPB=2 packs more
column tiles per wave when M and N are both large, else WPB=4 for more
wavefronts on small-M / short-window shapes."""
"""Pick (RPB, WPB) from the problem shape.

RPB from ``seq_len * seq_len_kv`` thresholds; step down to a divisor of
``seq_len`` when padding overhead would dominate. WPB unchanged.
"""
Comment thread
jin-amd marked this conversation as resolved.
Resolved
rpb2_min_elems = 2**19
rpb4_min_elems = 2**21
elems = seq_len * seq_len_kv
if elems < rpb2_min_elems:
rpb = 1
elif elems < rpb4_min_elems:
rpb = 2 if seq_len % 2 == 0 else 1
else:
rpb = 4
wpb = 2 if (seq_len >= 2048 and seq_len_kv >= 8192) else 4
return f"mfma_r2_w{wpb}"
return f"mfma_r{rpb}_w{wpb}"
Comment thread
jin-amd marked this conversation as resolved.
Resolved


def _resolve_variant(variant, seq_len, seq_len_kv):
Expand Down
Loading