Skip to content
Merged
Show file tree
Hide file tree
Changes from 49 commits
Commits
Show all changes
56 commits
Select commit Hold shift + click to select a range
c6f0489
[GLUON][GFX950][DSV4] Split-count collapse, cs0 alignment hint, per-c…
cagrikymk Aug 18, 2026
23e8319
[GLUON][GFX950][DSV4] Chunked fp8 dequant + parallel split-K reduce
cagrikymk Aug 18, 2026
f944ac3
[GLUON][GFX950][DSV4] pa_decode_sparse: accept a caller-supplied out=
cagrikymk Aug 18, 2026
9459334
[GLUON][GFX950][DSV4] Only ask for 2 waves/EU on the buffer_load path
cagrikymk Aug 18, 2026
e079000
[GLUON][GFX950][DSV4] Occupancy-aware split-K policy + separate main …
cagrikymk Aug 18, 2026
7034e33
[GLUON][GFX950][DSV4] Whole-row gather, NaN-propagating max, base-2 s…
cagrikymk Aug 18, 2026
e3b8129
[GLUON][GFX950][DSV4] Split policy: do not inflate partial tiles when…
cagrikymk Aug 18, 2026
42ebba5
[GLUON][GFX950][DSV4] Per-query adaptive split count with early CTA exit
cagrikymk Aug 18, 2026
8c8e1c3
[GLUON][GFX950][DSV4] Fix the prologue's serial chain and the gather …
cagrikymk Aug 18, 2026
e9cb7b3
[GLUON][GFX950][DSV4] Narrow the UE8M0 scale gather on the 64-bit cac…
cagrikymk Aug 18, 2026
a62d73d
[GLUON][GFX950][DSV4] Add AITER_PA_DECODE_LDS_PAD knob (default uncha…
cagrikymk Aug 18, 2026
5a82565
[GLUON][GFX950][DSV4] Add AITER_PA_DECODE_BLOCK_M knob (default uncha…
cagrikymk Aug 18, 2026
2410989
[GLUON][GFX950][DSV4] Store the split-K accumulator partials in bf16
cagrikymk Aug 18, 2026
1f62fea
[GLUON][GFX950][DSV4] Ask for 2 waves/EU on the 64-bit gather path too
cagrikymk Aug 18, 2026
d7302ea
[GLUON][GFX950][DSV4] buffer_load the slot index gather
cagrikymk Aug 18, 2026
59617a4
[GLUON][GFX950][DSV4] Reciprocal-multiply instead of divide in both e…
cagrikymk Aug 18, 2026
9cf6a0c
[GLUON][GFX950][DSV4] Add AITER_PA_DECODE_CS0_ALIGN override (default…
cagrikymk Aug 18, 2026
19f5977
[GLUON][GFX950][DSV4] Fuse the fp8xE8M0 dequant, and spend the regist…
cagrikymk Aug 18, 2026
814d53d
[GLUON][GFX950][DSV4] Keep the occupancy rule off the 64-bit gather p…
cagrikymk Aug 18, 2026
7cd9465
[GLUON][GFX950][DSV4] Emit the fused dequant as two single-output asm…
cagrikymk Aug 18, 2026
b585afc
[GLUON][GFX950][DSV4] UNI_TILE: one tile body for full and partial tiles
cagrikymk Aug 19, 2026
a5e8595
[GLUON][GFX950][DSV4] Simplify the UNI_TILE slot path; three of its s…
cagrikymk Aug 19, 2026
645a30b
[GLUON][GFX950][DSV4] Fold qk_scale into the row max so the exp2 argu…
cagrikymk Aug 19, 2026
a1a1a22
[GLUON][GFX950][DSV4] Restructure sparse decode around Cfg/Fmt/Seg ag…
cagrikymk Aug 19, 2026
da5aabb
[GLUON][GFX950][MLA] Add sparse_mla_decode_fwd: separated-rope sparse…
cagrikymk Aug 19, 2026
f89f5e2
[GLUON][GFX950][MLA] Simplify: concise comments, no env knobs, leaner…
cagrikymk Aug 19, 2026
4f4fb36
[GLUON][GFX950][DSV4] Drop the gluon driver's env knobs; leaner reduce
cagrikymk Aug 19, 2026
f5e0f14
remove leftover stuff
cagrikymk Aug 19, 2026
c3b541d
[GLUON][GFX950][MLA] fp8_mfma: keep the tile in fp8 through both dots
cagrikymk Aug 20, 2026
4815a04
[GLUON][GFX950][MLA] Accept caller-quantized fp8 q, the asm calling c…
cagrikymk Aug 20, 2026
9d188bf
[GLUON][GFX950][MLA] Give the sparse-MLA path its own split-K policy
cagrikymk Aug 20, 2026
2987280
[GLUON][GFX950][MLA] Select the dot precision, and adapt q to it
cagrikymk Aug 20, 2026
bf3c53c
restructure asm constexprs
cagrikymk Aug 20, 2026
f78942d
Enable async direct-to-LDS gather for gfx950 sparse MLA
cagrikymk Aug 21, 2026
54b1eda
add bench, simplify comments
cagrikymk Aug 21, 2026
7946a1e
cleanup
cagrikymk Aug 21, 2026
4d86ac5
more cleanup
cagrikymk Aug 21, 2026
2961459
for reviewdog comments
cagrikymk Aug 23, 2026
e62372c
black and formatting
cagrikymk Aug 23, 2026
d921e5b
add lse return and trim tests/comments
cagrikymk Aug 24, 2026
773a5d2
cache constexpr restructure to fix 3.6 issues
cagrikymk Aug 24, 2026
a6be2c1
change LSE args
cagrikymk Aug 24, 2026
2189e64
Merge branch 'main' into cagri/sparse_pa_optimizations
cagrikymk Aug 24, 2026
0be1ae6
Merge branch 'main' into cagri/sparse_pa_optimizations
cagrikymk Aug 26, 2026
d4db44c
add glm 5.3 flash support, comment trimming
cagrikymk Aug 27, 2026
9b1b986
cache mod for q
cagrikymk Aug 27, 2026
f95f8c2
Merge branch 'main' into cagri/sparse_pa_optimizations
cagrikymk Aug 27, 2026
83075b6
fix gen issue
cagrikymk Aug 27, 2026
88126fc
better name kv cache types
cagrikymk Sep 10, 2026
b286403
Cagri/sparse mla unified api (#5551)
cagrikymk Sep 15, 2026
b8a557e
Merge branch 'main' into cagri/sparse_pa_optimizations
cagrikymk Sep 15, 2026
3a38c85
formatting
cagrikymk Sep 15, 2026
33c58f3
fix broken fp8 dtype
cagrikymk Sep 15, 2026
0762106
simplify comments
cagrikymk Sep 15, 2026
e28ca27
fix hardcoded fp8 max limit
cagrikymk Sep 15, 2026
7785721
Merge branch 'main' into cagri/sparse_pa_optimizations
cagrikymk Sep 15, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading