[FlyDSL] Paged mla indexer - #4221

Open

fhuizing wants to merge 52 commits into

fhuizing:paged_MLA_indexer

Commits on Jul 10, 2026

initial kernel and tests
amd-yashagar
committed
9e2dfbc
fix bench to not use random avg context length
amd-yashagar
committed
65cba2b
simplify fp8_paged_mqa_logits: operator style for i32 arithmetic, flatten variant scaffolding
Folkert Huizinga
committed
485f08b
perf: upgrade paged MQA logits to mfma_scale_f32_32x32x64 (K_STEPS 8→2, 6-13% faster)
Folkert Huizinga
committed
b0bf341

Commits on Jul 13, 2026

review: un-hardcode ChunkK / block_kv in paged mqa logits host
fhuizing
committed
48d887e

Commits on Jul 14, 2026

Commits on Aug 13, 2026

Commits on Aug 14, 2026

fix(flydsl): size paged mqa-logits bench KV pool from real block demand

fhuizing
and
cursoragent
committed
c3a943e
perf(flydsl): retune paged mqa-logits launch geometry (9.3% across shapes)

fhuizing
and
cursoragent
committed
e28ac81
refactor(flydsl): use FlyDSL operator sugar in paged mqa-logits

fhuizing
and
cursoragent
committed
2341f1f
refactor(flydsl): drop dead helpers and tighten mqa-logits docs

fhuizing
and
cursoragent
committed
e415028
refactor(flydsl): drive the paged mqa-logits tile loop with scf.for_

fhuizing
and
cursoragent
committed
3de0f40
refactor(flydsl): express the KV preshuffle as a layout, not a code path

fhuizing
and
cursoragent
committed
90fcbf2
test(flydsl): curate the paged mqa-logits matrix, 870 cases -> 29

fhuizing
and
cursoragent
committed
7ae5ec5
test(flydsl): cover the wave-split and ChunkK axes

fhuizing
and
cursoragent
committed
8979a09
test(flydsl): condense the paged mqa-logits test prose and plumbing

fhuizing
and
cursoragent
committed
490156e

Commits on Aug 15, 2026

docs(flydsl): drop benchmark figures from the paged mqa-logits source

fhuizing
and
cursoragent
committed
9a53327
docs(flydsl): fix stale --variant default in the paged bench help

fhuizing
and
cursoragent
committed
2b3ad3f
Merge remote-tracking branch 'upstream/main' into paged_MLA_indexer
fhuizing
committed
2ba0e31
refactor: move the FlyDSL benchmarks out of op_benchmarks/triton

fhuizing
and
cursoragent
committed
22e4a84
Merge remote-tracking branch 'origin/paged_MLA_indexer' into paged_MLA_indexer
fhuizing
committed
c07a978
style(flydsl): satisfy the Black and Ruff pre-checks on PR #4221

fhuizing
and
cursoragent
committed
b11cd5a
refactor(flydsl): drop dead conversion plumbing from the paged kernel

fhuizing
and
cursoragent
committed
b93e68c

Commits on Aug 19, 2026

Commits on Aug 20, 2026

Commits on Aug 25, 2026

Commits on Sep 6, 2026

feat(flydsl): add gfx950 H64 16x16x128 paged FP8 MQA logits kernel

fhuizing
and
cursoragent
committed
f33a573

Commits on Sep 7, 2026

feat(flydsl): specialize gfx950 paged MQA logits for H=32 and H=64

fhuizing
and
cursoragent
committed
a811a1d
feat(flydsl): compile-time next_n for gfx950 paged MQA logits

fhuizing
and
cursoragent
committed
8adbf32
feat(flydsl): dual-bank page pipeline for gfx950 paged MQA logits

fhuizing
and
cursoragent
committed
6c1c496
Merge upstream/main into paged_MLA_indexer

fhuizing
and
cursoragent
committed
51b689b
feat(flydsl): dispatch gfx950 paged MQA logits as the default decode path

fhuizing
and
cursoragent
committed
c1ee3ec

Commits on Sep 8, 2026

refactor(flydsl): make gfx950 the only paged FP8 MQA logits path

fhuizing
and
cursoragent
committed
9661da3
style(flydsl): black-format gfx950 paged MQA logits and tests

fhuizing
and
cursoragent
committed
9a41879

Commits on Sep 11, 2026

dynamic next_n scheduling WIP.
fhuizing
committed
f5b3903
cleanup
fhuizing
committed
d1cbe07
feat(flydsl): accept compact Q[B, next_n, 32, 128] for gfx950 paged MQA logits

fhuizing
and
cursoragent
committed
30bb002