[Triton/Gluon] [ASM] [HIP] MHA v4: support GQA, add gfx950 bf16, add gfx942 i8/fp8 - #4967

Merged

valarLip merged 23 commits into

mainfrom

Aug 26, 2026

Commits on Aug 18, 2026

perf(mha_v4): avoid copying odd-tail FP6 V inputs
jcaraban
committed
c5b1546
feat(mha_v4): support grouped query attention
jcaraban
committed
918947e
feat(mha_v4): add MXFP8 raw entrypoint
jcaraban
committed
2205978
docs(mha_v4): clarify grouped-query attention contract
jcaraban
committed
c49d98d
feat(mha_v4): add gfx942 native FP8 kernel
jcaraban
committed
4f0488a
fix(mha_v4): canonicalize rotated FP8 preprocessing
jcaraban
committed
7dc62a5
refactor(bench): simplify MHA v4 quantized runners
jcaraban
committed
4815d47
perf(mha_v4): deploy gfx942 XCD-swizzled kernels
jcaraban
committed
92deb9a

Commits on Aug 19, 2026

perf(mha_v4): deploy gfx942 block kernels
jcaraban
committed
e62e076
fix(mha_v4): handle singleton-head rotation strides
jcaraban
committed
e79b1c8
perf(mha_v4): deploy retimed gfx942 I8/FP8 kernels
jcaraban
committed
361ad58

Commits on Aug 20, 2026

fix(mha_v4): deploy corrected gfx942 PV LDS waits
jcaraban
committed
ef3a635

Commits on Aug 22, 2026

fix(fmha): deploy gfx942 V staging
jcaraban
committed
8b2acc8
fix(fmha): update gfx942 I8FP8 kernel
jcaraban
committed
75ff143

Commits on Aug 23, 2026

feat(mha): add bf16 to mha v4
jcaraban
committed
a2a7db1
perf(fmha): deploy optimized gfx942 block kernels
jcaraban
committed
b4d7c11

Commits on Aug 24, 2026

style(mha_v4): apply repository formatting
jcaraban
committed
550c90e
test(mha_v4): isolate compile parity cases
jcaraban
committed
c27ea90
Merge remote-tracking branch 'origin/main' into mha_v4_gqa_etc
jcaraban
committed
3b7e931
fix ruff warnings
jcaraban
committed
a1037ee
fix(mha_v4): enforce contiguous rotation layout
jcaraban
committed
932fb80

Commits on Aug 25, 2026

fix(mha_v4): update deterministic BF16 kernel
jcaraban
committed
18cc699
Revert "fix(mha_v4): handle singleton-head rotation strides"
jcaraban
committed
3f3e117