Repository navigation

[Perf] [AMD] mla: Use the gfx950 aiter RoPE, RMSNorm and MLA KV-row paths on gfx1250 - #48154

Open

jiaryang wants to merge 5 commits into

sgl-project:mainfrom

jiaryang:amd/gfx1250-prefill-aiter-rope-rmsnorm-kv

Open

[Perf] [AMD] mla: Use the gfx950 aiter RoPE, RMSNorm and MLA KV-row paths on gfx1250#48154
jiaryang wants to merge 5 commits into
sgl-project:mainfrom
jiaryang:amd/gfx1250-prefill-aiter-rope-rmsnorm-kv

Commits on Nov 2, 2026
- [AMD] Use aiter rope, aiter rmsnorm and split MLA KV rows on gfx1250
  
  jiaryang
  and
  cursoragent
  committed
  89dd0ff
Commits on Nov 3, 2026
- Merge commit '8d4e1ce4c7' into HEAD
  jiaryang
  committed
  1327b75
- [AMD] Keep native rope on gfx1250 for aliased q/k and RL on-policy
  jiaryang
  committed
  5e6ccc5
- [AMD] Let gfx1250 aiter rope handle a key passed as its own query
  jiaryang
  committed
  77fba2f
Commits on Nov 4, 2026
- Merge branch 'main' into amd/gfx1250-prefill-aiter-rope-rmsnorm-kv
  yctseng0211
  authored
  eb98e1b