Repository navigation

[Perf] [AMD] mla: Fuse RoPE, concat and KV-cache write for MLA decode on gfx1250 - #44459

Merged

HaiShaw merged 6 commits into

sgl-project:mainfrom

jiaryang:amd/gfx1250-mla-fused-rope-kv-cache

Nov 5, 2026

Merged

[Perf] [AMD] mla: Fuse RoPE, concat and KV-cache write for MLA decode on gfx1250#44459
HaiShaw merged 6 commits into
sgl-project:mainfrom
jiaryang:amd/gfx1250-mla-fused-rope-kv-cache

Commits on Nov 3, 2026
- [AMD] Fuse RoPE, concat and KV-cache write for MLA decode on gfx1250
  
  jiaryang
  and
  cursoragent
  committed
  379e3e2
- [AMD] Evaluate the gfx1250 fused RoPE gate per call
  
  jiaryang
  and
  cursoragent
  committed
  59901a8
- Merge branch 'main' into amd/gfx1250-mla-fused-rope-kv-cache
  jiaryang
  committed
  245dc70
- [Test] Import ForwardMode from forward_mode
  
  jiaryang
  and
  cursoragent
  committed
  1240927
- Merge branch 'main' into amd/gfx1250-mla-fused-rope-kv-cache
  jiaryang
  authored
  0e8b07e
- [Test] Keep the ROCm HiSparse fused-KV test on the gfx95 branch
  jiaryang
  committed
  52275fd