Repository navigation

[Perf][ROCm][Attention] Fuse Kimi-K3 MLA chunked-context gather on AITER - #53166

Open

nsusanto wants to merge 8 commits into

vllm-project:mainfrom

nsusanto:rocm-mla-fused-context-gather

Open

[Perf][ROCm][Attention] Fuse Kimi-K3 MLA chunked-context gather on AITER#53166
nsusanto wants to merge 8 commits into
vllm-project:mainfrom
nsusanto:rocm-mla-fused-context-gather

Commits on Oct 13, 2026
- [ROCm][Perf] Fuse the MLA chunked-context gather on AITER
  
  nsusanto
  and
  claude
  committed
  6236d53
- [ROCm][Perf] Address review on MLA chunked-context gather
  nsusanto
  committed
  10e12f2
- [ROCm] Build MLA chunked-context KV indices in the metadata builder
  nsusanto
  committed
  b07338f
- [ROCm] Default the MLA page-index kernel's start-offset args
  nsusanto
  committed
  e288f65
- [ROCm] Move fusion gate to rocm mla
  nsusanto
  committed
  6259ce4
- [ROCm] Guard fused MLA gather on kv_lora_rank and gate context index build
  nsusanto
  committed
  aea7e84
- [ROCm] Test the fused MLA context gather and k concat
  nsusanto
  committed
  b511478
Commits on Oct 15, 2026
- Merge branch 'main' into rocm-mla-fused-context-gather
  dllehr-amd
  authored
  78508e8