Repository navigation

[Attention] Enable FA4 sparse MQA decode on Blackwell - #55866

Merged

MatthewBonanni merged 16 commits into

vllm-project:mainfrom

simon-veitner-redhat:sparse-mqa

Oct 13, 2026

Merged

[Attention] Enable FA4 sparse MQA decode on Blackwell#55866
MatthewBonanni merged 16 commits into
vllm-project:mainfrom
simon-veitner-redhat:sparse-mqa

Commits on Oct 8, 2026
- [Attention] Share sparse MLA MQA cache handling
  
  committed
  a09db3f
- [Attention] Add the FA4 sparse MQA decode backend for SM100
  
  simon-veitner-redhat
  and
  claude
  committed
  b8945ec
- cleanup: drop redundant sparse MLA tests and shorten comments
  
  simon-veitner-redhat
  and
  claude
  committed
  f89c3de
- [Build] Bump vllm-flash-attn to vllm-project/flash-attention b273a026
  simon-veitner-redhat
  committed
  0140d70
- remove some slop
  simon-veitner-redhat
  committed
  0850ebc
Commits on Oct 9, 2026
- [Tests] Trim sparse MLA wiring tests
  
  simon-veitner-redhat
  and
  claude
  committed
  50d4512
- Merge branch 'main' into sparse-mqa
  LucasWilkinson
  authored
  0d695c4
- [CI] Resolve sparse MLA backends lazily in kv cache layout test for ROCm
  simon-veitner-redhat
  committed
  99e55b6
- Merge remote-tracking branch 'origin/main' into sparse-mqa
  LucasWilkinson
  committed
  8859ebb
Commits on Oct 11, 2026
- Merge branch 'main' into sparse-mqa
  LucasWilkinson
  authored
  cf280cf
- [CI] Skip FA4 sparse MLA fallback selection test on non-CUDA platforms
  simon-veitner-redhat
  committed
  7fdd3ad
Commits on Oct 12, 2026
- Merge branch 'main' into sparse-mqa
  MatthewBonanni
  authored
  4d3b1d8
- Merge branch 'main' into sparse-mqa
  simon-veitner-redhat
  committed
  8b58a13
- [Misc] Use the CUDA-guarded flashattn_mla_sparse alias in FA4 tests
  
  simon-veitner-redhat
  and
  claude
  committed
  4131823
Commits on Oct 13, 2026
- Merge branch 'main' into sparse-mqa
  simon-veitner-redhat
  committed
  705419d
- Merge branch 'main' into sparse-mqa
  simon-veitner-redhat
  committed
  1944857

Commits

Commits on Oct 8, 2026

Commits on Oct 9, 2026

Commits on Oct 11, 2026

Commits on Oct 12, 2026

Commits on Oct 13, 2026