Skip to content

[Perf][Attention] FA4 sparse MLA prefill with query groups for 16-64 heads per rank - #63104

Open
XinyuanQiao wants to merge 7 commits into
vllm-project:mainfrom
XinyuanQiao:mla-sparse-grouped-prefill
Open

[Perf][Attention] FA4 sparse MLA prefill with query groups for 16-64 heads per rank#63104
XinyuanQiao wants to merge 7 commits into
vllm-project:mainfrom
XinyuanQiao:mla-sparse-grouped-prefill

Commits

  1. Commits on Oct 22, 2026

  2. Commits on Oct 26, 2026

  3. Commits on Nov 5, 2026

  4. Commits on Nov 6, 2026