Skip to content

[KV-Offloading][TP] : Expand replicated_layout detection to multi-group MLA - #57652

Merged
LucasWilkinson merged 3 commits into
vllm-project:mainfrom
neuralmagic:varun/dsv4-fix
Sep 30, 2026
Merged

LucasWilkinson merged 3 commits into
vllm-project:mainfrom
neuralmagic:varun/dsv4-fix

[#57652 suggestion] AttentionSpec.max_tp_shards + KVCacheConfig.kv_tp…

4d9c279
Select commit
Loading
Failed to load commit list.