Repository navigation

[KV-Offloading][TP] : Expand replicated_layout detection to multi-group MLA - #57652

Merged

LucasWilkinson merged 3 commits into

vllm-project:mainfrom

neuralmagic:varun/dsv4-fix

Sep 30, 2026

Merged

[KV-Offloading][TP] : Expand replicated_layout detection to multi-group MLA #57652
LucasWilkinson merged 3 commits into
vllm-project:mainfrom
neuralmagic:varun/dsv4-fix

Commits on Sep 29, 2026
- [KV Offload] Allow replicated MLA layout for multi-group caches
  
  almogtavor
  authored and
  varun-sundar-rabindranath
  committed
  9fc5392
- Expand replicated layout determination
  varun-sundar-rabindranath
  committed
  de6341e
- [#57652 suggestion] AttentionSpec.max_tp_shards + KVCacheConfig.kv_tp_replicas for TP-replication detection (#176)
  
  LucasWilkinson
  authored and
  varun-sundar-rabindranath
  committed
  4d9c279