Repository navigation

feat: price grouped KV handoff transfers by vLLM group rules - #791

Open

Arsene12358 wants to merge 3 commits into

yimingl/aisim-2291-grouped-prefix-caching-profile-markerfrom

yimingl/aisim-2290-simulate-pd-disaggregation-for-grouped

Open

feat: price grouped KV handoff transfers by vLLM group rules#791
Arsene12358 wants to merge 3 commits into
yimingl/aisim-2291-grouped-prefix-caching-profile-markerfrom
yimingl/aisim-2290-simulate-pd-disaggregation-for-grouped

Commits on Nov 9, 2026
- feat: compute grouped KV transfer payloads by vLLM 0.31.0 and 0.32.0 group rules
  
  Arsene12358
  and
  claude
  committed
  37f481e
- feat: hold grouped KV sources with block-unit transfer timing
  
  Arsene12358
  and
  claude
  committed
  6f1f8e5
- feat: accept grouped KV caches on prefill and decode ranks
  
  Arsene12358
  and
  claude
  committed
  e1f2200