Skip to content

[Bugfix][KV Offload] Count each key once per request toward store_threshold - #64558

Merged
orozery merged 6 commits into
vllm-project:mainfrom
sohom-cs:fix/offload-threshold-retried-offer
Nov 3, 2026
Merged

orozery merged 6 commits into
vllm-project:mainfrom
sohom-cs:fix/offload-threshold-retried-offer

Commits

  1. Commits on Oct 29, 2026

  2. Commits on Nov 1, 2026

  3. Commits on Nov 2, 2026

  4. Commits on Nov 3, 2026