Skip to content

[KV Offload] Add per-request max_load_tokens control - #55885

Merged
orozery merged 10 commits into
vllm-project:mainfrom
albertoperdomo2:feat/opt-out-kv-load
Sep 16, 2026
Merged

[KV Offload] Add per-request max_load_tokens control#55885
orozery merged 10 commits into
vllm-project:mainfrom
albertoperdomo2:feat/opt-out-kv-load

Commits

  1. Commits on Sep 13, 2026

  2. Commits on Sep 14, 2026

  3. Commits on Sep 15, 2026