[Bugfix][KV Offload] Stop offloading the final sampled token's KV slot - #54288

Merged

orozery merged 5 commits into

vllm-project:mainfrom

almogtavor:offload-finished-watermark

Sep 6, 2026

Commits on Aug 28, 2026

[Bugfix][KV Offload] Stop offloading the final sampled token's KV slot
almogtavor
committed
57718fb

Commits on Aug 29, 2026

Clamp the finished watermark at the prompt length
almogtavor
committed
79290b6

Commits on Sep 6, 2026

Update vllm/distributed/kv_transfer/kv_connector/v1/offloading/scheduler.py

almogtavor
and
orozery
authored
d97a7dc
Merge branch 'main' into offload-finished-watermark
almogtavor
authored
a205224
gate the finished-store test on request state instead of an attempt count
almogtavor
committed
f96dfe2