Skip to content

[Bugfix] Reset num_cached_tokens sentinel on request preemption#36752

Closed
xiaguan wants to merge 1 commit into
vllm-project:mainfrom
xiaguan:fix/preempt-reset-num-cached-tokens
Closed

[Bugfix] Reset num_cached_tokens sentinel on request preemption#36752
xiaguan wants to merge 1 commit into
vllm-project:mainfrom
xiaguan:fix/preempt-reset-num-cached-tokens

[Bugfix] Reset num_cached_tokens sentinel on request preemption

02ec729
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Mar 11, 2026 in 0s

There is no internal Diff connected, this can be merged now