Skip to content

[Bugfix] Reset num_cached_tokens sentinel on request preemption#36752

Closed
xiaguan wants to merge 1 commit intovllm-project:mainfrom
xiaguan:fix/preempt-reset-num-cached-tokens
Closed

[Bugfix] Reset num_cached_tokens sentinel on request preemption#36752
xiaguan wants to merge 1 commit intovllm-project:mainfrom
xiaguan:fix/preempt-reset-num-cached-tokens

Commits

Commits on Mar 11, 2026