[Bugfix] Reset num_cached_tokens sentinel on request preemption#36752
Closed
xiaguan wants to merge 1 commit intovllm-project:mainfrom
Closed
[Bugfix] Reset num_cached_tokens sentinel on request preemption#36752xiaguan wants to merge 1 commit intovllm-project:mainfrom
xiaguan wants to merge 1 commit intovllm-project:mainfrom