Skip to content

[Bugfix] Free requests to avoid a KV Cache exhaustion during VLLM_NIXL_ABORT_REQUEST_TIMEOUT - #29906

Closed
hasB4K wants to merge 1 commit into
vllm-project:mainfrom
hasB4K:mathis/patch_scheduler
Closed

[Bugfix] Free requests to avoid a KV Cache exhaustion during VLLM_NIXL_ABORT_REQUEST_TIMEOUT#29906
hasB4K wants to merge 1 commit into
vllm-project:mainfrom
hasB4K:mathis/patch_scheduler