Skip to content

[Core] Proactively free KV cache blocks when aborting finished requests#35506

Open
jianzs wants to merge 2 commits intovllm-project:mainfrom
jianzs:feat/free-block-for-abort-early
Open

[Core] Proactively free KV cache blocks when aborting finished requests#35506
jianzs wants to merge 2 commits intovllm-project:mainfrom
jianzs:feat/free-block-for-abort-early

Commits

Commits on Mar 4, 2026

Commits on Mar 5, 2026