Skip to content

[Core] Free KV cache GPU memory on engine shutdown#28953

Closed
markmc wants to merge 8 commits intovllm-project:mainfrom
markmc:llm-engine-shutdown
Closed

[Core] Free KV cache GPU memory on engine shutdown#28953
markmc wants to merge 8 commits intovllm-project:mainfrom
markmc:llm-engine-shutdown

Commits

Commits on Dec 18, 2025