[DO NOT MERGE] Reapply "[BugFix] Fix engine hanging after KV cache initialization failure #35478"#36650
Closed
markmc wants to merge 1 commit intovllm-project:mainfrom
Closed
[DO NOT MERGE] Reapply "[BugFix] Fix engine hanging after KV cache initialization failure #35478"#36650markmc wants to merge 1 commit intovllm-project:mainfrom
markmc wants to merge 1 commit intovllm-project:mainfrom
