[BugFix] Clear spec_token_ids for preempted req to prevent grammar conflicts on resumption#31955
Closed
izhuhaoran wants to merge 2 commits intovllm-project:mainfrom
Closed
[BugFix] Clear spec_token_ids for preempted req to prevent grammar conflicts on resumption#31955izhuhaoran wants to merge 2 commits intovllm-project:mainfrom
izhuhaoran wants to merge 2 commits intovllm-project:mainfrom
