[Feature] Add --max-unfinished-requests apiserver parameter#39492
Open
chaunceyjiang wants to merge 2 commits intovllm-project:mainfrom
Open
[Feature] Add --max-unfinished-requests apiserver parameter#39492chaunceyjiang wants to merge 2 commits intovllm-project:mainfrom
chaunceyjiang wants to merge 2 commits intovllm-project:mainfrom