[Feature] Add --max-unfinished-requests apiserver parameter#39492

chaunceyjiang wants to merge 2 commits into

vllm-project:mainvllm-project/vllm:mainfrom

chaunceyjiang:feature/max-unfinished-requestschaunceyjiang/vllm:feature/max-unfinished-requestsCopy head branch name to clipboard