[Core][Feat] Add max-waiting-queue-time parameter to reject requests#37413
Open
chaunceyjiang wants to merge 2 commits intovllm-project:mainfrom
Open
[Core][Feat] Add max-waiting-queue-time parameter to reject requests#37413chaunceyjiang wants to merge 2 commits intovllm-project:mainfrom
chaunceyjiang wants to merge 2 commits intovllm-project:mainfrom