[Core][Feat] Add max-waiting-queue-length parameter to reject requests when waiting queue is full#21352
Closed
chaunceyjiang wants to merge 6 commits intovllm-project:mainfrom
Closed
[Core][Feat] Add max-waiting-queue-length parameter to reject requests when waiting queue is full#21352chaunceyjiang wants to merge 6 commits intovllm-project:mainfrom
chaunceyjiang wants to merge 6 commits intovllm-project:mainfrom
Commits
Commits on Sep 12, 2025
- committed
- committed
- committed
- committed
- committed
- committed
