[Core] Add max-waiting-queue-length parameter to reject requests when queue is full#21271

chudyandrej wants to merge 3 commits intovllm-project:mainvllm-project/vllm:mainfrom

kontextso:ach/max_waiting_queue_lengthkontextso/vllm:ach/max_waiting_queue_lengthCopy head branch name to clipboard