Skip to content

feat(router): reject with 429 when a deployment's max_parallel_requests slots are all in use - #41555

Merged
yassin-berriai merged 6 commits into
mainfrom
litellm_max_parallel_requests_queue_size
Sep 18, 2026
Merged

feat(router): reject with 429 when a deployment's max_parallel_requests slots are all in use#41555
yassin-berriai merged 6 commits into
mainfrom
litellm_max_parallel_requests_queue_size

Merge remote-tracking branch 'origin/main' into litellm_max_parallel_…

61ce1b4
Select commit
Loading
Failed to load commit list.
CodSpeed / CodSpeed Performance Analysis succeeded Sep 18, 2026 in 0s

Performance Gate Passed

✅ 31 untouched benchmarks

Comparing litellm_max_parallel_requests_queue_size (61ce1b4) with main (8fc9c46)

Open in CodSpeed
View more details on CodSpeed