Skip to content

feat(router): reject with 429 when a deployment's max_parallel_requests slots are all in use - #41555

Merged
yassin-berriai merged 6 commits into
mainfrom
litellm_max_parallel_requests_queue_size
Sep 18, 2026
Merged

feat(router): reject with 429 when a deployment's max_parallel_requests slots are all in use#41555
yassin-berriai merged 6 commits into
mainfrom
litellm_max_parallel_requests_queue_size

Merge remote-tracking branch 'origin/main' into litellm_max_parallel_…

61ce1b4
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch succeeded Sep 18, 2026 in 1s

96.42% of diff hit (target 81.58%)

View this Pull Request on Codecov

96.42% of diff hit (target 81.58%)

View more details on Codecov