Skip to content

fix(proxy): enforce max_parallel_requests as a per-slot concurrency gauge - #32441

Merged
yassin-berriai merged 5 commits into
litellm_internal_stagingfrom
litellm_max_parallel_requests_concurrency_gauge
Jul 17, 2026
Merged

fix(proxy): enforce max_parallel_requests as a per-slot concurrency gauge#32441
yassin-berriai merged 5 commits into
litellm_internal_stagingfrom
litellm_max_parallel_requests_concurrency_gauge

style(proxy): use builtin generics and union syntax in new rate limit…

d29a777
Select commit
Loading
Failed to load commit list.
CodSpeed / CodSpeed Performance Analysis succeeded Jul 16, 2026 in 0s

Performance Gate Passed

✅ 31 untouched benchmarks

Comparing litellm_max_parallel_requests_concurrency_gauge (d29a777) with litellm_internal_staging (2162da5)

Open in CodSpeed
View more details on CodSpeed