fix(proxy): enforce max_parallel_requests as a per-slot concurrency gauge - #32441

fix(proxy): enforce max_parallel_requests as a per-slot concurrency gauge#32441

yassin-berriai merged 5 commits into

litellm_internal_stagingBerriAI/litellm:litellm_internal_stagingfrom

litellm_max_parallel_requests_concurrency_gaugeBerriAI/litellm:litellm_max_parallel_requests_concurrency_gaugeCopy head branch name to clipboard