Skip to content

Don't fail for global_max_parallel_requests = 1 - #9173

Closed
vvidovic wants to merge 1 commit into
BerriAI:mainfrom
vvidovic:fix_global_max_parallel_requests
Closed

Don't fail for global_max_parallel_requests = 1#9173
vvidovic wants to merge 1 commit into
BerriAI:mainfrom
vvidovic:fix_global_max_parallel_requests

Conversation

@vvidovic

@vvidovic vvidovic commented Mar 12, 2025

Copy link
Copy Markdown
Contributor

When global_max_parallel_requests was set to 1, all requests failed.

Title

Fix global_max_parallel_requests initial request

Relevant issues

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

  • I have Added testing in the tests/litellm/ directory, Adding at least 1 test is a hard requirement - see details
  • I have added a screenshot of my new test passing locally
  • My PR passes all unit tests on (make test-unit)[https://docs.litellm.ai/docs/extras/contributing_code]
  • My PR's scope is as isolated as possible, it only solves 1 specific problem

Type

🐛 Bug Fix
✅ Test

Changes

  • Fix global_max_parallel_requests initial request

image

@vercel

vercel Bot commented Mar 12, 2025

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Apr 23, 2025 6:05am

@CLAassistant

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

When `global_max_parallel_requests` was set to `1`, all requests
failed.
@vvidovic

vvidovic commented May 7, 2025

Copy link
Copy Markdown
Contributor Author

Any news about this PR?
I signed CLA, as visible in the: #9175. For some reason, in this PR it is not visible.

@vvidovic

vvidovic commented May 9, 2025

Copy link
Copy Markdown
Contributor Author

@ishaan-jaff - did you have time to check this PR?

@github-actions

github-actions Bot commented Aug 8, 2025

Copy link
Copy Markdown
Contributor

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

@github-actions github-actions Bot added the stale label Aug 8, 2025
@github-actions github-actions Bot closed this Aug 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants