Skip to content

fix(fallback): pass explicit base_url and api_key to resolve_provider_client - #3853

Closed
cameronbergh wants to merge 1 commit into
NousResearch:mainfrom
cameronbergh:fix/fallback-explicit-credentials
Closed

fix(fallback): pass explicit base_url and api_key to resolve_provider_client#3853
cameronbergh wants to merge 1 commit into
NousResearch:mainfrom
cameronbergh:fix/fallback-explicit-credentials

Conversation

@cameronbergh

Copy link
Copy Markdown
Contributor

Without these, fallback providers configured with custom endpoints (e.g. LM Studio, Ollama) fail to resolve because the router falls back to OPENAI_BASE_URL / OPENAI_API_KEY env vars instead of using the per-provider credentials from the fallback_chain config.

Fixes the credential passthrough gap in the chain fallback mechanism from PR #3813.

…_client

Without these, fallback providers configured with custom endpoints (e.g. LM Studio,
Ollama) fail to resolve because the router falls back to OPENAI_BASE_URL /
OPENAI_API_KEY env vars instead of using the per-provider credentials
from the fallback_chain config.
@teknium1

Copy link
Copy Markdown
Contributor

Thanks for the contribution, @cameronbergh!

Closing this as a duplicate of #2587 (by @KiraKatana), which targets the same fix/feature. We're consolidating on that PR for review.

If you want to help push it over the line, please jump in there — or if you think your approach is better for a specific reason that isn't covered in the other PR, let us know and we can reopen.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants