Repository navigation
Conversation
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
| ## RESPONSE OBJECT | ||
| response = model_response | ||
| elif custom_llm_provider == "ollama": | ||
| if extra_headers is not None: |
There was a problem hiding this comment.
i believe the headers field should already have this.
we just need extra_headers passed to an llm provider integration for openai/azure as they use the openai sdk which requires it in that way
the rest, can just use the headers field - which already updates if 'extra_headers' is passed as a param to the sdk
There was a problem hiding this comment.
Yes, I was just following the pattern for other providers where extra_headers was included in optional_params. Are you proposing optional_params['headers'] = headers instead of optional_params['extra_headers'] = extra_headers?
|
|
1 similar comment
|
|
|
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. |
Title
Add extra headers for ollama completion
Relevant issues
Fixes #7179
Type
🆕 New Feature
Changes
extra_headerspassed in to ollama viaoptional_params[REQUIRED] Testing - Attach a screenshot of any new tests passing locall
If UI changes, send a screenshot/GIF of working UI fixes
no new tests