Repository navigation
LiteLLM Minor Fixes & Improvements (2024/12/18) p1 - #7295
Merged
17 commits merged intoDec 19, 2024
Merged
17 commits merged into
17 commits merged into
Conversation
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
…e ai studio - pricing + commercial rate limits
…audio output = true
…nterprise feature
… 'stop' params for o1 and 'stream_options' param for o1-mini
…sage' to supporting openai models needed as o1-preview, and o1-mini models don't support 'system message
…1-preview o1 currently doesn't support streaming, but the other model versions do Fixes #7292
…ported params if model map says so Fixes #7292
![github-advanced-security[bot]](https://avatars.githubusercontent.com/in/57789?s=60&v=4){kind=small}
| ) | ||
| except Exception: | ||
| verbose_logger.debug( | ||
| f"Unable to infer model provider for model={model}, defaulting to openai for o1 supported param check" |
Check failure
Code scanning / CodeQL
Clear-text logging of sensitive information
Show autofix suggestion
Hide autofix suggestion
Copilot Autofix
AI almost 2 years ago
To fix the problem, we should avoid logging sensitive information directly. Instead, we can log a generic message that does not include the sensitive data. This way, we maintain the ability to log useful information for debugging purposes without exposing sensitive data.
- Replace the log message that includes the
modelvariable with a more generic message. - Ensure that no sensitive information is included in the log message.
Suggested changeset
1
litellm/llms/openai/chat/o1_transformation.py
| @@ -68,3 +68,3 @@ | ||
| verbose_logger.debug( | ||
| f"Unable to infer model provider for model={model}, defaulting to openai for o1 supported param check" | ||
| "Unable to infer model provider, defaulting to openai for o1 supported param check" | ||
| ) |
Copilot is powered by AI and may make mistakes. Always verify output.
…upported params + handle stream options being passed in for azure o1
Allows o1 calls to be faked for just the "o1" model, allows native streaming for o1-mini, o1-preview Fixes #7292
Codecov ReportAttention: Patch coverage is
📢 Thoughts on this report? Let us know! |
ghost
changed the title
fzowl
pushed a commit
to fzowl/litellm
that referenced
this pull request
Jun 24, 2026
* fix(health.md): add rerank model health check information * build(model_prices_and_context_window.json): add gemini 2.0 for google ai studio - pricing + commercial rate limits * build(model_prices_and_context_window.json): add gemini-2.0 supports audio output = true * docs(team_model_add.md): clarify allowing teams to add models is an enterprise feature * fix(o1_transformation.py): add support for 'n', 'response_format' and 'stop' params for o1 and 'stream_options' param for o1-mini * build(model_prices_and_context_window.json): add 'supports_system_message' to supporting openai models needed as o1-preview, and o1-mini models don't support 'system message * fix(o1_transformation.py): translate system message based on if o1 model supports it * fix(o1_transformation.py): return 'stream' param support if o1-mini/o1-preview o1 currently doesn't support streaming, but the other model versions do Fixes BerriAI#7292 * fix(o1_transformation.py): return tool calling/response_format in supported params if model map says so Fixes BerriAI#7292 * fix: fix linting errors * fix: update '_transform_messages' * fix(o1_transformation.py): fix provider passed for supported param checks * test(base_llm_unit_tests.py): skip test if api takes >5s to respond * fix(utils.py): return false in 'supports_factory' if can't find value * fix(o1_transformation.py): always return stream + stream_options as supported params + handle stream options being passed in for azure o1 * feat(openai.py): support stream faking natively in openai handler Allows o1 calls to be faked for just the "o1" model, allows native streaming for o1-mini, o1-preview Fixes BerriAI#7292 * fix(openai.py): use inference param instead of original optional param
This pull request was closed.
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
fix(health.md): add rerank model health check information
build(model_prices_and_context_window.json): add gemini 2.0 for google ai studio - pricing + commercial rate limits
build(model_prices_and_context_window.json): add gemini-2.0 supports audio output = true
docs(team_model_add.md): clarify allowing teams to add models is an enterprise feature
fix(o1_transformation.py): add support for 'n', 'response_format' and 'stop' params for o1 and 'stream_options' param for o1-mini
build(model_prices_and_context_window.json): add 'supports_system_message' to supporting openai models
needed as o1-preview, and o1-mini models don't support 'system message
fix(o1_transformation.py): translate system message based on if o1 model supports it
fix(o1_transformation.py): return 'stream' param support if o1-mini/o1-preview
o1 currently doesn't support streaming, but the other model versions do
Fixes #7292
Fixes #7292
fix: fix linting errors
fix: update '_transform_messages'
fix(o1_transformation.py): fix provider passed for supported param checks
test(base_llm_unit_tests.py): skip test if api takes >5s to respond
fix(utils.py): return false in 'supports_factory' if can't find value
fix(o1_transformation.py): always return stream + stream_options as supported params + handle stream options being passed in for azure o1
feat(openai.py): support stream faking natively in openai handler
Allows o1 calls to be faked for just the "o1" model, allows native streaming for o1-mini, o1-preview
Fixes #7292