🔄 Upstream Sync: LiteLLM v1.81.0-stable - #85

Closed

mateo-di wants to merge 7611 commits into

upstream-sync/v1.81.0-stable

This pull request is big! We're only showing the most recent 250 commits

Commits on Jan 28, 2026

UI: New build
ishaan-jaff
committed
e444199
breakdown by team and keys
yuneng-jiang
committed
905e9cd
Merge remote-tracking branch 'origin' into litellm_key_alias_spend_usage_report
yuneng-jiang
committed
8a54fff
Adding test
yuneng-jiang
committed
077cfa8
Fixing build
yuneng-jiang
committed
dbd1ff3
fix pypdf: >=6.6.2
ishaan-jaff
committed
5135efb
Merge pull request #19918 from BerriAI/litellm_ui_spend_logs_store
yuneng-jiang
authored
054918e
[Fix] A2a Gateway - Allow supporting old A2a card formats (#19949)
ishaan-jaff
authored
3ef475b
Add error_message search in spend logs endpoint
yuneng-jiang
committed
cb8ead6
Adding Error message search to ui spend logs
yuneng-jiang
committed
0cdfa8e

Commits on Jan 29, 2026

Merge pull request #19960 from BerriAI/litellm_ui_spend_logs_error_message
yuneng-jiang
authored
cccda30
fix
ishaan-jaff
committed
c4daa39
fix(presidio): reuse HTTP connections to prevent OOMs (#19964)
AlexsanderHamir
authored
3816570
[Fix] VertexAI Pass through - fix regression that caused vertex ai passthroughs to stop working for router models (#19967)

authored
d12ce3c
fix Prompt Studio history to load tools and system messages (#19920)
nehaaprasad
authored
a785eec
Reusable Table Sort Component
yuneng-jiang
committed
92f9d8f
Fixing sorting API calls
yuneng-jiang
committed
e905667
[Release Day] - Fixed CI/CD issues & changed processes (#19902)
AlexsanderHamir
authored
69bd442
[Feat] - Search API add /list endpoint to list what search tools exist in router (#19969)
ishaan-jaff
authored
dcca8c7
Merge pull request #19970 from BerriAI/litellm_ui_column_sort_component
yuneng-jiang
authored
632e8cf
fixing sorting for v2/model/info
yuneng-jiang
committed
58dd3bd
Merge pull request #19963 from BerriAI/litellm_ui_spend_logs_em_search
yuneng-jiang
authored
e796b9e
[Feat] LiteLLM Vector Stores - Add permission management for users, teams (#19972)
ishaan-jaff
authored
9c5fed4
feat: Add new OpenRouter models: `xiaomi/mimo-v2-flash`, `z-ai/glm-4.7`, `z-ai/glm-4.7-flash`, and `minimax/minimax-m2.1`. to model prices and context window (#19938)
rushilchugh01
authored
562f0a0
fix gemini gemini-robotics-er-1.5-preview entry
Sameerlite
committed
be8a76f
Merge pull request #19974 from BerriAI/litellm_model_map_fix_jan_29
Sameerlite
authored
2a1bfd3
fix(vertex_ai): convert image URLs to base64 in tool messages for Anthropic (#19896)
Chesars
authored
8a26033
Fix/router search tools v2 (#19840)
Harshit28j
authored
8e2fa79
removing _experimental out routes from gitignore
yuneng-jiang
committed
20bab33
chore: update Next.js build artifacts (2026-01-29 04:12 UTC, node v22.16.0)
yuneng-jiang
committed
12a4d14
Merge pull request #19976 from BerriAI/ui_build_yj_2
yuneng-jiang
authored
507f4c4
Merge pull request #19953 from BerriAI/litellm_key_alias_spend_usage_report
yuneng-jiang
authored
f2d2ed5
Fix: Batch cancellation ownership bug
Sameerlite
committed
833cf6a
Fix stream_chunk_builder to preserve images from streaming chunks (#19654)
Chesars
authored
c7453c0
fix(docker): add libsndfile to main Dockerfile for ARM64 audio processing (#19776)
Chesars
authored
2a48d12
Fix File access permissions for .retreive and .delete
Sameerlite
committed
70684ca
Fix Only allowed to call routes: ['llm_api_routes']. Tried to call route: /batches/bGl0ZWxsbV9wcm/cancel
Sameerlite
committed
654edbd
fix(proxy): add datadog_llm_observability to /health/services allowed list (#19952)
michelligabriele
authored
dcf5f07
fix(proxy): prevent provider-prefixed model leaks (#19943)
bcdonadio
authored
ba17f51
fix(hosted_vllm): route through base_llm_http_handler to support ssl_verify (#19893)
cfchase
authored
87bdfb0
Add OpenRouter Kimi K2.5 (#19872)

ayim
and
claude
authored
d4031c8
Fix: Encoding cancel batch response
Sameerlite
committed
8966852
Add tests for user level permissions on file and batch access
Sameerlite
committed
fa2b065
Fix: mypy errors
Sameerlite
committed
d3b2afb
Fix lint issues
Sameerlite
committed
98ae6dc
Add litellm metadata correctly for file create
Sameerlite
committed
4b385e5
Add cost tacking and usage info in call_type=aretrieve_batch
Sameerlite
committed
fce2635
Add custom_llm_provider as gemini translation
Sameerlite
committed
5270aa5
Add /openai_passthrough route for openai passthrough requests:
Sameerlite
committed
8808e4d
Add test to check if model map is corretly formatted
Sameerlite
committed
fa80dc6
Merge pull request #19992 from BerriAI/litellm_add_model_map_test
Sameerlite
authored
6997ee8
Intentional bad model map
Sameerlite
committed
5dea545
Add Validate model_prices_and_context_window.json job
Sameerlite
committed
39dea34
Remove validate job from lint
Sameerlite
committed
b0dec49
Merge pull request #19993 from BerriAI/litellm_add_model_map_test
Sameerlite
authored
3503491
Intentional bad model map
Sameerlite
committed
f55ed3f
Intentional bad model map
Sameerlite
committed
0beaec0
Correct model map path
Sameerlite
committed
45867ba
Merge pull request #19994 from BerriAI/litellm_add_model_map_test
Sameerlite
authored
4aa786b
Fix: litellm_fix_robotic_model_map_entry
Sameerlite
committed
ef15861
Merge pull request #19997 from BerriAI/litellm_fix_robotic_model_map_entry
Sameerlite
authored
a2fd56f
Merge branch 'main' into litellm_oss_staging_01_28_2026
Sameerlite
authored
df07297
Merge pull request #19906 from BerriAI/litellm_oss_staging_01_28_2026
Sameerlite
authored
bd4918c
Merge pull request #19988 from BerriAI/litellm_gemini_robotics_llm_provider2
Sameerlite
authored
7c4577b
Fix max_input_tokens for gpt-5.2-codex
genga6
committed
fa54c24
fix(gemini): support file retrieval in GoogleAIStudioFilesHandler

Varun Sripad
authored and
Varun Sripad
committed
8b6bcfc
Merge pull request #19971 from BerriAI/litellm_v2_model_info_sorting_fix
yuneng-jiang
authored
bc23a97
Merge pull request #19886 from BerriAI/litellm_bulk_edit_keys
yuneng-jiang
authored
42081a5
error_code in spend logs error metadata
yuneng-jiang
committed
158e1e3
Show spend logs settings + allow delete of rentention period
yuneng-jiang
committed
d081e01
Adding tests
yuneng-jiang
committed
e080f92
Adding proxy_server
yuneng-jiang
committed
96cb2ef
Merge pull request #20015 from BerriAI/litellm_logs_error_code
yuneng-jiang
authored
3c02abb
Merge pull request #20017 from BerriAI/litellm_ui_spendlogs_setting_hook
yuneng-jiang
authored
f3515b7
sync: merge upstream/main for v1.81.0-stable
Cartofante
committed
74297a9
Adjusting new badges
yuneng-jiang
committed
6b77060
Merge remote-tracking branch 'origin' into litellm_new_badge_dot
yuneng-jiang
committed
ca8056f
Adding tests
yuneng-jiang
committed
5cd482c
Merge pull request #20024 from BerriAI/litellm_new_badge_dot
yuneng-jiang
authored
f782a2a

Commits on Jan 30, 2026

Add event-driven coordination for global spend query to prevent cache stampede (#20030)
AlexsanderHamir
authored
12f5824
Allow config embedding models
yuneng-jiang
committed
81e8a12
adding tests
yuneng-jiang
committed
0b6bacb
[Feat] New Model - amazon.nova-2-pro-preview-20251202-v1:0 (#20033)
ishaan-jaff
authored
f7e1a22
[Feat] LiteLLM x Claude Agent SDK Integration (#20035)
ishaan-jaff
authored
476f0b2
[Docs] Claude Agents SDK x LiteLLM Guide (#20036)
ishaan-jaff
authored
c9658f8
sync: merge upstream/main for v1.81.0-stable
Cartofante
committed
c976835
Model Usage per key
yuneng-jiang
committed
aa75bec
adding tests
yuneng-jiang
committed
19b6c44
fix: run prisma generate as nobody user in non-root container (#20000)
milan-berri
authored
8fcdf61
Merge pull request #20042 from BerriAI/main
Sameerlite
authored
c509ffc
Merge branch 'main' into litellm_oss_staging_01_29_2026
Sameerlite
authored
eb50c78
fix(ResponseAPILoggingUtils): extract input tokens details as dict
nht1206
committed
e95b9b8
Merge pull request #19989 from BerriAI/litellm_add_passthrough_openai_route
Sameerlite
authored
b0b4362
Add routing of xai chat completions to responses when web search options is present
Sameerlite
committed
dbc8006
Add web search tests
Sameerlite
committed
11c2160
Add disable flahg for anthropic gemini cache translation
Sameerlite
committed
5ac3f75
fix aspectRatio mapping
Sameerlite
committed
3c451e9
feat: add /delete endpoint support for gemini
Sameerlite
committed
78dd4b2
Merge pull request #20018 from varunsripad123/fix/google-files-retrieval
Sameerlite
authored
ed4c71e
Merge pull request #20046 from nht1206/bugfix/input-tokens-details-not-correctly-extracted
Sameerlite
authored
ab8b459
Merge pull request #20009 from genga6/fix/#20006-update-max-input-tokens-for-gpt-5.2-codex
Sameerlite
authored
fdb4b54
Fix: vllm embedding format
Sameerlite
committed
55348dd
Merge pull request #19975 from BerriAI/litellm_oss_staging_01_29_2026
Sameerlite
authored
a805426
Merge pull request #20055 from BerriAI/litellm_files_gemini_endpoints_support
Sameerlite
authored
51747ee
Merge pull request #19981 from BerriAI/litellm_fix_batches_permissions
Sameerlite
authored
cfc9c77
Merge pull request #19986 from BerriAI/litellm_batch_cost_tracking_jan29
Sameerlite
authored
8d485f2
Merge pull request #20051 from BerriAI/litellm_xai_web_search_routing
Sameerlite
authored
404c33e
Merge pull request #20052 from BerriAI/litllm_disable_cache_jan_29
Sameerlite
authored
8b9d501
Merge pull request #20053 from BerriAI/litellm_gemini_edit_jan_30
Sameerlite
authored
5277a0c
Merge pull request #20056 from BerriAI/litellm_vllm_embedding
Sameerlite
authored
1877483
Fix: remove unsupported prompt-caching-scope-2026-01-05 header for vertex ai
Sameerlite
committed
8363a26
Merge pull request #20058 from BerriAI/litellm_vertex_ai_prompt-caching-scope-2026-01-05,
Sameerlite
authored
6e92103
Merge pull request #20039 from BerriAI/litellm_ui_key_model_bd
yuneng-jiang
authored
c301339
Add mock client factory pattern and mock support for PostHog, Helicone, and Braintrust integrations (#19707)
AlexsanderHamir
authored
0acfcb4
Realtime API benchmarks (#20074)

authored
3910161
fixes: ci pipeline router coverage failure (#20065)
Harshit28j
authored
481bb4b
fix: working claude code with agent SDKs (#20081)
ishaan-jaff
authored
974837c
[Feat] Add async_post_call_response_headers_hook to CustomLogger (#20083)

ishaan-jaff
and
michelligabriele
authored
6897d5f
Add WATSONX_ZENAPIKEY
yuneng-jiang
committed
1f5b875
fix(proxy): resolve high CPU when router_settings in DB by avoiding REGISTRY.collect() in PrometheusServicesLogger (#20087)
AlexsanderHamir
authored
a11b043
v0 - looks decen view
ishaan-jaff
committed
8b7a925
refactored code
ishaan-jaff
committed
f07ef8a
fix ui
ishaan-jaff
committed
5f07635
fixes ui
ishaan-jaff
committed
2014bcf
complete v2 viewer
ishaan-jaff
committed
61bb51d
fix drawer
ishaan-jaff
committed
437e9e2

Commits on Jan 31, 2026

Revert logs view commits to recreate with clean history (#20090)
ishaan-jaff
authored
ad1b48a
update image and bounded logo in navbar
yuneng-jiang
committed
3e8e1de
Merge pull request #20092 from BerriAI/litellm_user_dropdown
yuneng-jiang
authored
b64cd31
refactoring user dropdown
yuneng-jiang
committed
0942f98
Merge pull request #20095 from BerriAI/litellm_user_dropdown_v2
yuneng-jiang
authored
267993b
new utils
ishaan-jaff
committed
2ce87a3
address feedback
ishaan-jaff
committed
e2f7b10
[Feat] v2 - Logs view with side panel and improved UX (#20091)
ishaan-jaff
authored
5345a76
Delete resource modal dark mode
yuneng-jiang
committed
b8e2ac4
[Feat] UI - New View to render "Tools" on Logs View (#20093)

ishaan-jaff
and
cursoragent
authored
1cd83e9
[Feat] UI - Add Pretty print view of request/response (#20096)

ishaan-jaff
and
warp-agent
authored
4abae44
remove md
ishaan-jaff
committed
87c1e6f
fixed mcp tools instructions on ui to show comma seprated str instead of list
shivam
committed
d012677
docs: cleanup docs
Krrish Dholakia
committed
0edd50f
Merge pull request #20101 from BerriAI/ui-mcp-list-tools-instructions-fix
shivamrawat1
authored
3f1bda5
litellm_fix: add missing timezone import to proxy_server.py (#20121)
shin-bot-litellm
authored
08e4d06
fix(proxy): reduce PLR0915 complexity in base_process_llm_request (#20127)
shin-bot-litellm
authored
4029f61
litellm_fix(ui): remove unused ToolOutlined import (#20129)
shin-bot-litellm
authored
8e69c2e
litellm_fix(e2e): disable bedrock-converse-claude-sonnet-4.5 model in tests (#20131)
shin-bot-litellm
authored
ecd0202
litellm_fix(test): fix Azure AI cost calculator test - use Logging class (#20134)
shin-bot-litellm
authored
013b470
litellm_fix(test): fix Bedrock tool search header test regression (#20135)
shin-bot-litellm
authored
14a5706
litellm_fix(test): allow comment field in schema and exclude robotics models from tpm check (#20139)
shin-bot-litellm
authored
7db4594
litellm_docs: add missing environment variable documentation (#20138)
shin-bot-litellm
authored
1c757de
litellm_fix(test): add acancel_batch to Azure SDK client initialization test (#20143)
shin-bot-litellm
authored
395ad9b
litellm_fix: handle unknown models in Azure AI cost calculator (#20150)
shin-bot-litellm
authored
10194d9
litellm_fix(test): fix router silent experiment tests to properly mock async functions (#20140)
shin-bot-litellm
authored
e35e650
Merge pull request #20098 from BerriAI/litellm_ui_dark_mode_2
yuneng-jiang
authored
b366335
Merge pull request #20031 from BerriAI/litellm_new_badge_dot
yuneng-jiang
authored
c4a2745
Merge pull request #20086 from BerriAI/litellm_watsonx_inte_fix
yuneng-jiang
authored
ae2cf71
chore: update Next.js build artifacts (2026-01-31 17:20 UTC, node v22.16.0)
yuneng-jiang
committed
87b4da4
Merge pull request #20154 from BerriAI/ui_build_yj_jan_31
yuneng-jiang
authored
f2cb31a
fix(proxy): use get_async_httpx_client for logo download (#20155)
shin-bot-litellm
authored
2f6d18e
fix(datadog): check for agent mode before requiring DD_API_KEY/DD_SITE (#20156)
shin-bot-litellm
authored
d5bc80b
litellm_fix: handle empty dict for web_search_options in Nova grounding (#20159)
shin-bot-litellm
authored
1b43814
fix(mypy): fix type errors in files, opentelemetry, gemini transformation, and key management (#20161)
shin-bot-litellm
authored
6c497d2
litellm_fix(test): update Prometheus metric test assertions with new labels (#20162)
shin-bot-litellm
authored
2780e2f
test: remove hosted_vllm from OpenAI client tests (#20163)
shin-bot-litellm
authored
fea4092
litellm_fix: bump litellm-proxy-extras version to 0.4.28 (#20166)

shin-bot-litellm
and
shin-bot-litellm
authored
ea01163
litellm_fix(mypy): fix remaining type errors (#20164)

shin-bot-litellm
and
shin-bot-litellm
authored
5434b66
litellm_fix(security): allowlist Next.js CVEs for 7 days (#20169)
shin-bot-litellm
authored
df042f7
litellm_fix(router): use safe_deep_copy in _get_silent_experiment_kwargs (#20170)
shin-bot-litellm
authored
244c80a
docs(embeddings): add supported input formats section (#20073)
Chesars
authored
3fa7ab1
fix proxy extras pip
ishaan-jaff
committed
df7ea19
fix gemini files
ishaan-jaff
committed
4bf4e79
fix EventDrivenCacheCoordinator
ishaan-jaff
committed
d53ef30
test_increment_top_level_request_and_spend_metrics
ishaan-jaff
committed
3759ea2
fix typing
ishaan-jaff
committed
05552b5
fix transform_retrieve_file_response
ishaan-jaff
committed
08271a8
fix linting
ishaan-jaff
committed
f508a99
fix mcp linting
ishaan-jaff
committed
54a3838
_add_web_search_tool
ishaan-jaff
committed
9fe0819
test_bedrock_nova_grounding_web_search_options_non_streaming
ishaan-jaff
committed
8b575f4
add _is_bedrock_tool_block
ishaan-jaff
committed
e6c1a65
fix MCP client
ishaan-jaff
committed
36dfa0f
fix files
ishaan-jaff
committed
41ec820
litellm_fix(lint): remove unused ToolNameValidationResult imports (#20176)
shin-bot-litellm
authored
14f31a0
litellm_fix(azure): Fix acancel_batch not using Azure SDK client initialization (#20168)

shin-bot-litellm
and
shin-bot-litellm
authored
bcc05a6
fix tar security issue with TAR
ishaan-jaff
committed
a002907
fix model name during fallback
yuneng-jiang
committed
c9261c9
Merge pull request #20177 from BerriAI/litellm_global_fallback_fix
yuneng-jiang
authored
a81af9a
test_get_image_non_root_uses_var_lib_assets_dir
ishaan-jaff
committed
280e8a9
test_delete_vector_store_checks_access
ishaan-jaff
committed
f1b16d2
test_get_session_iterator_thread_safety
ishaan-jaff
committed
66c7233
Fix health endpoints
yuneng-jiang
committed
b7c4599
Merge pull request #20182 from BerriAI/litellm_ui_health_checks
yuneng-jiang
authored
ac1459e
_prepare_vertex_auth_headers
ishaan-jaff
committed
852ea7d
test_budget_reset_and_expires_at_first_of_month
ishaan-jaff
committed
38f5ae8
fix(test): add router.acancel_batch coverage (#20183)
shin-bot-litellm
authored
5bd5df3
fix(mypy): fix validate_tool_name return type signatures (#20184)
shin-bot-litellm
authored
65fb18b
fix(test): update test_chat_completion to handle metadata in body
Shin
committed
586b041
fix(proxy): resolve 'multiple values for keyword argument' in batch cancel and file retrieve
shin-bot-litellm
committed
dff7f83
ci(security): allowlist GHSA-34x7-hfp2-rc4v (node-tar hardlink)
shin-bot-litellm
committed
f9fbffa
fix(mypy): add type: ignore for conditional function variants in MCP modules
shin-bot-litellm
committed
d9da49b
fix: make cache updates synchronous for budget enforcement
shin-bot-litellm
committed
d038341
fix(test): accept both AuthenticationError and InternalServerError in batch_completion test (#20186)

shin-bot-litellm
and
shin-bot-litellm
authored
db120c5
test_embedding fix
ishaan-jaff
committed
2e6659d
fix bedrock-nova-premier
ishaan-jaff
committed
a4acf81
Revert "fix: make cache updates synchronous for budget enforcement"
ishaan-jaff
committed
54286fc
fix(test): correct prompt_tokens in test_string_cost_values (#20185)
shin-bot-litellm
authored
e2475f4
fix: bedrock-converse-claude-sonnet-4.5
ishaan-jaff
committed
671fd84
fix: stabilize CI tests - routes and bedrock config

ishaan-jaff
and
cursoragent
committed
c7522e3
sync: generator client
ishaan-jaff
committed
47efa33
add LiteLLM_ManagedVectorStoresTable_user_id_idx
ishaan-jaff
committed
a92b938
docs/blog index page (#20188)
ryan-crabbe
authored
82383cd
UI spend logs setting docs
yuneng-jiang
committed
af015fe
bump extras
ishaan-jaff
committed
7e5e626
Merge pull request #20197 from BerriAI/spend_logs_docs
yuneng-jiang
authored
543e85a
fix fake-openai-endpoint
ishaan-jaff
committed
94d5036
doc fix
yuneng-jiang
committed
93dfac7
fix team budget checks
ishaan-jaff
committed
d897c5e
Merge pull request #20198 from BerriAI/spend_logs_docs
yuneng-jiang
authored
0bf471b
bump: version 1.81.5 → 1.81.6
ishaan-jaff
committed
427d8f4
litellm_fix_mapped_tests_core: clear client cache and fix isinstance checks (#20196)

shin-bot-litellm
and
shin-bot-litellm
authored
37a45a3

Commits on Feb 1, 2026

test_chat_completion_low_budget
ishaan-jaff
committed
0c785b3
fix: delete_file
ishaan-jaff
committed
ecb725f
fixes
ishaan-jaff
committed
01b96f1
fix: update test_prometheus to expect masked user_id in metrics

ishaan-jaff
and
cursoragent
committed
3a3576d
docs fix
ishaan-jaff
committed
8a57ee5
feat(bedrock): add base cache costs for sonnet v1 (#20214)
cscguochang
committed
76407bc
docs: fix dead links in v1.81.6 release notes (#20218)

shin-bot-litellm
and
shin-bot-litellm
authored
93a0631
fix(test): update test_prometheus with masked user_id and missing labels

ishaan-jaff
and
cursoragent
committed
bb3c2a9
litellm_fix_mapped_tests_core: fix test isolation and mock injection issues (#20209)

shin-bot-litellm
and
ishaan-jaff
authored
0c00679
Revert "Merge pull request #18790 from BerriAI/litellm_key_team_routing_3"
ishaan-jaff
committed
35e29c2
test_proxy_failure_metrics
ishaan-jaff
committed
faff9d1
test_proxy_success_metrics
ishaan-jaff
committed
92c8e00
fix(test): make test_proxy_failure_metrics resilient to missing proxy-level metrics

ishaan-jaff
and
cursoragent
committed
466e6bd
test fix
ishaan-jaff
committed
b7e48f1
docs: Update v1.81.6 release notes - focus on Logs v2 with Tool Call Tracing (#20225)

shin-bot-litellm
and
shin-bot-litellm
authored
df387c3
feat: enhance Cohere embedding support with additional parameters and model version
amirzaushnizer
committed
f0853b2

Commits on Feb 2, 2026

Commits on Feb 3, 2026

sync: merge v1.81.0-stable tag
Cartofante
committed
31e39ac

Commits on Feb 4, 2026

fix: resolve upstream sync conflicts for PR #85
github-actions[bot]
committed
72922c6
fix(ci): resolve CI failures from upstream sync

github-actions[bot]
and
claude
committed
df134f1
fix(ci): resolve CI failures from upstream sync
github-actions[bot]
committed
4cac9e5
fix(ci): resolve CI failures from upstream sync

github-actions[bot]
and
claude
committed
f12b2cd
fix(ci): resolve CI failures from upstream sync

github-actions[bot]
and
claude
committed
f1a9ef2
fix(ci): resolve CI failures from upstream sync

github-actions[bot]
and
claude
committed
d3b933e
fix(ci): resolve CI failures from upstream sync

github-actions[bot]
and
claude
committed
1252293
fix(ci): resolve CI failures from upstream sync
github-actions[bot]
committed
0bf5a26