You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
fix(databricks): update Unity Gateway model mappings - #43158
/v1/models advertises a retired Databricks Sonnet 5 name
Unity Catalog Sonnet 5 requests report zero cost
How it solves it:
Register Sonnet 5 under its system.ai model name
Preserve pricing for the legacy endpoint identifier
User Flow
Before: a developer using a wildcard Databricks route receives an obsolete Sonnet 5 model name and cannot use the replacement with correct cost tracking
They configure LiteLLM with model_name: "databricks/*"
They send GET https://litellm-domain/v1/models
The response includes databricks/databricks-claude-sonnet-5
Using that model returns Databricks 403 PERMISSION_DENIED
Using databricks/system.ai.claude-sonnet-5 instead records zero cost
After: the same wildcard route exposes the Unity Catalog model name with correct pricing
They configure LiteLLM with model_name: "databricks/*"
They send GET https://litellm-domain/v1/models
The response includes databricks/system.ai.claude-sonnet-5
Requests using that identifier use the existing Sonnet 5 pricing
Legacy Sonnet 5 references still resolve to the same pricing
The tests check the right things, including the edge cases, and regressions in the respective real-world customer use-cases are not possible after this PR
[Medium risk] Updates Databricks model name mappings and cost lookups.
The PR appears safe to merge based on the reviewed changes.
Summary
The PR replaces retired Databricks registry names with Unity Catalog names and retains legacy pricing and metadata lookups through provider-specific aliases.
The latest commit moves Databricks alias handling into DatabricksModelInfo and adds regression coverage for its registration.
Closing this out — it has gone stale and is no longer something I can maintain. Sorry for the noise, and thanks to the maintainers for the review. Feel free to reopen if it's ever useful.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
TLDR
Problem this solves:
/v1/modelsadvertises a retired Databricks Sonnet 5 nameHow it solves it:
system.aimodel nameUser Flow
Before: a developer using a wildcard Databricks route receives an obsolete Sonnet 5 model name and cannot use the replacement with correct cost tracking
model_name: "databricks/*"GET https://litellm-domain/v1/modelsdatabricks/databricks-claude-sonnet-5403 PERMISSION_DENIEDdatabricks/system.ai.claude-sonnet-5instead records zero costAfter: the same wildcard route exposes the Unity Catalog model name with correct pricing
model_name: "databricks/*"GET https://litellm-domain/v1/modelsdatabricks/system.ai.claude-sonnet-5Relevant issues
Fixes #43146
Pre-Submission checklist
Screenshots / Proof of Fix
A live Databricks E2E run was not available for this change.
The reported provider-side failure is the
403 PERMISSION_DENIEDfrom #43146 when usingdatabricks-claude-sonnet-5.Local regression coverage confirms the LiteLLM-side paths changed by this PR:
databricks/system.ai.claude-sonnet-5databricks/databricks-claude-sonnet-5is no longer advertiseddatabricks/system.ai.claude-sonnet-5resolves to non-zero pricingLocal validation:
Type
🐛 Bug Fix
Caveats (if any)
Medium
Final Attestation