feat(azure-ai): add latest catalog model metadata - #39422
Conversation
|
PR #39422 labeled |
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
|
#39388 now carries Codestral-2501, MAI-Thinking-1 and mistral-ocr-4-0 from here. The other five entries have no Azure Retail Prices meter yet, so they stay unabsorbed |
|
Rolling registry PR #39388 now carries Codestral-2501, MAI-Thinking-1 and mistral-ocr-4-0 with Azure-published fields; the other five rows still need an Azure meter |
|
Closing: the verifiable rows landed in #39388; the remaining entries have no Azure meter or pricing row to check against. Reopen with an official source. |
TLDR
Problem this solves:
How it solves it:
User Flow
Before: a developer cannot inspect complete built-in metadata for a newly configured Azure AI catalog deployment
azure_ai/FW-GLM-5.3for an Azure AI deploymentGET https://litellm-domain/v1/model/infoAfter: the same developer can inspect the model's published metadata before sending traffic
azure_ai/FW-GLM-5.3for an Azure AI deploymentGET https://litellm-domain/v1/model/infoRelevant issues
Linear ticket
Sources
Validation notes
Kimi-K3deployments provisioned successfully in two regionsFW-Kimi-K3Kimi-K3entry remains published catalog metadata, not live-route validationPre-Submission checklist
Please complete all items before asking a LiteLLM maintainer to review your PR
uv run pytest tests/test_litellm/<your_test_file>.py -v. Leave the suites (make test-unit-*,make test-unit) to CI: it finishes in ~15 minutes where a laptop takes an hour or more@greptileaito re-request a review after pushing changes)Delays in PR merge?
If you're seeing a delay in your PR being merged, ping the LiteLLM Team on Slack (#pr-review)
Screenshots / Proof of Fix
This PR adds catalog metadata only; live inference varies by model and Azure deployment
Type
New Feature
Test
Caveats (if any)
Medium
Kimi-K3metadata does not imply working Azure inferenceFW-Kimi-K3remained activeLow
Final Attestation