Repository navigation
feat(azure): add azure_ai/Microsoft-Decision-1 - #45639
Conversation
Price-Sync: litellm-providers
|
|
|
Merging this PR will not alter performance
|
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
|
@kerrylu-berri - The entry is added but the whole implementation is missing. Also the price is incorrect, this model doesnt charge output tokens |
…s Admin UI to rc/1.106.0 (#45639, #45673, #45654, #45717) (#45735) * feat(azure): add azure_ai/Microsoft-Decision-1 (#45639) Backport of #45639 to rc/1.106.0. Cherry-picked from de6a071 (main). * feat(azure_ai): support Microsoft-Decision-1 on the decisions API (#45673) Backport of #45673 to rc/1.106.0. Cherry-picked from 2fcc780 (main). * feat(ui): let admins find, call, and test decision models from the Admin UI (#45654) Backport of #45654 to rc/1.106.0. Cherry-picked from e2276ac (main). * fix(model_prices): drop unverified output price for azure_ai/Microsoft-Decision-1 (#45717) Backport of #45717 to rc/1.106.0. Cherry-picked from 674208b (main). Co-authored-by: kerry <kerry@berri.ai> --------- Co-authored-by: berriai-litellm-provider-info-sync[bot] <328147090+berriai-litellm-provider-info-sync[bot]@users.noreply.github.com> Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: moyai-devin-berriai[bot] <336287033+moyai-devin-berriai[bot]@users.noreply.github.com> Co-authored-by: kerry <kerry@berri.ai>
…#45739) * feat(azure): add azure_ai/Microsoft-Decision-1 (#45639) Backport of #45639 to rc/1.106.0. Cherry-picked from de6a071 (main). * feat(azure_ai): support Microsoft-Decision-1 on the decisions API (#45673) Backport of #45673 to rc/1.106.0. Cherry-picked from 2fcc780 (main). * feat(ui): let admins find, call, and test decision models from the Admin UI (#45654) Backport of #45654 to rc/1.106.0. Cherry-picked from e2276ac (main). * feat(ui): build System One playground requests with a form (#45721) Backport of #45721 to rc/1.106.0. Cherry-picked from 62aee8b (main). * fix(model_prices): drop unverified output price for azure_ai/Microsoft-Decision-1 (#45717) Backport of #45717 to rc/1.106.0. Cherry-picked from 674208b (main). Co-authored-by: kerry <kerry@berri.ai> --------- Co-authored-by: berriai-litellm-provider-info-sync[bot] <328147090+berriai-litellm-provider-info-sync[bot]@users.noreply.github.com> Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: moyai-devin-berriai[bot] <336287033+moyai-devin-berriai[bot]@users.noreply.github.com> Co-authored-by: kerry <kerry@berri.ai>
Price-Sync: litellm-providers Co-authored-by: berriai-litellm-provider-info-sync[bot] <328147090+berriai-litellm-provider-info-sync[bot]@users.noreply.github.com> (cherry picked from commit de6a071)
TLDR
Problem this solves:
Microsoft-Decision-1in the Models API and bills it in the retail price feed, but the cost map has no row for itHow it solves it:
azure_ai/Microsoft-Decision-1as a modeevaluationrow priced from the Azure retail price feedRows
azure_ai/Microsoft-Decision-1(new, kind page, source https://prices.azure.com/api/retail/prices?$filter=productName eq 'Microsoft Decision Models')input_cost_per_token4.2e-08 andoutput_cost_per_token4.2e-08: the feed has one meter for the model in all 37 regions,"productName":"Microsoft Decision Models","skuName":"Microsoft Decision 1","meterName":"Microsoft Decision 1 1M Tokens","retailPrice":0.042,"unitOfMeasure":"1M","armSkuName":"Pi 1 glbl", effective 2026-10-01. It has no input or output split, so the one token rate goes on both fieldsmodeevaluation: the Azure Models API (Microsoft.CognitiveServices/locations/eastus2/models,Microsoft.Microsoft-Decision-1.1) states"capabilities": {"chatCompletion": "false", "decision": "true"}, and the other decision models in the catalog (typesafe/jev-latest, perplexity/pplx-decider-v1-27b, cloudflare/clef) usemodeevaluationlitellm_providerazure_ai: the Models API lists it under publisherMicrosoft, formatMicrosoft, kindMaaS, the same as azure_ai/MAI-Thinking-1max_input_tokens,max_output_tokensorsupports_*flags: no Azure page or the Models API states a context window or capability flags for this model, and it is not on the Microsoft pricing page or models-sold-directly yet. Nothing is inherited, following the decision rows that also carry no limits (typesafe/jev-latest)deprecation_date: the Models API gives"deprecation": {"inference": "2099-12-31T00:00:00Z"}, a placeholder rather than a retirement dateChanged pages
The Microsoft and Black Forest Labs pricing pages and models-sold-directly were re-read. The Microsoft and BFL prices render client side, so they were compared through the retail feed: MAI-Thinking-1 (2.00 / 0.20 cached / 8.00 per 1M) and MAI-Cyber-1-Flash (0.60 / 0.06 / 3.50) match the catalog, and models-sold-directly still states 256,000 context and 64,000 output for MAI-Thinking-1 and 32,000 tokens for the FLUX.2 and MAI-Image rows. azure_ai/flux.2-pro stays unchanged per ruling azure-flux-2-pro-megapixel-leave-unchanged
Delisted by the provider
Absent from the Models API and not dated on the retirement schedule or the retired models page, left for a human: azure/computer-use-preview, azure/container, azure/gpt-3.5-turbo, azure/gpt-3.5-turbo-instruct-0914, azure/gpt-35-turbo, azure/gpt-35-turbo-instruct, azure/gpt-35-turbo-instruct-0914, azure/gpt-4-0125-preview, azure/gpt-4-1106-preview, azure/gpt-4-turbo, azure/gpt-4-turbo-vision-preview, azure/gpt-5.2-pro, azure/gpt-5.5-pro, azure/gpt-5.6, azure/o1-mini, azure/sora-2-pro, azure/sora-2-pro-high-res. azure/mistral-large-2402 and azure/mistral-large-latest stay undated per ruling azure-mistral-large-conflicting-retirement-stay-undated and azure/ada keeps its date per azure-ada-keep-text-embedding-ada-002-date. The other delisted ids already carry a
deprecation_datePre-Submission checklist
Note
Low Risk
Pricing-catalog JSON only; no runtime routing, auth, or billing logic changes.
Overview
Adds
azure_ai/Microsoft-Decision-1to the LiteLLM model cost catalog so usage can be costed when Azure exposes this decision model via MaaS.The new row uses
mode:evaluation,litellm_provider:azure_ai, and the same input/output per-token rate (4.2e-08) from the Azure retail price feed. The change is mirrored inmodel_prices_and_context_window.jsonandlitellm/model_prices_and_context_window_backup.json.Reviewed by Cursor Bugbot for commit 20b6b8d. Bugbot is set up for automated code reviews on this repo. Configure here.