fix(pricing): apply Azure GPT-5.6 Luna and Terra price cuts - #35841
fix(pricing): apply Azure GPT-5.6 Luna and Terra price cuts#35841shivamrawat1 wants to merge 2 commits into
Conversation
Azure matched OpenAI's 7/30 price decreases for GPT-5.6 Luna (-80%) and Terra (-20%), confirmed by the Microsoft Foundry GA blog. Scale all cost fields for azure global and us/eu data zone entries accordingly and add the now-published cache write prices to the global entries.
Greptile SummaryThis PR updates Azure GPT-5.6 Luna and Terra pricing in the canonical and backup cost maps.
Confidence Score: 4/5The regional cache-write pricing gap should be fixed before merging because cached writes on Azure US/EU Luna and Terra deployments are recorded at zero cost. The revised base, tier, priority, and cache-read values are consistent and synchronized, but all four changed data-zone records omit the cache-creation field consumed by Azure cost calculation, causing understated spend and budget usage whenever cache-write tokens are reported. Files Needing Attention: model_prices_and_context_window.json and litellm/model_prices_and_context_window_backup.json
|
| Filename | Overview |
|---|---|
| model_prices_and_context_window.json | Pricing reductions and tier ratios are internally consistent, but the changed US/EU Luna and Terra entries omit cache-write rates and therefore calculate cache creation at zero cost. |
| litellm/model_prices_and_context_window_backup.json | Accurately mirrors the canonical map, including the same missing cache-write rates on the changed regional variants. |
Reviews (1): Last reviewed commit: "fix(pricing): apply Azure GPT-5.6 Luna a..." | Re-trigger Greptile
| "azure/us/gpt-5.6-terra": { | ||
| "cache_read_input_token_cost": 2.75e-07, | ||
| "cache_read_input_token_cost_above_272k_tokens": 5.5e-07, | ||
| "cache_read_input_token_cost_priority": 6.875e-07, | ||
| "input_cost_per_token": 2.75e-06, | ||
| "input_cost_per_token_above_272k_tokens": 5.5e-06, | ||
| "input_cost_per_token_priority": 6.875e-06, | ||
| "cache_read_input_token_cost": 2.2e-07, | ||
| "cache_read_input_token_cost_above_272k_tokens": 4.4e-07, | ||
| "cache_read_input_token_cost_priority": 5.5e-07, | ||
| "input_cost_per_token": 2.2e-06, | ||
| "input_cost_per_token_above_272k_tokens": 4.4e-06, |
There was a problem hiding this comment.
Regional cache writes cost zero
When Azure US/EU GPT-5.6 Luna or Terra responses report cache-creation tokens, these regional entries omit cache_creation_input_token_cost, so Azure cost calculation resolves the rate to 0.0, causing spend tracking and budget enforcement to omit the entire cache-write charge.
Knowledge Base Used: Cost Tracking and Budget Enforcement
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
Foundry blog publishes Sol cached writes at $6.25/M; match OpenAI long-context and priority cache-creation tiers on azure/gpt-5.6 and azure/gpt-5.6-sol. Update Azure gpt-5.6 unit expectations for the Terra/Luna cuts already on this branch
|
Superseded by rolling registry audit #37902, which reverified and absorbed the provider-documented metadata changes at field level |
TLDR
Problem this solves:
azure/entries, so models.litellm.ai and proxy cost tracking overstated Azure spend by up to 5x on LunaHow it solves it:
azure/gpt-5.6-lunaandazure/gpt-5.6-terraby the announced cuts (Luna x0.2, Terra x0.8): Luna is now $0.20/M input, $1.20/M output, $0.02/M cached input; Terra is $2.00/M input, $12.00/M output, $0.20/M cached input, matching both the blog and the existing OpenAI entriescache_creation_input_token_cost: $0.25/M Luna, $2.50/M Terra)azure/us/andazure/eu/data zone entries, preserving the existing 1.1x data zone premium and all tier/priority ratios. Azure has not published data zone or priority prices for these models yet (the blog says to ask your sales rep), so these keep the established ratio convention and can be trued up when the pricing page catches upmodel_prices_and_context_window.jsonand the backup copyRelevant issues
Linear ticket
Pre-Submission checklist
Please complete all items before asking a LiteLLM maintainer to review your PR
tests/test_litellm/test_model_prices_schema.pypasses and value assertions would break on every intentional price update)@greptileaito re-request a review after pushing changes)Delays in PR merge?
If you're seeing a delay in your PR being merged, ping the LiteLLM Team on Slack (#pr-review).
Screenshots / Proof of Fix
No active Azure GPT-5.6 deployment was available for a paid call, so proof is against a live local proxy loading the updated cost map (this is exactly what models.litellm.ai and proxy spend tracking serve)
curl -sS http://localhost:4010/model/info -H "Authorization: Bearer sk-1234"Cost calculation for 100k prompt + 10k completion tokens:
Luna: 100k x $0.20/M + 10k x $1.20/M = $0.032. Terra: 100k x $2.00/M + 10k x $12.00/M = $0.32. Data zone entries at 1.1x
Type
🐛 Bug Fix
Changes
model_prices_and_context_window.jsonandlitellm/model_prices_and_context_window_backup.json: scaled all cost fields (base, above-272k tier, priority, cache read) onazure/gpt-5.6-luna,azure/gpt-5.6-terraand theirazure/us/,azure/eu/variants by x0.2 (Luna) and x0.8 (Terra); addedcache_creation_input_token_costto the two global entries per the Foundry blogQA runbook
LITELLM_LOCAL_MODEL_COST_MAP=True python litellm/proxy/proxy_cli.py --config litellm/proxy/dev_config.yaml --detailed_debug/spend/calculateloop from the proof section above and confirm the four costs matchx-litellm-response-coston a 1k-token request is about 100x cheaper than before for LunaFinal Attestation