feat(models): add Azure Foundry model pricing - #38976
Conversation
Greptile SummaryAdds exact Azure Foundry pricing records for DeepSeek V4 Flash and Kimi K2.7 Code.
Confidence Score: 5/5The PR appears safe to merge with no actionable defects identified. The new pricing entries conform to the registry schema, cached-token fields use existing metadata conventions, model lookup is case-insensitive, and the primary and backup registries remain synchronized.
|
| Filename | Overview |
|---|---|
| model_prices_and_context_window.json | Adds and refreshes Azure Foundry model pricing and caching metadata without an identified correctness issue. |
| litellm/model_prices_and_context_window_backup.json | Mirrors the primary pricing registry changes byte-for-byte, preserving the repository synchronization invariant. |
Reviews (1): Last reviewed commit: "feat(models): add Azure Foundry model pr..." | Re-trigger Greptile
504ba63 to
6f239b5
Compare
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
6f239b5 to
701ddd9
Compare
| "azure_ai/DeepSeek-V4-Flash-0731": { | ||
| "cache_read_input_token_cost": 2.8e-08, | ||
| "deprecation_date": "2028-02-20", | ||
| "input_cost_per_token": 1.9e-07, |
There was a problem hiding this comment.
Medium: Budget bypass from incorrect model pricing
Azure prices the dated V4 Flash 0731 SKU separately from generic V4 Flash: its global input and output rates are $0.44 and $1.32 per million tokens, rather than the $0.19 and $0.51 recorded here. An authenticated caller can select DeepSeek-V4-Flash-0731 and have both budget reservation and final spend charged at less than half the upstream cost. Update this entry and its mirrored backup entry with the dated SKU's input, output, and cached-input rates.
PR overviewThis pull request adds Azure Foundry model pricing metadata, including token rates for dated DeepSeek model SKUs, to the model pricing catalog and its backup. One pricing issue remains open: the dated DeepSeek V4 Flash SKU is recorded at substantially lower rates than Azure charges. An authenticated caller can select it to bypass accurate budget enforcement and have usage charged at less than half the upstream cost, creating direct but model-specific financial exposure. Open issues (1)
Fixed/addressed: 0 · PR risk: 6/10 |
TLDR
Basically I scrape https://azure.microsoft.com/en-us/pricing/details/ai-foundry-models/kimi and sync our json.
Problem this solves:
How it solves it:
User Flow
Before: a developer cannot verify exact pricing for supported Azure model IDs
azure_ai/DeepSeek-V4-Flash-0731azure_ai/kimi-k2.7-codewith the same resultAfter: the same supported Azure model IDs have pricing metadata
azure_ai/DeepSeek-V4-Flash-0731azure_ai/kimi-k2.7-codealso shows verified Azure pricingRelevant issues
Pylon #8009
Linear ticket
Resolves LIT-6555
Pre-Submission checklist
Screenshots / Proof of Fix
Before (d6cce13)
git show d6cce13308:model_prices_and_context_window.json | jq '{deepseek: has("azure_ai/DeepSeek-V4-Flash-0731"), kimi: has("azure_ai/kimi-k2.7-code"), deepseek_cache: .["azure_ai/deepseek-v4-flash"].cache_read_input_token_cost, kimi_cache: .["azure_ai/kimi-k2.6"].cache_read_input_token_cost}'{"deepseek":false,"kimi":false,"deepseek_cache":null,"kimi_cache":null}After (701ddd9)
jq '{deepseek: has("azure_ai/DeepSeek-V4-Flash-0731"), kimi: has("azure_ai/kimi-k2.7-code"), deepseek_cache: .["azure_ai/deepseek-v4-flash"].cache_read_input_token_cost, kimi_cache: .["azure_ai/kimi-k2.6"].cache_read_input_token_cost}' model_prices_and_context_window.json{"deepseek":true,"kimi":true,"deepseek_cache":2.8e-08,"kimi_cache":1.6e-07}Type
New Feature
Caveats (if any)
Low
Final Attestation