Repository navigation
fix(model_prices): registry audit 2026-10-09, together qwen3.7-max price, azure kimi-k2.7-code retirement - #45595
Conversation
…ice, azure kimi-k2.7-code retirement Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
|
I'll fix CI failures and address comments from users with write access. I'll skip comments containing "(aside)".
|
|
|
|
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
TLDR
Problem this solves:
together_ai/Qwen/Qwen3.7-Maxis priced at $1.50/$4.50 per 1M (cached $0.30), but Together now lists it at $2.50/$7.50 (cached $0.50), so LiteLLM underbills it by 40%azure_ai/kimi-k2.7-codecarriesdeprecation_date: 2027-04-16(the Kimi-K2.6 date), but Azure's retirement schedule lists Kimi-K2.7-Code (2026-06-12, Preview) as retiring 2026-10-03How it solves it:
model_prices_and_context_window.jsonand the backup copy, nothing elseThis is the rolling registry PR for the 2026-10-09 audit run (no open Devin registry-only PR existed to roll into)
Relevant issues
Supports #26900 (registry
deprecation_datedrives deprecation surfacing)User Flow
Before: a team calling
together_ai/Qwen/Qwen3.7-Maxthrough the proxy is billed at the old rate, and the Kimi K2.7 Code retirement is reported six months latetogether_ai/Qwen/Qwen3.7-Maxto config.yaml and restarts the proxyAfter: the same call is billed at Together's listed price
together_ai/Qwen/Qwen3.7-Maxto config.yaml and restarts the proxySources (one per changed value)
together_ai/Qwen/Qwen3.7-Maxinput_cost_per_tokenGET https://api.together.xyz/v1/models(pricing.input: 2.5), read 2026-10-09; https://www.together.ai/pricingtogether_ai/Qwen/Qwen3.7-Maxoutput_cost_per_tokenpricing.output: 7.5)together_ai/Qwen/Qwen3.7-Maxcache_read_input_token_costpricing.cached_input: 0.5)azure_ai/kimi-k2.7-codedeprecation_dateKimi-K2.7-Code / 2026-06-12 / Preview / 2026-10-03)Absorbed from other open PRs
#45533 (together_ai registry sync): the Qwen3.7-Max price change, re-verified against the Together models API above. Its other change, deleting
cache_read_input_token_costfromtogether_ai/together/Tev1-4B-experimental, is dropped: the API reportscached_input: 0for that model, which does not establish that the existing 4.2e-08 row is wrongDropped as unverifiable or out of scope
deepseek-v3): DeepSeek's API exposesdeepseek-chat/deepseek-reasoner, notdeepseek-v3, anddeepseek/deepseek-v3already exists with the same priceskimi-k2.5): duplicate of the existingmoonshot/kimi-k2.5rowChecked with no change needed
Anthropic deprecations page (all dated models match or are already removed), Groq deprecations page, Together deprecations page (serverless removal table; the 2026-07-29 rows are the fine-tuning table and were not applied), Azure Foundry retirement schedule (other mismatches are
azure/sora-2, deliberately set to the later Models API date on main, andazure/gpt-realtime-mini-2025-10-06, which appears in two tables with different dates, so it was left alone).ci_cd/cost_map_pins.jsonis not present on main, and no capability flags change in this PRPre-Submission checklist
Screenshots / Proof of Fix
Local checks on 894ac03:
Live call, real Together key,
LITELLM_LOCAL_MODEL_COST_MAP=True, Before on main 63a4f3f (port 4011), After on this branch (port 4012). Qwen3.7-Max only accepts streaming, so the request streams withinclude_usage:Before, final usage chunk:
"completion_tokens":320,"prompt_tokens":16,...,"cost":0.001464(old rates)After, final usage chunk:
"completion_tokens":86,"prompt_tokens":16,...,"cost":0.000685(16 x 2.5e-06 + 86 x 7.5e-06 = 0.000685)Type
Bug Fix
Caveats
Streaming responses report
x-litellm-response-cost: 0.0in headers on both legs because headers flush before usage is known, so the proof reads the cost from the final usage chunk insteadLink to Devin session: https://app.devin.ai/sessions/81e2e7f1f1934b738b6f459898f1b721
Open in Devin Desktop: https://app.devin.ai/desktop/session/81e2e7f1f1934b738b6f459898f1b721?variant=devin