fix(model_prices): correct DeepSeek V4 max output tokens - #36925
Conversation
…max output tokens Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
🤖 Devin AI EngineerI'll be helping with this pull request! Here's what you should know: ✅ I will automatically:
Note: I can only respond to comments from users who have write access to this repository. ⚙️ Control Options:
|
|
|
Greptile SummaryThe PR corrects lifecycle metadata for Gemini API models and raises the registered DeepSeek V4 output limit to the provider-published 384K value.
Confidence Score: 5/5The PR appears safe to merge, with both model registries consistently updated to the corrected provider metadata. The changed dates conform to the registry schema, the DeepSeek limits are consistent across all affected aliases and existing sibling metadata, and the canonical and runtime-bundled files remain synchronized.
|
| Filename | Overview |
|---|---|
| model_prices_and_context_window.json | Updates the canonical registry’s Gemini lifecycle dates and DeepSeek V4 token limits consistently, with no actionable defect identified. |
| litellm/model_prices_and_context_window_backup.json | Mirrors the canonical registry changes in the runtime-bundled copy, preserving the repository’s synchronization contract. |
Reviews (1): Last reviewed commit: "fix(model_prices): correct Gemini 2.5 sh..." | Re-trigger Greptile
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
|
bugbot run |
There was a problem hiding this comment.
Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.
❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.
Reviewed by Cursor Bugbot for commit b066ed3. Configure here.
| }, | ||
| "gemini/gemini-embedding-001": { | ||
| "deprecation_date": "2028-05-14", | ||
| "deprecation_date": "2026-07-14", |
There was a problem hiding this comment.
Wrong embedding shutdown date
Medium Severity
gemini/gemini-embedding-001 now carries deprecation_date 2026-07-14, which is already past and conflicts with Google’s current docs: the model remains available, the Gemini API deprecations page does not list it, and Cloud lifecycle guidance keeps it until at least May 2028. This replaces the nearer-correct prior value and will mislead migration tooling once deprecation metadata is surfaced.
Additional Locations (1)
Reviewed by Cursor Bugbot for commit b066ed3. Configure here.
Google's Gemini deprecations page lists no shutdown date for the 2.5 GA models and May 14, 2028 for gemini-embedding-001; keep only the DeepSeek V4 max output correction. Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>


TLDR
DeepSeek V4
max_output_tokenswas 8192 in the registry, but DeepSeek documents a 384K maximum output. This raisesdeepseek-v4-flashanddeepseek-v4-pro(and theirdeepseek/-prefixed aliases) to 393216 in both the canonical registry and the bundled copy.User Flow
Before: a client that sizes
max_tokensfromGET /model/infofordeepseek/deepseek-v4-proreads back"max_output_tokens": 8192and truncates long generations at 8K, where DeepSeek would have allowed 384K.After: the same request reports
"max_output_tokens": 393216.Sources
deepseek-v4-flashanddeepseek-v4-prolistCONTEXT LENGTH: 1MandMAX OUTPUT: MAXIMUM: 384K. 384K is written as 393216, matching how the registry already stores DeepSeek limits in 1024 units (deepseek/deepseek-v3.2is 163840).Not changed, deliberately:
deprecation_dateto the Gemini 2.5 GA models and changedgemini/gemini-embedding-001. That was wrong and has been reverted — https://ai.google.dev/gemini-api/docs/deprecations currently lists "No shutdown date announced" forgemini-2.5-pro,gemini-2.5-flashandgemini-2.5-flash-lite, and May 14, 2028 forgemini-embedding-001, which is what the registry already had.The wider audit turned up nothing else verifiably stale: Anthropic, OpenAI, Bedrock, Mistral, Cohere, xAI and Azure lifecycle tables already match the registry entry for entry, and DeepSeek V4 pricing already matches the current per-token rates.
Relevant issues
Supports #26900
Pre-Submission checklist
Existing coverage in
tests/test_litellm/test_model_prices_schema.pyvalidates these fields against the schema (18 passed), so no new test was added for a data-only change.Screenshots / Proof of Fix
Live proxy on http://localhost:4000 started with
LITELLM_LOCAL_MODEL_COST_MAP=True python litellm/proxy/proxy_cli.py --config litellm/proxy/dev_config.yaml --port 4000, with a deployment registered via/model/new.Before, at base commit
423b791ee0:After:
Type
🐛 Bug Fix
Caveats
Data-only change; no gateway code reads or exposes lifecycle metadata yet (that is #26900).
Link to Devin session: https://app.devin.ai/sessions/65e89f80ad4346f0aec983f06c6aa0d9