Repository navigation
chore(prices): sync prices for 2 providers: 51 models - #40873
Closed
berriai-litellm-provider-info-sync[bot] wants to merge 4 commits into
Closed
berriai-litellm-provider-info-sync[bot] wants to merge 4 commits into
berriai-litellm-provider-info-sync[bot] wants to merge 4 commits into
Conversation
fireworks_ai/accounts/fireworks/models/deepseek-v4-flash-0731: input_cost_per_token_priority, output_cost_per_token_priority, cache_read_input_token_cost_priority fireworks_ai/accounts/fireworks/models/deepseek-v4-flash-vision-exp: fireworks_ai/accounts/fireworks/models/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, input_cost_per_token_priority, output_cost_per_token_priority, cache_read_input_token_cost_priority fireworks_ai/accounts/fireworks/models/deepseek-v4-pro-0813: input_cost_per_token_priority, output_cost_per_token_priority, cache_read_input_token_cost_priority fireworks_ai/accounts/fireworks/models/deepseek-v4p1-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, input_cost_per_token_priority, output_cost_per_token_priority, cache_read_input_token_cost_priority fireworks_ai/accounts/fireworks/models/glm-5p2: input_cost_per_token_priority, output_cost_per_token_priority, cache_read_input_token_cost_priority fireworks_ai/accounts/fireworks/models/glm-5p3: input_cost_per_token_priority, output_cost_per_token_priority, cache_read_input_token_cost_priority fireworks_ai/accounts/fireworks/models/glm-5p3-flash: input_cost_per_token_priority, output_cost_per_token_priority, cache_read_input_token_cost_priority fireworks_ai/accounts/fireworks/models/gpt-oss-120b: input_cost_per_token_priority, output_cost_per_token_priority, cache_read_input_token_cost_priority fireworks_ai/accounts/fireworks/models/kimi-k2p6: input_cost_per_token_priority, output_cost_per_token_priority, cache_read_input_token_cost_priority fireworks_ai/accounts/fireworks/models/kimi-k2p7-code: input_cost_per_token_priority, output_cost_per_token_priority, cache_read_input_token_cost_priority fireworks_ai/accounts/fireworks/models/kimi-k3: input_cost_per_token_priority, output_cost_per_token_priority, cache_read_input_token_cost_priority fireworks_ai/accounts/fireworks/models/minimax-m2p7: input_cost_per_token_priority, output_cost_per_token_priority, cache_read_input_token_cost_priority fireworks_ai/accounts/fireworks/models/minimax-m3: input_cost_per_token_priority, output_cost_per_token_priority, cache_read_input_token_cost_priority fireworks_ai/accounts/fireworks/models/muse-glimmer-30b: fireworks_ai/accounts/fireworks/models/nemotron-3-ultra-nvfp4: fireworks_ai/accounts/fireworks/models/qwen3-embedding-8b: fireworks_ai/accounts/fireworks/models/qwen3-reranker-8b: input_cost_per_token fireworks_ai/accounts/fireworks/models/qwen3p7-plus: fireworks_ai/accounts/fireworks/models/qwen3p8-max: input_cost_per_token_priority, output_cost_per_token_priority, cache_read_input_token_cost_priority fireworks_ai/accounts/fireworks/routers/glm-5p2-fast: fireworks_ai/accounts/fireworks/routers/glm-5p3-fast: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost fireworks_ai/accounts/fireworks/routers/kimi-k3-fast: together_ai/arcee-ai/trinity-mini: input_cost_per_token, output_cost_per_token together_ai/arize-ai/qwen-2-1.5b-instruct: babbage-002: input_cost_per_token_batches, output_cost_per_token_batches chat-latest: chatgpt-image-latest: output_cost_per_token, input_cost_per_image_token, output_cost_per_image_token, input_cost_per_token_batches, output_cost_per_token_batches, input_cost_per_image_token_batches, cache_read_input_token_cost_batches, output_cost_per_image_token_batches claude-fable-5: claude-fable-5-1: claude-haiku-4-5: claude-mythos-5: claude-mythos-5-1: claude-opus-4-5: claude-opus-4-6: claude-opus-4-7: claude-opus-4-8: claude-opus-5: claude-sonnet-4-5: claude-sonnet-4-6: claude-sonnet-5: davinci-002: input_cost_per_token_batches, output_cost_per_token_batches deep-research-pro-preview-12-2025: cache_read_input_token_cost, cache_read_input_token_cost_batches together_ai/deepseek-ai/deepseek-coder-33b-instruct: input_cost_per_token, output_cost_per_token together_ai/deepseek-ai/DeepSeek-R1-0528: input_cost_per_token, output_cost_per_token together_ai/deepseek-ai/DeepSeek-R1-Distill-Llama-70B: input_cost_per_token, output_cost_per_token together_ai/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B: input_cost_per_token, output_cost_per_token together_ai/deepseek-ai/DeepSeek-R1-Distill-Qwen-14B: input_cost_per_token, output_cost_per_token together_ai/deepseek-ai/DeepSeek-V3.1: together_ai/deepseek-ai/DeepSeek-V4-Flash-0731: together_ai/deepseek-ai/DeepSeek-V4-Pro-0813: ft:babbage-002: input_cost_per_token_batches, output_cost_per_token_batches ft:davinci-002: input_cost_per_token_batches, output_cost_per_token_batches ft:gpt-3.5-turbo: ft:gpt-4.1-2025-04-14: cache_read_input_token_cost_batches ft:gpt-4.1-mini-2025-04-14: cache_read_input_token_cost_batches ft:gpt-4.1-nano-2025-04-14: cache_read_input_token_cost_batches ft:gpt-4o-2024-08-06: input_cost_per_token_batches, output_cost_per_token_batches, cache_read_input_token_cost_batches ft:gpt-4o-mini-2024-07-18: cache_read_input_token_cost_batches ft:o4-mini-2025-04-16: cache_read_input_token_cost_batches
berriai-litellm-provider-info-sync
Bot
requested a review
from mateo-berri
as a code owner
September 12, 2026 18:16
|
|
Contributor
Contributor
Greptile SummaryThis PR synchronizes pricing and source metadata for 225 models across Anthropic, Fireworks AI, OpenAI, Together AI, and Vertex AI. It adds 48 catalog entries and expands the schema for new batch, flex, priority, modality, and long-context price fields. The catalog copies remain synchronized, but the strict legacy validator rejects the new fields, and modality-specific batch prices are not consumed by batch spend calculation Confidence Score: 3/5This PR is not safe to merge until catalog validation accepts the new fields and batch modality prices affect spend calculation The strict repository schema check rejects newly introduced catalog properties, and image batch traffic continues using generic token prices instead of the newly published image-token rates Files Needing Attention: model_prices_and_context_window.json, litellm/model_prices_and_context_window_backup.json, model_prices_and_context_window.schema.json
|
| Filename | Overview |
|---|---|
| model_prices_and_context_window.json | Updates provider prices and sources and adds 48 models, but newly declared modality batch rates are not applied by batch cost calculation |
| litellm/model_prices_and_context_window_backup.json | Mirrors the root catalog exactly, including the unsupported modality-specific batch pricing fields |
| model_prices_and_context_window.schema.json | Adds 23 pricing properties without updating the repository's separate closed INTENDED_SCHEMA validator, causing catalog validation to fail |
Reviews (1): Last reviewed commit: "chore(prices): sync prices for 5 provide..." | Re-trigger Greptile
![greptile-apps[bot]](https://avatars.githubusercontent.com/in/867647?s=60&v=4){kind=small}
Comment on lines
+122
to
+125
| "cache_creation_input_token_cost_batches": { | ||
| "type": "number", | ||
| "minimum": 0 | ||
| }, |
Contributor
There was a problem hiding this comment.
These new fields are missing from test_utils.py's closed INTENDED_SCHEMA, so catalog validation rejects them and fails CI.
Comment on lines
+54888
to
+54899
| "cache_read_input_token_cost_batches": 6.3e-07, | ||
| "deprecation_date": "2026-12-01", | ||
| "input_cost_per_image_token": 1e-05, | ||
| "input_cost_per_image_token": 8e-06, | ||
| "input_cost_per_image_token_batches": 4e-06, | ||
| "input_cost_per_token": 5e-06, | ||
| "input_cost_per_token_batches": 2.5e-06, | ||
| "litellm_provider": "openai", | ||
| "mode": "image_generation", | ||
| "output_cost_per_image_token": 4e-05, | ||
| "output_cost_per_image_token": 3.2e-05, | ||
| "output_cost_per_image_token_batches": 1.6e-05, | ||
| "output_cost_per_token": 1e-05, | ||
| "output_cost_per_token_batches": 5e-06, |
Contributor
There was a problem hiding this comment.
For batch image requests, the calculator uses generic token rates and never reads these image-token rates, so reported spend is too low.
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
…cing Remove sync-emitted cost keys that no LiteLLM cost path reads (cache and audio/image/character/video *_batches variants, audio cache tier variants, image token tier variants) and keep only the flex variants the cost calculator resolves via _get_service_tier_cost_key. Propagate cost fields from OpenAI base aliases to dated variants and from fireworks long-form keys to their short-form aliases. Restore o4-mini flex cached input to 1.375e-07. Update the fireworks deepseek-v4-pro expectation to the values returned by api.fireworks.ai/v1/serverless/models. Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
chatgpt-image-latest: input_cost_per_image_token_batches, cache_read_input_token_cost_batches, output_cost_per_image_token_batches deep-research-pro-preview-12-2025: cache_read_input_token_cost_batches ft:gpt-4.1-2025-04-14: cache_read_input_token_cost_batches ft:gpt-4.1-mini-2025-04-14: cache_read_input_token_cost_batches ft:gpt-4.1-nano-2025-04-14: cache_read_input_token_cost_batches ft:gpt-4o-2024-08-06: cache_read_input_token_cost_batches ft:gpt-4o-mini-2024-07-18: cache_read_input_token_cost_batches ft:o4-mini-2025-04-16: cache_read_input_token_cost_batches gemini-2.0-flash: input_cost_per_character_batches, input_cost_per_audio_token_batches gemini-2.0-flash-lite: input_cost_per_character_batches, input_cost_per_audio_token_batches gemini-2.5-flash: input_cost_per_audio_token_batches, cache_read_input_token_cost_batches, cache_read_input_audio_token_cost_flex, cache_read_input_audio_token_cost_batches, cache_read_input_audio_token_cost_priority gemini-2.5-flash-image: output_cost_per_image_token_flex, output_cost_per_image_token_batches gemini-2.5-flash-lite: input_cost_per_audio_token_batches, cache_read_input_token_cost_batches, cache_read_input_audio_token_cost_flex, cache_read_input_audio_token_cost_batches, cache_read_input_audio_token_cost_priority vertex_ai/gemini-2.5-flash-preview-tts: output_cost_per_audio_token_batches gemini-2.5-pro: cache_read_input_token_cost_batches, input_cost_per_token_above_200k_tokens_batches, output_cost_per_token_above_200k_tokens_batches, cache_read_input_token_cost_above_200k_tokens_batches gemini-2.5-pro-preview-tts: output_cost_per_audio_token_batches gemini-3-flash-preview: input_cost_per_audio_token_batches, cache_read_input_token_cost_batches, cache_read_input_audio_token_cost_flex, cache_read_input_audio_token_cost_batches, cache_read_input_audio_token_cost_priority gemini-3-pro-image: output_cost_per_image_token_flex, cache_read_input_token_cost_batches, output_cost_per_image_token_batches, output_cost_per_image_token_priority, input_cost_per_token_above_200k_tokens_batches, output_cost_per_token_above_200k_tokens_batches gemini-3.1-flash-image: output_cost_per_image_token_flex, cache_read_input_token_cost_batches, output_cost_per_image_token_batches gemini-3.1-flash-lite: input_cost_per_audio_token_batches, cache_read_input_token_cost_batches, cache_read_input_audio_token_cost_flex, cache_read_input_audio_token_cost_batches, cache_read_input_audio_token_cost_priority gemini-3.1-flash-lite-image: output_cost_per_image_token_flex, cache_read_input_token_cost_batches, output_cost_per_image_token_batches vertex_ai/gemini-3.1-flash-tts-preview: output_cost_per_audio_token_batches gemini-3.1-pro-preview: cache_read_input_token_cost_batches, input_cost_per_token_above_200k_tokens_batches, output_cost_per_token_above_200k_tokens_batches, cache_read_input_token_cost_above_200k_tokens_batches gemini-3.5-flash: cache_read_input_token_cost_batches gemini-3.5-flash-lite: cache_read_input_token_cost_batches gemini-3.6-flash: cache_read_input_token_cost_batches gemini-3.7-flash: cache_read_input_token_cost_batches gemini-3.8-flash: cache_read_input_token_cost_batches gemini-embedding-2: input_cost_per_audio_token_batches, input_cost_per_image_token_batches vertex_ai/gemini-robotics-er-2: cache_read_input_token_cost_batches gpt-5: cache_read_input_token_cost_batches gpt-5-mini: cache_read_input_token_cost_batches gpt-5-nano: cache_read_input_token_cost_batches gpt-5.1: cache_read_input_token_cost_batches gpt-5.2: cache_read_input_token_cost_batches gpt-5.4: cache_read_input_token_cost_batches, input_cost_per_token_above_272k_tokens_batches, output_cost_per_token_above_272k_tokens_batches, cache_read_input_token_cost_above_272k_tokens_batches gpt-5.4-mini: cache_read_input_token_cost_batches gpt-5.4-nano: cache_read_input_token_cost_batches gpt-5.4-pro: input_cost_per_token_above_272k_tokens_batches, output_cost_per_token_above_272k_tokens_batches gpt-5.5: cache_read_input_token_cost_batches, input_cost_per_token_above_272k_tokens_batches, output_cost_per_token_above_272k_tokens_batches, cache_read_input_token_cost_above_272k_tokens_batches gpt-5.6-luna: cache_read_input_token_cost_batches, cache_creation_input_token_cost_batches gpt-5.6-sol: cache_read_input_token_cost_batches, cache_creation_input_token_cost_batches gpt-5.6-terra: cache_read_input_token_cost_batches, cache_creation_input_token_cost_batches gpt-6-astra: cache_read_input_token_cost_batches, cache_creation_input_token_cost_batches gpt-image-1: input_cost_per_image_token_batches, cache_read_input_token_cost_batches, output_cost_per_image_token_batches gpt-image-1-mini: input_cost_per_image_token_batches, cache_read_input_token_cost_batches, output_cost_per_image_token_batches gpt-image-1.5: input_cost_per_image_token_batches, cache_read_input_token_cost_batches, output_cost_per_image_token_batches gpt-image-2: input_cost_per_image_token_batches, cache_read_input_token_cost_batches, output_cost_per_image_token_batches o4-mini: cache_read_input_token_cost_flex sora-2: output_cost_per_video_per_second_batches sora-2-pro: output_cost_per_video_per_second_batches
berriai-litellm-provider-info-sync
Bot
changed the title
…lias pricing" This reverts commit d6de187.
berriai-litellm-provider-info-sync
Bot
deleted the
litellm-providers/price-sync-main
branch
September 12, 2026 19:22
6 of 7 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
TLDR
Problem this solves:
How it solves it:
User Flow
This does not apply to an automated price sync; there is no user-facing flow change beyond cost values in the catalog
Relevant issues
Linear ticket
Pre-Submission checklist
Please complete all items before asking a LiteLLM maintainer to review your PR
uv run pytest tests/test_litellm/<your_test_file>.py -v. Leave the suites (make test-unit-*,make test-unit) to CI: it finishes in ~15 minutes where a laptop takes an hour or more@greptileaito re-request a review after pushing changes)Delays in PR merge?
If you're seeing a delay in your PR being merged, ping the LiteLLM Team on Slack (#pr-review).
Screenshots / Proof of Fix
A live proxy run does not apply to an automated price sync; the source pages and per-value audit trail are in the portal's sync history
Type
Chore
Caveats (if any)
Medium
gpt-6-astra,gpt-5.6-sol,gpt-5.6-terra,gpt-5.6-lunaLow
QA runbook
No tests or e2e files are touched, so this does not apply
Final Attestation
Sync report
Updates 51 models across OpenAI, Vertex AI (Gemini), each read from its provider's own published prices.
OpenAI
Updates 28 models from the provider's pricing page (page
63878741d55c).Changes
chatgpt-image-latest: cache_read_input_token_cost_batches $0.63/1M, input_cost_per_image_token_batches $4/1M, output_cost_per_image_token_batches $16/1Mft:gpt-4.1-2025-04-14: cache_read_input_token_cost_batches $0.5/1Mft:gpt-4.1-mini-2025-04-14: cache_read_input_token_cost_batches $0.1/1Mft:gpt-4.1-nano-2025-04-14: cache_read_input_token_cost_batches $0.025/1Mft:gpt-4o-2024-08-06: cache_read_input_token_cost_batches $0.9/1Mft:gpt-4o-mini-2024-07-18: cache_read_input_token_cost_batches $0.075/1Mft:o4-mini-2025-04-16: cache_read_input_token_cost_batches $0.5/1Mgpt-5: cache_read_input_token_cost_batches $0.0625/1Mgpt-5-mini: cache_read_input_token_cost_batches $0.0125/1Mgpt-5-nano: cache_read_input_token_cost_batches $0.0025/1Mgpt-5.1: cache_read_input_token_cost_batches $0.0625/1Mgpt-5.2: cache_read_input_token_cost_batches $0.0875/1Mgpt-5.4: cache_read_input_token_cost_above_272k_tokens_batches $0.25/1M, cache_read_input_token_cost_batches $0.13/1M, input_cost_per_token_above_272k_tokens_batches $2.5/1M, output_cost_per_token_above_272k_tokens_batches $11.25/1Mgpt-5.4-mini: cache_read_input_token_cost_batches $0.0375/1Mgpt-5.4-nano: cache_read_input_token_cost_batches $0.01/1Mgpt-5.4-pro: input_cost_per_token_above_272k_tokens_batches $30/1M, output_cost_per_token_above_272k_tokens_batches $135/1Mgpt-5.5: cache_read_input_token_cost_above_272k_tokens_batches $0.5/1M, cache_read_input_token_cost_batches $0.25/1M, input_cost_per_token_above_272k_tokens_batches $5/1M, output_cost_per_token_above_272k_tokens_batches $22.5/1Mgpt-5.6-luna: cache_creation_input_token_cost_batches $0.125/1M, cache_read_input_token_cost_batches $0.01/1Mgpt-5.6-sol: cache_creation_input_token_cost_batches $2.5/1M, cache_read_input_token_cost_batches $0.2/1Mgpt-5.6-terra: cache_creation_input_token_cost_batches $1.25/1M, cache_read_input_token_cost_batches $0.1/1Mgpt-6-astra: cache_creation_input_token_cost_batches $6.25/1M, cache_read_input_token_cost_batches $0.5/1Mgpt-image-1: cache_read_input_token_cost_batches $0.63/1M, input_cost_per_image_token_batches $5/1M, output_cost_per_image_token_batches $20/1Mgpt-image-1-mini: cache_read_input_token_cost_batches $0.1/1M, input_cost_per_image_token_batches $1.25/1M, output_cost_per_image_token_batches $4/1Mgpt-image-1.5: cache_read_input_token_cost_batches $0.63/1M, input_cost_per_image_token_batches $4/1M, output_cost_per_image_token_batches $16/1Mgpt-image-2: cache_read_input_token_cost_batches $0.625/1M, input_cost_per_image_token_batches $4/1M, output_cost_per_image_token_batches $15/1Mo4-mini: cache_read_input_token_cost_flex $0.1375/1M → $0.138/1Msora-2: output_cost_per_video_per_second_batches $0.05/s of videosora-2-pro: output_cost_per_video_per_second_batches $0.15/s of videoSkipped by the parser (7)
gpt-6-astra: long-context prices present but the row states no thresholdgpt-5.6-sol: long-context prices present but the row states no thresholdgpt-5.6-terra: long-context prices present but the row states no thresholdgpt-5.6-luna: long-context prices present but the row states no thresholdsora-2-pro 1024p: size variant has no litellm key stated on the pagesora-2-pro 1080p: size variant has no litellm key stated on the pageft:o4-mini-2025-04-16: data-sharing discount has no litellm keyTogether AI
No price changes; listed for what its tick could not apply.
Skipped by the parser (98)
Prism-ML/Ternary-Bonsai-27B: no serverless token price (pricing.input and pricing.output are 0 or absent)nim/meta/llama-3.2-11b-vision-instruct: no serverless token price (pricing.input and pricing.output are 0 or absent)nim/meta/llama-3.2-90b-vision-instruct: no serverless token price (pricing.input and pricing.output are 0 or absent)nim/mistralai/mixtral-8x22b-instruct-v01: no serverless token price (pricing.input and pricing.output are 0 or absent)nim/meta/llama-3.3-70b-instruct: no serverless token price (pricing.input and pricing.output are 0 or absent)nim/nvidia/llama-3.1-nemotron-70b-instruct: no serverless token price (pricing.input and pricing.output are 0 or absent)nim/meta/llama-3.1-8b-instruct: no serverless token price (pricing.input and pricing.output are 0 or absent)nim/meta/llama-3.1-70b-instruct: no serverless token price (pricing.input and pricing.output are 0 or absent)nim/nv-mistralai/mistral-nemo-12b-instruct: no serverless token price (pricing.input and pricing.output are 0 or absent)nim/mistralai/mixtral-8x7b-instruct-v01: no serverless token price (pricing.input and pricing.output are 0 or absent)nim/nvidia/llama-3.3-nemotron-super-49b-v1: no serverless token price (pricing.input and pricing.output are 0 or absent)google/gemma-3-27b-it: no serverless token price (pricing.input and pricing.output are 0 or absent)meta-llama/Llama-2-7b-chat-hf: no serverless token price (pricing.input and pricing.output are 0 or absent)deepseek-ai/DeepSeek-R1-Distill-Qwen-7B: no serverless token price (pricing.input and pricing.output are 0 or absent)google/gemma-3-1b-it: no serverless token price (pricing.input and pricing.output are 0 or absent)google/gemma-3-4b-it: no serverless token price (pricing.input and pricing.output are 0 or absent)deepcogito/cogito-v1-preview-llama-8B: no serverless token price (pricing.input and pricing.output are 0 or absent)deepcogito/cogito-v1-preview-qwen-32B: no serverless token price (pricing.input and pricing.output are 0 or absent)deepcogito/cogito-v1-preview-qwen-14B: no serverless token price (pricing.input and pricing.output are 0 or absent)deepcogito/cogito-v1-preview-llama-70B: no serverless token price (pricing.input and pricing.output are 0 or absent)deepcogito/cogito-v1-preview-llama-70B-Turbo: no serverless token price (pricing.input and pricing.output are 0 or absent)meta-llama/Llama-3.3-70B-Instruct: no serverless token price (pricing.input and pricing.output are 0 or absent)Qwen/Qwen2.5-32B: no serverless token price (pricing.input and pricing.output are 0 or absent)Qwen/Qwen2.5-72B: no serverless token price (pricing.input and pricing.output are 0 or absent)Qwen/Qwen2.5-3B-Instruct: no serverless token price (pricing.input and pricing.output are 0 or absent)Qwen/Qwen2.5-1.5B-Instruct: no serverless token price (pricing.input and pricing.output are 0 or absent)Qwen/Qwen2.5-14B: no serverless token price (pricing.input and pricing.output are 0 or absent)Qwen/Qwen2.5-7B: no serverless token price (pricing.input and pricing.output are 0 or absent)Qwen/Qwen2.5-1.5B: no serverless token price (pricing.input and pricing.output are 0 or absent)meta-llama/Meta-Llama-3.1-70B: no serverless token price (pricing.input and pricing.output are 0 or absent)meta-llama/Llama-3.2-1B: no serverless token price (pricing.input and pricing.output are 0 or absent)Qwen/Qwen2.5-7B-Instruct: no serverless token price (pricing.input and pricing.output are 0 or absent)Qwen/Qwen2.5-32B-Instruct: no serverless token price (pricing.input and pricing.output are 0 or absent)meta-llama/Llama-3.1-405B: no serverless token price (pricing.input and pricing.output are 0 or absent)agentica-org/DeepCoder-14B-Preview: no serverless token price (pricing.input and pricing.output are 0 or absent)mistralai/Mistral-7B-v0.1: no serverless token price (pricing.input and pricing.output are 0 or absent)mistralai/Devstral-Small-2505: no serverless token price (pricing.input and pricing.output are 0 or absent)mistralai/Mixtral-8x22B-Instruct-v0.1: no serverless token price (pricing.input and pricing.output are 0 or absent)allenai/Molmo-7B-D-0924: no serverless token price (pricing.input and pricing.output are 0 or absent)Qwen/Qwen3-8B: no serverless token price (pricing.input and pricing.output are 0 or absent)Vertex AI (Gemini)
Updates 23 models from the provider's pricing page (page
428d27362083).Changes
deep-research-pro-preview-12-2025: cache_read_input_token_cost_batches $0.1/1Mgemini-2.0-flash: input_cost_per_audio_token_batches $0.5/1M, input_cost_per_character_batches $0.01875/1M charsgemini-2.0-flash-lite: input_cost_per_audio_token_batches $0.0375/1M, input_cost_per_character_batches $0.009375/1M charsgemini-2.5-flash: cache_read_input_audio_token_cost_batches $0.1/1M, cache_read_input_audio_token_cost_flex $0.1/1M, cache_read_input_audio_token_cost_priority $0.18/1M, cache_read_input_token_cost_batches $0.03/1M, input_cost_per_audio_token_batches $0.5/1Mgemini-2.5-flash-image: output_cost_per_image_token_batches $15/1M, output_cost_per_image_token_flex $15/1Mgemini-2.5-flash-lite: cache_read_input_audio_token_cost_batches $0.03/1M, cache_read_input_audio_token_cost_flex $0.03/1M, cache_read_input_audio_token_cost_priority $0.054/1M, cache_read_input_token_cost_batches $0.01/1M, input_cost_per_audio_token_batches $0.05/1Mvertex_ai/gemini-2.5-flash-preview-tts: output_cost_per_audio_token_batches $5/1Mgemini-2.5-pro: cache_read_input_token_cost_above_200k_tokens_batches $0.25/1M, cache_read_input_token_cost_batches $0.125/1M, input_cost_per_token_above_200k_tokens_batches $1.25/1M, output_cost_per_token_above_200k_tokens_batches $7.5/1Mgemini-2.5-pro-preview-tts: output_cost_per_audio_token_batches $10/1Mgemini-3-flash-preview: cache_read_input_audio_token_cost_batches $0.1/1M, cache_read_input_audio_token_cost_flex $0.1/1M, cache_read_input_audio_token_cost_priority $0.18/1M, cache_read_input_token_cost_batches $0.05/1M, input_cost_per_audio_token_batches $0.5/1Mgemini-3-pro-image: cache_read_input_token_cost_batches $0.1/1M, input_cost_per_token_above_200k_tokens_batches $2/1M, output_cost_per_image_token_batches $60/1M, output_cost_per_image_token_flex $60/1M, output_cost_per_image_token_priority $216/1M, output_cost_per_token_above_200k_tokens_batches $9/1Mgemini-3.1-flash-image: cache_read_input_token_cost_batches $0.025/1M, output_cost_per_image_token_batches $30/1M, output_cost_per_image_token_flex $30/1Mgemini-3.1-flash-lite: cache_read_input_audio_token_cost_batches $0.025/1M, cache_read_input_audio_token_cost_flex $0.025/1M, cache_read_input_audio_token_cost_priority $0.09/1M, cache_read_input_token_cost_batches $0.0125/1M, input_cost_per_audio_token_batches $0.25/1Mgemini-3.1-flash-lite-image: cache_read_input_token_cost_batches $0.0125/1M, output_cost_per_image_token_batches $15/1M, output_cost_per_image_token_flex $15/1Mvertex_ai/gemini-3.1-flash-tts-preview: output_cost_per_audio_token_batches $10/1Mgemini-3.1-pro-preview: cache_read_input_token_cost_above_200k_tokens_batches $0.4/1M, cache_read_input_token_cost_batches $0.2/1M, input_cost_per_token_above_200k_tokens_batches $2/1M, output_cost_per_token_above_200k_tokens_batches $9/1Mgemini-3.5-flash: cache_read_input_token_cost_batches $0.075/1Mgemini-3.5-flash-lite: cache_read_input_token_cost_batches $0.015/1Mgemini-3.6-flash: cache_read_input_token_cost_batches $0.0375/1Mgemini-3.7-flash: cache_read_input_token_cost_batches $0.0375/1Mgemini-3.8-flash: cache_read_input_token_cost_batches $0.0375/1Mgemini-embedding-2: input_cost_per_audio_token_batches $3.25/1M, input_cost_per_image_token_batches $0.225/1Mvertex_ai/gemini-robotics-er-2: cache_read_input_token_cost_batches $0.05/1MSkipped by the parser (3)
gemini-2.5-flash: "Audio Input" above 200K is $0.30, not the base price; litellm has no field for itGemini 2.0 Flash Image Generation: litellm keys only the free experimental model (gemini-2.0-flash-exp-image-generation)Gemini 2.0 Flash Live API: litellm has no vertex_ai/ key for the 2.0 Live APIOpened by the litellm-providers price sync. Every price is read from the provider's own published source and gated before it is applied; the audit trail for each value is in the portal's sync history.