Skip to content

fix(pricing): rolling model registry update: Bedrock gpt-6-astra, gpt-image-2.5, Cohere rerank 4, Vertex Grok 4.3/4.6/4.20, Gemini 3.5 audio, OpenAI web search fee, xAI Imagine video, Lyria 3.5, Voyage, ChatGPT GPT-5.5/5.6, Bedrock Mantle, Scaleway dates #31884

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
mateo-berri merged 27 commits into from
Sep 10, 2026
Merged

fix(pricing): rolling model registry update: Bedrock gpt-6-astra, gpt-image-2.5, Cohere rerank 4, Vertex Grok 4.3/4.6/4.20, Gemini 3.5 audio, OpenAI web search fee, xAI Imagine video, Lyria 3.5, Voyage, ChatGPT GPT-5.5/5.6, Bedrock Mantle, Scaleway dates #31884

Show file tree
Hide file tree
Changes from 5 commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
bfc7ae0
feat: add claude-sonnet-5 pricing to model cost map
Jul 1, 2026
901a097
fix: restore supports_reasoning on minimax entries lost during dedup
Jul 1, 2026
3b19138
chore: merge litellm_internal_staging into rolling registry PR
mateo-berri Sep 5, 2026
bbf5114
fix(pricing): correct Vertex Haiku 4.5 output limit, Bedrock Mantle g…
mateo-berri Sep 5, 2026
528f3ae
test(bedrock_mantle): cover gpt-oss-safeguard-20b input and output rates
mateo-berri Sep 5, 2026
38106cc
Merge remote-tracking branch 'origin/litellm_internal_staging' into l…
mateo-berri Sep 5, 2026
b4e7776
fix(model_prices): add gemini lyria-3.5, voyage-multilingual-2, chatg…
mateo-berri Sep 5, 2026
0a0764a
Merge remote-tracking branch 'origin/litellm_internal_staging' into l…
mateo-berri Sep 7, 2026
15c9fca
fix(pricing): add xai grok-imagine-video entries, computer-use-previe…
mateo-berri Sep 7, 2026
68d7a2d
fix(pricing): drop supported_endpoints from xai grok-imagine-video en…
mateo-berri Sep 7, 2026
e842369
chore: merge litellm_internal_staging into rolling registry PR
mateo-berri Sep 8, 2026
cb8daee
chore(registry): absorb #40185 daybreak-blue and #40159 cloudflare rp…
mateo-berri Sep 8, 2026
fd1fad5
test: annotate registry metadata test parameters
mateo-berri Sep 8, 2026
bd2a355
Merge remote-tracking branch 'origin/litellm_internal_staging' into l…
mateo-berri Sep 8, 2026
d497434
fix(model_prices): update provider and web search pricing
mateo-berri Sep 8, 2026
8eb6f6d
test(cost_calc): type web search test params and drop docstrings
mateo-berri Sep 8, 2026
f058d6a
merge litellm_internal_staging
mateo-berri Sep 9, 2026
9f21ae3
fix(registry): correct eu Claude 3.5 Haiku Bedrock pricing, add Nova …
mateo-berri Sep 9, 2026
b067729
fix(registry): add xAI Imagine Video 720p per second rates
mateo-berri Sep 9, 2026
2881b8c
fix(cost): carry output_cost_per_second_720p through model info
mateo-berri Sep 9, 2026
6dbaf43
fix(registry): drop OpenAI shutdown date from shared computer-use-pre…
mateo-berri Sep 9, 2026
23ed208
Merge litellm_internal_staging into rolling registry PR
mateo-berri Sep 9, 2026
00e4380
fix(registry): add Bedrock gpt-6-astra CRIS + mantle profiles, embed-…
mateo-berri Sep 9, 2026
420282a
fix(registry): set max_output_tokens on vertex_ai/xai/grok-4.3 and gr…
mateo-berri Sep 9, 2026
5bdf457
fix(bedrock): honor the json_mode kwarg on invoke Nova structured out…
mateo-berri Sep 9, 2026
b89c324
test(cost): assert gpt-4o-mini keeps chat web search off while the fl…
mateo-berri Sep 9, 2026
fbc6fb5
fix(bedrock): route gpt-6-astra reasoning_effort to reasoning.effort …
mateo-berri Sep 9, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
32 changes: 19 additions & 13 deletions litellm/model_prices_and_context_window_backup.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45421,8 +45421,8 @@
"input_cost_per_token": 1e-06,
"litellm_provider": "vertex_ai-anthropic_models",
"max_input_tokens": 200000,
"max_output_tokens": 8192,
"max_tokens": 8192,
"max_output_tokens": 64000,
"max_tokens": 64000,
"mode": "chat",
"output_cost_per_token": 5e-06,
"regional_endpoint_uplift_multiplier": 1.1,
Expand All @@ -45446,8 +45446,8 @@
"input_cost_per_token": 1e-06,
"litellm_provider": "vertex_ai-anthropic_models",
"max_input_tokens": 200000,
"max_output_tokens": 8192,
"max_tokens": 8192,
"max_output_tokens": 64000,
"max_tokens": 64000,
"mode": "chat",
"output_cost_per_token": 5e-06,
"regional_endpoint_uplift_multiplier": 1.1,
Expand Down Expand Up @@ -51727,7 +51727,8 @@
"max_tokens": 32768,
"mode": "chat",
"output_cost_per_token": 8e-07,
"supports_function_calling": true
"supports_function_calling": true,
"deprecation_date": "2026-10-01"
},
"scaleway/openai/gpt-oss-120b": {
"input_cost_per_token": 1.5e-07,
Expand Down Expand Up @@ -51766,7 +51767,8 @@
"mode": "chat",
"output_cost_per_token": 5e-07,
"supports_function_calling": true,
"supports_vision": true
"supports_vision": true,
"deprecation_date": "2026-08-01"
},
"scaleway/hcompany/holo2-30b-a3b": {
"input_cost_per_token": 3e-07,
Expand All @@ -51777,7 +51779,8 @@
"mode": "chat",
"output_cost_per_token": 7e-07,
"supports_reasoning": true,
"supports_vision": true
"supports_vision": true,
"deprecation_date": "2026-08-09"
},
"scaleway/mistralai/mistral-medium-3.5-128b": {
"input_cost_per_token": 1.5e-06,
Expand All @@ -51800,7 +51803,8 @@
"max_tokens": 16384,
"mode": "chat",
"output_cost_per_token": 2e-06,
"supports_function_calling": true
"supports_function_calling": true,
"deprecation_date": "2026-08-01"
},
"scaleway/mistralai/voxtral-small-24b-2507": {
"input_cost_per_audio_token": 1.5e-07,
Expand All @@ -51811,7 +51815,8 @@
"max_tokens": 16384,
"mode": "chat",
"output_cost_per_token": 3.5e-07,
"supports_audio_input": true
"supports_audio_input": true,
"deprecation_date": "2026-08-01"
},
"scaleway/mistralai/mistral-small-3.2-24b-instruct-2506": {
"input_cost_per_token": 1.5e-07,
Expand All @@ -51833,7 +51838,8 @@
"mode": "chat",
"output_cost_per_token": 2e-07,
"supports_vision": true,
"supports_function_calling": true
"supports_function_calling": true,
"deprecation_date": "2026-10-01"
},
"scaleway/BAAI/bge-multilingual-gemma2": {
"input_cost_per_token": 1e-07,
Expand Down Expand Up @@ -54283,7 +54289,7 @@
"supports_tool_choice": true
},
"bedrock_mantle/openai.gpt-oss-20b": {
"input_cost_per_token": 7.5e-08,
"input_cost_per_token": 7e-08,
"output_cost_per_token": 3e-07,
"litellm_provider": "bedrock_mantle",
"max_input_tokens": 131072,
Expand Down Expand Up @@ -54317,8 +54323,8 @@
"supports_tool_choice": true
},
"bedrock_mantle/openai.gpt-oss-safeguard-20b": {
"input_cost_per_token": 7.5e-08,
"output_cost_per_token": 3e-07,
"input_cost_per_token": 7e-08,
"output_cost_per_token": 2e-07,
"litellm_provider": "bedrock_mantle",
"max_input_tokens": 131072,
"max_output_tokens": 65536,
Expand Down
32 changes: 19 additions & 13 deletions model_prices_and_context_window.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45421,8 +45421,8 @@
"input_cost_per_token": 1e-06,
"litellm_provider": "vertex_ai-anthropic_models",
"max_input_tokens": 200000,
"max_output_tokens": 8192,
"max_tokens": 8192,
"max_output_tokens": 64000,
"max_tokens": 64000,
"mode": "chat",
"output_cost_per_token": 5e-06,
"regional_endpoint_uplift_multiplier": 1.1,
Expand All @@ -45446,8 +45446,8 @@
"input_cost_per_token": 1e-06,
"litellm_provider": "vertex_ai-anthropic_models",
"max_input_tokens": 200000,
"max_output_tokens": 8192,
"max_tokens": 8192,
"max_output_tokens": 64000,
"max_tokens": 64000,
"mode": "chat",
"output_cost_per_token": 5e-06,
"regional_endpoint_uplift_multiplier": 1.1,
Expand Down Expand Up @@ -51727,7 +51727,8 @@
"max_tokens": 32768,
"mode": "chat",
"output_cost_per_token": 8e-07,
"supports_function_calling": true
"supports_function_calling": true,
"deprecation_date": "2026-10-01"
},
"scaleway/openai/gpt-oss-120b": {
"input_cost_per_token": 1.5e-07,
Expand Down Expand Up @@ -51766,7 +51767,8 @@
"mode": "chat",
"output_cost_per_token": 5e-07,
"supports_function_calling": true,
"supports_vision": true
"supports_vision": true,
"deprecation_date": "2026-08-01"
},
"scaleway/hcompany/holo2-30b-a3b": {
"input_cost_per_token": 3e-07,
Expand All @@ -51777,7 +51779,8 @@
"mode": "chat",
"output_cost_per_token": 7e-07,
"supports_reasoning": true,
"supports_vision": true
"supports_vision": true,
"deprecation_date": "2026-08-09"
Comment thread
cursor[bot] marked this conversation as resolved.
Resolved
},
"scaleway/mistralai/mistral-medium-3.5-128b": {
"input_cost_per_token": 1.5e-06,
Expand All @@ -51800,7 +51803,8 @@
"max_tokens": 16384,
"mode": "chat",
"output_cost_per_token": 2e-06,
"supports_function_calling": true
"supports_function_calling": true,
"deprecation_date": "2026-08-01"
},
"scaleway/mistralai/voxtral-small-24b-2507": {
"input_cost_per_audio_token": 1.5e-07,
Expand All @@ -51811,7 +51815,8 @@
"max_tokens": 16384,
"mode": "chat",
"output_cost_per_token": 3.5e-07,
"supports_audio_input": true
"supports_audio_input": true,
"deprecation_date": "2026-08-01"
},
"scaleway/mistralai/mistral-small-3.2-24b-instruct-2506": {
"input_cost_per_token": 1.5e-07,
Expand All @@ -51833,7 +51838,8 @@
"mode": "chat",
"output_cost_per_token": 2e-07,
"supports_vision": true,
"supports_function_calling": true
"supports_function_calling": true,
"deprecation_date": "2026-10-01"
},
"scaleway/BAAI/bge-multilingual-gemma2": {
"input_cost_per_token": 1e-07,
Expand Down Expand Up @@ -54283,7 +54289,7 @@
"supports_tool_choice": true
},
"bedrock_mantle/openai.gpt-oss-20b": {
"input_cost_per_token": 7.5e-08,
"input_cost_per_token": 7e-08,
"output_cost_per_token": 3e-07,
"litellm_provider": "bedrock_mantle",
"max_input_tokens": 131072,
Expand Down Expand Up @@ -54317,8 +54323,8 @@
"supports_tool_choice": true
},
"bedrock_mantle/openai.gpt-oss-safeguard-20b": {
"input_cost_per_token": 7.5e-08,
"output_cost_per_token": 3e-07,
"input_cost_per_token": 7e-08,
"output_cost_per_token": 2e-07,
Comment thread
greptile-apps[bot] marked this conversation as resolved.
Resolved
"litellm_provider": "bedrock_mantle",
"max_input_tokens": 131072,
"max_output_tokens": 65536,
Expand Down
12 changes: 10 additions & 2 deletions tests/test_litellm/llms/bedrock_mantle/test_bedrock_mantle_transformation.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -696,10 +696,18 @@ def test_gpt_oss_20b_pricing(self, monkeypatch):
monkeypatch.setenv("LITELLM_LOCAL_MODEL_COST_MAP", "true")
litellm.add_known_models()
info = litellm.get_model_info("bedrock_mantle/openai.gpt-oss-20b")
# Bedrock pricing: $0.075/M input, $0.30/M output
assert info["input_cost_per_token"] == pytest.approx(7.5e-8)
# Bedrock pricing: $0.07/M input, $0.30/M output
assert info["input_cost_per_token"] == pytest.approx(7e-8)
assert info["output_cost_per_token"] == pytest.approx(3e-7)

def test_gpt_oss_safeguard_20b_pricing(self, monkeypatch):
monkeypatch.setenv("LITELLM_LOCAL_MODEL_COST_MAP", "true")
litellm.add_known_models()
info = litellm.get_model_info("bedrock_mantle/openai.gpt-oss-safeguard-20b")
# Bedrock pricing: $0.07/M input, $0.20/M output
assert info["input_cost_per_token"] == pytest.approx(7e-8)
assert info["output_cost_per_token"] == pytest.approx(2e-7)

def test_pricing_significantly_cheaper_than_openai_native(self, monkeypatch):
"""
Verify Bedrock Mantle pricing is cheaper than OpenAI's direct API pricing.
Expand Down
Loading