Skip to content

Bedrock Model Updates 2026-03-26 - #24645

Merged
krrish-berri-2 merged 2 commits into
BerriAI:mainfrom
cu-aaii:2026-03-26_bedrock-models
Apr 3, 2026
Merged

Bedrock Model Updates 2026-03-26#24645
krrish-berri-2 merged 2 commits into
BerriAI:mainfrom
cu-aaii:2026-03-26_bedrock-models

Conversation

@marty-sullivan

Copy link
Copy Markdown
Contributor

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

  • My PR passes all unit tests on make test-unit
  • My PR's scope is as isolated as possible, it only solves 1 specific problem
  • I have requested a Greptile review by commenting @greptileai and received a Confidence Score of at least 4/5 before requesting a maintainer review

CI (LiteLLM team)

CI status guideline:

  • 50-55 passing tests: main is stable with minor issues.
  • 45-49 passing tests: acceptable but needs attention
  • <= 40 passing tests: unstable; be careful with your merges and assess the risk.
  • Branch creation CI run
    Link:

  • CI run for the last commit
    Link:

  • Merge / cherry-pick CI run
    Links:

Type

🆕 New Feature

Changes

  • Added new bedrock models (GLM 5, minimax m2.5, nemotron 3 super to model cost maps
  • Removed erroneous, duplicate entry for vertex_ai/gemini-embeddings-2-preview from model cost maps

@vercel

vercel Bot commented Mar 26, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
litellm Ready Ready Preview, Comment Mar 26, 2026 8:11pm

Request Review

@marty-sullivan

Copy link
Copy Markdown
Contributor Author

@greptileai please review

@codspeed-hq

codspeed-hq Bot commented Mar 26, 2026

Copy link
Copy Markdown
Contributor

Merging this PR will not alter performance

✅ 16 untouched benchmarks


Comparing cu-aaii:2026-03-26_bedrock-models (857c287) with main (25feae9)

Open in CodSpeed

@greptile-apps

greptile-apps Bot commented Mar 26, 2026

Copy link
Copy Markdown
Contributor

Greptile Summary

This PR updates the Bedrock model pricing/metadata maps with three new model additions and one removal. The changes are purely data — no logic code is touched.\n\nWhat changed:\n- Added minimax.minimax-m2.5 with 13 region-specific bedrock/… entries (covering all major AWS regions) and a bedrock_converse base entry using US East pricing as the default — consistent with minimax.minimax-m2 and minimax.minimax-m2.1 predecessors.\n- Added nvidia.nemotron-super-3-120b with a single bedrock_converse base entry, following the same base-only pattern used for all existing nvidia.nemotron-* models.\n- Added zai.glm-5 with a single bedrock_converse base entry, consistent with existing zai.glm-4.7 and zai.glm-4.7-flash.\n- Removed a duplicate vertex_ai/gemini-embedding-2-preview entry that incorrectly sourced its pricing from the Gemini API docs (ai.google.dev) rather than the Vertex AI pricing page, and was missing the audio/image/video cost fields present in the correct surviving entry.\n- Both model_prices_and_context_window.json (root) and litellm/model_prices_and_context_window_backup.json are kept in sync (byte-for-byte identical at HEAD).\n\nThe previously raised concern about a missing base entry for minimax.minimax-m2.5 has been addressed in this revision.

Confidence Score: 5/5

Safe to merge — data-only change, both JSON files are in sync, all new entries follow established conventions.

All three new model entries follow the exact same structural patterns as their predecessor models. The removed duplicate vertex_ai entry was genuinely erroneous. The previously flagged missing base entry has been added.

No files require special attention.

Important Files Changed

Filename Overview
model_prices_and_context_window.json Adds region-specific and base entries for minimax.minimax-m2.5, plus base-only entries for nvidia.nemotron-super-3-120b and zai.glm-5; removes a duplicate vertex_ai/gemini-embedding-2-preview entry with incorrect Gemini API pricing.
litellm/model_prices_and_context_window_backup.json Mirror of model_prices_and_context_window.json — both files are byte-for-byte identical at HEAD.

Reviews (2): Last reviewed commit: "adding non-regional entry for minimax-2...." | Re-trigger Greptile

Comment thread model_prices_and_context_window.json
@marty-sullivan

Copy link
Copy Markdown
Contributor Author

@greptileai I confirmed that the vertexai pricing is correct in the remaining entry for gemini-embeddings-2-preview. The duplicate entry had erroneous pricing.

@greptile-apps

greptile-apps Bot commented Mar 26, 2026

Copy link
Copy Markdown
Contributor

Thanks for verifying! The changes look good - new bedrock models added correctly and the duplicate gemini-embeddings-2-preview entry cleaned up. ✅

@emerzon

emerzon commented Mar 27, 2026

Copy link
Copy Markdown
Contributor

Partially duplicate with #24652, but missing some regional endpoints and flex/priority price entries

@krrish-berri-2
krrish-berri-2 self-requested a review April 3, 2026 04:25
@krrish-berri-2
krrish-berri-2 merged commit 52a596d into BerriAI:main Apr 3, 2026
38 of 39 checks passed
fzowl pushed a commit to fzowl/litellm that referenced this pull request Jun 24, 2026
* add new bedrock models & remove duplicate vertexai entry

* adding non-regional entry for minimax-2.5
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants