Skip to content

docs(bedrock): gpt-5.6 and newer default to the native chat completions route, chat_completions/ opts the rest in - #1583

Merged
mateo-berri merged 11 commits into
mainfrom
litellm_docs_bedrock_native_openai_chat
Oct 3, 2026
Merged

mateo-berri merged 11 commits into
mainfrom
litellm_docs_bedrock_native_openai_chat

Conversation

@mateo-berri

@mateo-berri mateo-berri commented Sep 20, 2026 •

Copy link
Copy Markdown
Contributor

Companion docs for BerriAI/litellm#44307, which sends Bedrock GPT-5.6 and newer chat completions (the GPT-5.6, GPT-6, and GPT-6.1 families today) to bedrock-runtime's native /openai/v1/chat/completions endpoint by default and adds a bedrock/chat_completions/ prefix that opts any other model AWS serves there (GPT-OSS and Grok 4.6) into the same route. The Bedrock provider page gets a "Native Chat Completions route" section naming which models go native by default and which need the prefix, the cost map condition behind the default (a row listing /v1/chat/completions under supported_endpoints), the per-request cases that still use Converse (guardrailConfig and the other Converse body fields, operator request metadata, application inference profiles, function tools with reasoning on, thinking on /chat/completions, and an explicit bedrock/converse/ prefix) with the reason for each, and what a caller will notice in the response. The GPT-OSS section keeps its bedrock/converse/openai.gpt-oss-* examples, since those models stay on Converse unless prefixed, and points at the prefix for the native route

Merge after BerriAI/litellm#44307 lands so the page does not describe an unreleased route

Caveats

Low: the structure check (not required on main) is red at 2b6b794 on docs/harness/quickstart.md and docs/harness/deepagents.md, files this PR does not touch, and main fixed it in #1951 (f1fda66), newer than this branch's merge base a134432, so it is left as is


Note

Low Risk
Documentation-only changes with no runtime impact; accuracy depends on the companion implementation PR shipping first.

Overview
Documents companion behavior for the upcoming Bedrock native /openai/v1/chat/completions routing (merge after the main LiteLLM PR lands).

The Bedrock provider page is updated to call out bedrock/chat_completions/ and note that bedrock/ defaults to native Chat Completions for GPT-5.6 and newer. A new Native Chat Completions route section explains which model families use native vs Converse by default, how the model cost map’s supported_endpoints drives the default, per-request Converse fallbacks (guardrails, Converse-only body fields, tools + reasoning, JSON modes, etc.), and response/parameter differences on the native path.

The converse/invoke section adds a short GPT-5.6+ exception, with SDK/proxy examples for opting GPT-OSS/Grok in via bedrock/chat_completions/ and pinning newer GPT models to bedrock/converse/. The OpenAI GPT OSS table now links to the native route prefix while keeping existing Converse examples.

Reviewed by Cursor Bugbot for commit 2b6b794. Bugbot is set up for automated code reviews on this repo. Configure here.

@vercel

vercel Bot commented Sep 20, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
litellm Ready Ready Preview Sep 30, 2026 11:58pm UTC

Request Review

@mateo-berri

Copy link
Copy Markdown
Contributor Author

bugbot run

@cursor cursor Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Stale Bugbot comment from a previous run.

@mateo-berri

Copy link
Copy Markdown
Contributor Author

bugbot run

@cursor cursor Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Stale Bugbot comment from a previous run.

…mage and Grok effort notes for the native chat route
@mateo-berri

Copy link
Copy Markdown
Contributor Author

bugbot run

@cursor cursor Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Stale Bugbot comment from a previous run.

@mateo-berri mateo-berri changed the title docs(bedrock): document the native chat completions route for the OpenAI and Grok models docs(bedrock): gpt-5.6 and newer default to the native chat completions route, chat_completions/ opts the rest in Sep 30, 2026
@mateo-berri

Copy link
Copy Markdown
Contributor Author

bugbot run

@cursor

cursor Bot commented Sep 30, 2026

Copy link
Copy Markdown

Bugbot is paused — on-demand spend limit reached

Bugbot uses usage-based billing for this team and has hit its on-demand spend limit.

A team admin can raise the spend limit in the Cursor dashboard, or wait for the next billing cycle to continue.

@mateo-berri

Copy link
Copy Markdown
Contributor Author

bugbot run

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Bugbot reviewed your changes and found no new issues!

Comment @cursor review or bugbot run to trigger another review on this PR

Reviewed by Cursor Bugbot for commit 2b6b794. Configure here.

@mateo-berri
mateo-berri merged commit 72cf5a4 into main Oct 3, 2026
4 of 5 checks passed
@mateo-berri
mateo-berri deleted the litellm_docs_bedrock_native_openai_chat branch October 3, 2026 02:56

This branch was successfully deployed

1 active deployment
Preview — 2b6b7942 Deployed Sep 30, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant