Repository navigation
docs(bedrock): gpt-5.6 and newer default to the native chat completions route, chat_completions/ opts the rest in - #1583
Merged
Conversation
…nAI and Grok models
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
Contributor
Author
|
bugbot run |
…ive chat completions route
…oss on the native route
… the native route
Contributor
Author
|
bugbot run |
18 tasks done
…mage and Grok effort notes for the native chat route
Contributor
Author
|
bugbot run |
…native_openai_chat_lit8684
…ns route, chat_completions/ opts the rest in
Contributor
Author
|
bugbot run |
Bugbot is paused — on-demand spend limit reachedBugbot uses usage-based billing for this team and has hit its on-demand spend limit. A team admin can raise the spend limit in the Cursor dashboard, or wait for the next billing cycle to continue. |
…one for GPT-5.6 and newer
Contributor
Author
|
bugbot run |
There was a problem hiding this comment.
✅ Bugbot reviewed your changes and found no new issues!
Comment @cursor review or bugbot run to trigger another review on this PR
Reviewed by Cursor Bugbot for commit 2b6b794. Configure here.
18 tasks done
6 tasks done
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Companion docs for BerriAI/litellm#44307, which sends Bedrock GPT-5.6 and newer chat completions (the GPT-5.6, GPT-6, and GPT-6.1 families today) to bedrock-runtime's native
/openai/v1/chat/completionsendpoint by default and adds abedrock/chat_completions/prefix that opts any other model AWS serves there (GPT-OSS and Grok 4.6) into the same route. The Bedrock provider page gets a "Native Chat Completions route" section naming which models go native by default and which need the prefix, the cost map condition behind the default (a row listing/v1/chat/completionsundersupported_endpoints), the per-request cases that still use Converse (guardrailConfigand the other Converse body fields, operator request metadata, application inference profiles, function tools with reasoning on,thinkingon/chat/completions, and an explicitbedrock/converse/prefix) with the reason for each, and what a caller will notice in the response. The GPT-OSS section keeps itsbedrock/converse/openai.gpt-oss-*examples, since those models stay on Converse unless prefixed, and points at the prefix for the native routeMerge after BerriAI/litellm#44307 lands so the page does not describe an unreleased route
Caveats
Low: the
structurecheck (not required on main) is red at 2b6b794 on docs/harness/quickstart.md and docs/harness/deepagents.md, files this PR does not touch, and main fixed it in #1951 (f1fda66), newer than this branch's merge base a134432, so it is left as isNote
Low Risk
Documentation-only changes with no runtime impact; accuracy depends on the companion implementation PR shipping first.
Overview
Documents companion behavior for the upcoming Bedrock native
/openai/v1/chat/completionsrouting (merge after the main LiteLLM PR lands).The Bedrock provider page is updated to call out
bedrock/chat_completions/and note thatbedrock/defaults to native Chat Completions for GPT-5.6 and newer. A new Native Chat Completions route section explains which model families use native vs Converse by default, how the model cost map’ssupported_endpointsdrives the default, per-request Converse fallbacks (guardrails, Converse-only body fields, tools + reasoning, JSON modes, etc.), and response/parameter differences on the native path.The converse/invoke section adds a short GPT-5.6+ exception, with SDK/proxy examples for opting GPT-OSS/Grok in via
bedrock/chat_completions/and pinning newer GPT models tobedrock/converse/. The OpenAI GPT OSS table now links to the native route prefix while keeping existing Converse examples.Reviewed by Cursor Bugbot for commit 2b6b794. Bugbot is set up for automated code reviews on this repo. Configure here.