Skip to content

fix(bedrock_mantle): register xai.grok-4.3 for SigV4 Responses API routing - #31374

Closed
syf2211 wants to merge 1 commit into
BerriAI:litellm_oss_stagingfrom
syf2211:fix/31196-bedrock-mantle-grok-sigv4
Closed

syf2211 wants to merge 1 commit into
BerriAI:litellm_oss_stagingfrom
syf2211:fix/31196-bedrock-mantle-grok-sigv4

Conversation

@syf2211

@syf2211 syf2211 commented Jun 26, 2026

Copy link
Copy Markdown

Summary

Register bedrock_mantle/xai.grok-4.3 in the model cost map so Bedrock Mantle routes Responses API calls through BedrockMantleResponsesAPIConfig (SigV4-capable) instead of falling back to the bearer-only chat bridge.

Fixes #31196

Motivation

xai.grok-4.3 on Amazon Bedrock Mantle supports the native Responses API on the /openai/v1 path with SigV4/IAM auth, but LiteLLM had no model_cost entry for this model. As a result, mantle_supports_responses() returned False, get_provider_responses_api_config() returned None, and requests were forced onto the chat-completions bridge that only supports bearer tokens.

Changes

  • Add bedrock_mantle/xai.grok-4.3 to model_prices_and_context_window.json and the backup JSON with:
    • use_openai_responses_path: true (AWS /openai/v1 wire path)
    • supported_endpoints: ["/v1/chat/completions", "/v1/responses"]
    • AWS pricing ($1.25/M input, $2.50/M output)
    • Reasoning/tool/vision capability flags from the AWS model card
  • Add regression tests for Responses routing, pricing, registry membership, and mantle_supports_responses

Tests

pytest tests/test_litellm/llms/bedrock_mantle/test_bedrock_mantle_responses_transformation.py::TestBedrockMantlePerModelResponsesURL::test_grok_4_3_uses_openai_responses_path \
  tests/test_litellm/llms/bedrock_mantle/test_bedrock_mantle_responses_transformation.py::TestBedrockMantleResponsesPricing::test_grok_4_3_pricing_and_capabilities \
  tests/test_litellm/llms/bedrock_mantle/test_bedrock_mantle_responses_transformation.py::TestBedrockMantleResponsesPricing::test_models_registered -q

Result: 3 passed

Notes

  • No routing/auth code changes needed — Bedrock Mantle onboarding is data-driven via model_cost.
  • Tiered pricing above 200K tokens is not included (consistent with other bedrock_mantle/* entries today).

…uting

Add bedrock_mantle/xai.grok-4.3 to the model cost map with Responses API
capability metadata and the openai/v1 wire path, so ProviderConfigManager
routes through BedrockMantleResponsesAPIConfig (SigV4-capable) instead of
falling back to the bearer-only chat bridge.

Fixes BerriAI#31196
@greptile-apps

greptile-apps Bot commented Jun 26, 2026

Copy link
Copy Markdown
Contributor

Too many files changed for review. (500 files found, 100 file limit)

@CLAassistant

CLAassistant commented Jun 26, 2026 •

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
9 out of 13 committers have signed the CLA.

✅ shivamrawat1
✅ yucheng-berri
✅ mubashir1osmani
✅ mateo-berri
✅ ryan-crabbe-berri
✅ michelligabriele
✅ tin-berri
✅ milan-berri
✅ Sameerlite
❌ ishaan-berri
❌ krrish-berri-2
❌ yassin-berriai
❌ cursoragent
You have signed the CLA already but the status is still pending? Let us recheck it.

@devin-ai-integration

Copy link
Copy Markdown
Contributor

Superseded by rolling registry audit #37902, which reverified and absorbed the provider-documented metadata changes at field level

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants