Skip to content

fix(bedrock): send tool-search beta header for Haiku 4.5 on Invoke /v1/messages #36502

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
mateo-berri merged 3 commits into from
Aug 11, 2026
Merged

fix(bedrock): send tool-search beta header for Haiku 4.5 on Invoke /v1/messages #36502

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
bc98c67
fix(bedrock): send tool-search beta header for Haiku 4.5 on Invoke /v…
mateo-berri Aug 11, 2026
7d4488d
refactor(bedrock): read tool search support from the model map
mateo-berri Aug 11, 2026
df54256
fix(schema): declare supports_tool_search in the model prices schemas
mateo-berri Aug 11, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 21 additions & 12 deletions litellm/llms/bedrock/messages/invoke_transformations/anthropic_claude3_transformation.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -372,8 +372,9 @@ def _supports_tool_search_on_bedrock(self, model: str) -> bool:
"""
Check if the model supports tool search on Bedrock.

On Amazon Bedrock, server-side tool search is supported on Claude Opus 4.5
and Claude Sonnet 4.5 with the tool-search-tool-2025-10-19 beta header.
The model map's ``supports_tool_search`` flag is authoritative when
``model`` resolves to an entry that sets it; the name patterns below
cover ids the map cannot resolve (ARNs, unlisted regional variants).

Ref: https://platform.claude.com/docs/en/agents-and-tools/tool-use/tool-search-tool

Expand All @@ -383,9 +384,12 @@ def _supports_tool_search_on_bedrock(self, model: str) -> bool:
Returns:
True if the model supports tool search on Bedrock
"""
catalog: Final = AnthropicModelInfo._get_provider_resolved_capability(model, "supports_tool_search", "bedrock")
if catalog is not None:
return catalog

model_lower: Final = model.lower()

# Supported models for tool search on Bedrock
supported_patterns: Final = [
# Opus 4.5
"opus-4.5",
Expand All @@ -407,10 +411,16 @@ def _supports_tool_search_on_bedrock(self, model: str) -> bool:
"sonnet_4.6",
"sonnet-4-6",
"sonnet_4_6",
# NOTE: Opus 4.7 on Bedrock does not support server-side tool search
# as of launch (2026-04-16). Bedrock rejects the tool type with:
# "tool type 'tool_search_tool_..._20251119' is not supported for this model".
# Re-add the opus-4.7 patterns here once AWS announces support.
# Opus 4.7
"opus-4.7",
"opus_4.7",
"opus-4-7",
"opus_4_7",
# Haiku 4.5
"haiku-4.5",
"haiku_4.5",
"haiku-4-5",
"haiku_4_5",
]

return any(pattern in model_lower for pattern in supported_patterns)
Comment thread
greptile-apps[bot] marked this conversation as resolved.
Expand All @@ -426,11 +436,10 @@ def _get_tool_search_beta_header_for_bedrock(
"""
Adjust tool search beta header for Bedrock.

Bedrock requires a different beta header for tool search on Opus 4 models
when tool search is used without programmatic tool calling or input examples.

Note: On Amazon Bedrock, server-side tool search is only supported on Claude Opus 4
with the `tool-search-tool-2025-10-19` beta header.
Bedrock requires a different beta header for tool search than the
Anthropic API when tool search is used without programmatic tool
calling or input examples: `tool-search-tool-2025-10-19`, and only on
the models listed in `_supports_tool_search_on_bedrock`.

Ref: https://platform.claude.com/docs/en/agents-and-tools/tool-use/tool-search-tool

Expand Down
Loading
Loading