Skip to content

litellm_fix(test): fix Bedrock tool search header test regression #20135

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ishaan-jaff merged 1 commit into from
Jan 31, 2026
Merged

litellm_fix(test): fix Bedrock tool search header test regression #20135

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 9 additions & 9 deletions ...nsformations/test_bedrock_chat_invoke_transformations_anthropic_claude3_transformation.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -335,11 +335,11 @@ def test_advanced_tool_use_header_translation_for_opus_4_5():

def test_advanced_tool_use_header_filtered_for_non_opus_4_5():
"""
Test that advanced-tool-use-2025-11-20 header is filtered out for non-Opus 4.5 models
without adding Bedrock-specific headers.
Test that advanced-tool-use-2025-11-20 header is filtered out for models
that don't support tool search on Bedrock.

The translation to tool-search-tool-2025-10-19 and tool-examples-2025-10-29 should
only happen for Claude Opus 4.5.
Tool search is supported on: Claude Opus 4.5, Claude Sonnet 4.5
Tool search is NOT supported on: Claude 3.5 Sonnet and earlier
"""
from litellm.llms.bedrock.messages.invoke_transformations.anthropic_claude3_transformation import (
AmazonAnthropicClaudeMessagesConfig,
Expand All @@ -360,9 +360,9 @@ def test_advanced_tool_use_header_filtered_for_non_opus_4_5():
"anthropic-beta": "advanced-tool-use-2025-11-20"
}

# Test with Claude Sonnet 4.5 (not Opus 4.5)
# Test with Claude 3.5 Sonnet (does NOT support tool search on Bedrock)
result = config.transform_anthropic_messages_request(
model="anthropic.claude-sonnet-4-5-20250929-v1:0",
model="anthropic.claude-3-5-sonnet-20241022-v2:0",
messages=messages,
anthropic_messages_optional_request_params=anthropic_messages_optional_request_params,
litellm_params={},
Expand All @@ -374,11 +374,11 @@ def test_advanced_tool_use_header_filtered_for_non_opus_4_5():
assert "advanced-tool-use-2025-11-20" not in beta_headers, \
"advanced-tool-use header should be removed for Bedrock"

# Verify Bedrock-specific headers were NOT added (only for Opus 4.5)
# Verify Bedrock-specific headers were NOT added (only for Opus 4.5 and Sonnet 4.5)
assert "tool-search-tool-2025-10-19" not in beta_headers, \
"tool-search-tool should not be added for non-Opus 4.5 models"
"tool-search-tool should not be added for models without tool search support"
assert "tool-examples-2025-10-29" not in beta_headers, \
"tool-examples should not be added for non-Opus 4.5 models"
"tool-examples should not be added for models without tool search support"


def test_advanced_tool_use_header_translation_with_multiple_beta_headers():
Expand Down
Loading