Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
Greptile OverviewGreptile SummaryAdds support for Claude Opus 4.6 across three provider platforms (Anthropic API, AWS Bedrock Converse, and Vertex AI). The implementation adds model metadata entries with pricing, context window limits (200K input, 128K output), and capability flags.
Confidence Score: 5/5
|
| Filename | Overview |
|---|---|
| litellm/constants.py | Added anthropic.claude-opus-4-6-v1:0 to BEDROCK_CONVERSE_MODELS list |
| model_prices_and_context_window.json | Added three Opus 4.6 model entries with pricing, context limits, and capability flags |
| litellm/model_prices_and_context_window_backup.json | Backup file synchronized with main model configuration JSON |
| tests/test_litellm/test_claude_opus_4_6_config.py | New test file validates Opus 4.6 model entries and Bedrock registration |
Sequence Diagram
sequenceDiagram
participant User
participant LiteLLM
participant ModelConfig
participant Provider as Provider (Anthropic/Bedrock/Vertex)
User->>LiteLLM: Request with claude-opus-4-6
LiteLLM->>ModelConfig: Lookup model metadata
ModelConfig-->>LiteLLM: Return pricing, limits, capabilities
Note over ModelConfig: max_input: 200K, max_output: 128K<br/>supports_prompt_caching: true<br/>tool_use_system_prompt_tokens: 346
LiteLLM->>Provider: Route to appropriate provider
alt Anthropic API
LiteLLM->>Provider: Use claude-opus-4-6
else Bedrock Converse
LiteLLM->>Provider: Use anthropic.claude-opus-4-6-v1:0
else Vertex AI
LiteLLM->>Provider: Use vertex_ai/claude-opus-4-6
end
Provider-->>LiteLLM: Model response
LiteLLM->>LiteLLM: Calculate costs using pricing metadata
Note over LiteLLM: Apply >200K pricing if applicable<br/>Apply cache pricing if used
LiteLLM-->>User: Response with usage tracking
f4751ae to
67e21b8
Compare
|
@PeterDaveHello please resolve merge conflicts |
|
@PeterDaveHello please also make sure you add the |
|
Sure! Doing it! |
Add Claude Opus 4.6 entries for Anthropic, Bedrock Converse, and Vertex AI. Align pricing and capability metadata with Anthropic docs, including long-context rates, above-200k prompt-caching rates, prefill removal, and tool-use system prompt token counts. Register the Bedrock Converse model ID in constants and add targeted tests to validate model map values and converse registration.
67e21b8 to
3d7daac
Compare
|
@ishaan-jaff @marty-sullivan PR updated! |
Add Claude Opus 4.6 entries for Anthropic, Bedrock Converse, and Vertex AI. Align pricing and capability metadata with Anthropic docs, including long-context rates, above-200k prompt-caching rates, prefill removal, and tool-use system prompt token counts. Register the Bedrock Converse model ID in constants and add targeted tests to validate model map values and converse registration.
|
It looks there may have been a change in the naming convention that needs to be fixed here for bedrock. It looks like they have gotten rid of the vs: |
|
Let me see what I can do for it. |
|
@PeterDaveHello thanks, I did confirm that litellm isn't picking it up properly, so the names do need to be fixed for bedrock |
Relevant issues
N/A
Pre-Submission checklist
Please complete all items before asking a LiteLLM maintainer to review your PR
tests/litellm/directory, Adding at least 1 test is a hard requirement - see detailstests/test_litellm/test_claude_opus_4_6_config.pymake test-unitpoetry run pytest tests/test_litellm/test_utils.py::test_aaamodel_prices_and_context_window_json_is_valid tests/test_litellm/test_claude_opus_4_6_config.py tests/test_litellm/llms/bedrock/chat/test_converse_transformation.py::test_get_supported_openai_params_bedrock_converse -q4 passedCI (LiteLLM team)
Branch creation CI run
Link:
CI run for the last commit
Link:
Merge / cherry-pick CI run
Links:
Type
🆕 New Feature
✅ Test
Changes
claude-opus-4-6anthropic.claude-opus-4-6-v1:0vertex_ai/claude-opus-4-6*_above_200k_tokens)supports_assistant_prefill=falsetool_use_system_prompt_tokens=346anthropic.claude-opus-4-6-v1:0inBEDROCK_CONVERSE_MODELSReferences