Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
Greptile SummaryThis PR adds a new blog post explaining how LiteLLM manages Anthropic beta headers across different providers (Bedrock, Azure AI, Vertex AI). The blog covers the config file structure, how to add new headers, dynamic reload options, and troubleshooting invalid beta flag errors.
Confidence Score: 3/5
|
| Filename | Overview |
|---|---|
| docs/my-website/blog/claude_code_beta_headers/index.md | New blog post documenting Anthropic beta header management in LiteLLM. Contains an inaccurate config example for bedrock_converse and a broken relative link to the docs section. |
Sequence Diagram
sequenceDiagram
participant CC as Claude Code
participant LP as LiteLLM Proxy
participant Config as Beta Headers Config
participant Provider as Provider (Bedrock/Azure/Vertex)
CC->>LP: Request with anthropic-beta headers
LP->>Config: Load provider-specific mapping
Config-->>LP: header→mapped_value or null
Note over LP: Filter: remove unknown & null headers<br/>Transform: rename to provider-specific names
LP->>Provider: Request with filtered/mapped headers
Provider-->>LP: Response
LP-->>CC: Response
Last reviewed commit: e67641c
| "bedrock_converse": { | ||
| "advanced-tool-use-2025-11-20": "tool-search-tool-2025-10-19", | ||
| "new-feature-2026-03-01": null, | ||
| ... |
There was a problem hiding this comment.
Incorrect header mapping for bedrock_converse
The example shows bedrock_converse mapping advanced-tool-use-2025-11-20 to "tool-search-tool-2025-10-19", but in the actual anthropic_beta_headers_config.json, bedrock_converse has this header set to null. Only bedrock (non-converse) maps it to "tool-search-tool-2025-10-19".
This is misleading because the example suggests bedrock_converse supports this header (via transformation), when in reality it filters it out entirely.
| "bedrock_converse": { | |
| "advanced-tool-use-2025-11-20": "tool-search-tool-2025-10-19", | |
| "new-feature-2026-03-01": null, | |
| ... | |
| "bedrock_converse": { | |
| "advanced-tool-use-2025-11-20": null, | |
| "new-feature-2026-03-01": null, |
| :::tip Zero-Downtime Updates | ||
| With dynamic reloading, you can fix invalid beta header errors **without restarting your service**! This is especially useful in production environments where downtime is costly. | ||
|
|
||
| See [Auto Sync Anthropic Beta Headers](../proxy/sync_anthropic_beta_headers.md) for complete documentation. |
There was a problem hiding this comment.
Broken relative link to docs page
This relative path ../proxy/sync_anthropic_beta_headers.md won't resolve correctly from a Docusaurus blog post. Blog posts are routed via their slug (e.g., /blog/claude_code_beta_headers), so ../proxy/ doesn't navigate into the docs section. This should use an absolute docs URL path instead.
| See [Auto Sync Anthropic Beta Headers](../proxy/sync_anthropic_beta_headers.md) for complete documentation. | |
| See [Auto Sync Anthropic Beta Headers](/docs/proxy/sync_anthropic_beta_headers) for complete documentation. |
Relevant issues
Pre-Submission checklist
Please complete all items before asking a LiteLLM maintainer to review your PR
tests/litellm/directory, Adding at least 1 test is a hard requirement - see detailsmake test-unit@greptileaiand received a Confidence Score of at least 4/5 before requesting a maintainer reviewCI (LiteLLM team)
Branch creation CI run
Link:
CI run for the last commit
Link:
Merge / cherry-pick CI run
Links:
Type
🆕 New Feature
🐛 Bug Fix
🧹 Refactoring
📖 Documentation
🚄 Infrastructure
✅ Test
Changes