Skip to content

docs: document the Anthropic automatic prompt caching env vars - #594

Merged
tin-berri merged 6 commits into
mainfrom
litellm_lit4478_anthropic_prompt_caching_env_vars
Jul 17, 2026
Merged

docs: document the Anthropic automatic prompt caching env vars#594
tin-berri merged 6 commits into
mainfrom
litellm_lit4478_anthropic_prompt_caching_env_vars

Conversation

@tin-berri

@tin-berri tin-berri commented Jul 16, 2026

Copy link
Copy Markdown
Contributor

Summary

Documents automatic Anthropic prompt caching across the environment settings reference and prompt caching tutorial. The reference adds LITELLM_ENABLE_ANTHROPIC_PROMPT_CACHING and LITELLM_ANTHROPIC_PROMPT_CACHING_TTL; the tutorial explains the provider-credential sharing boundary, gateway-wide checkpoint injection for Claude models, supported models and endpoints, TTL and precedence rules, and when to use manual injection points instead

These variables were added in BerriAI/litellm#33573. Its documentation job checks this repo's default branch and stays red until every environment variable read by the codebase has a row in docs/proxy/config_settings.md. The validation exits 0 against this branch and reports both keys as undocumented without the new rows

The rows remain alphabetized among the existing LITELLM_ANTHROPIC_* settings. A local Docusaurus production build also completes successfully

Screenshots

Rendered from current head 40174df1 using the local Docusaurus production build

Shared cache boundary and automatic checkpoints Injection behavior, cache lifetime, and manual fallback
Shared cache boundary and automatic checkpoints Injection behavior, cache lifetime, and manual fallback
Environment settings reference rows
Anthropic prompt caching environment settings

Link to Devin session: https://app.devin.ai/sessions/f03da2725ec94d28b3facf766871b102

@vercel

vercel Bot commented Jul 16, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
litellm Ready Ready Preview, Comment Jul 17, 2026 1:02am

Request Review

@tin-berri
tin-berri merged commit 712f8c1 into main Jul 17, 2026
3 checks passed
@tin-berri
tin-berri deleted the litellm_lit4478_anthropic_prompt_caching_env_vars branch July 17, 2026 01:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant