Repository navigation
docs(guardrails): LLM Shield Proxy: which LiteLLM versions include it; quick start runs as written - #2138
Open
ninadphalak wants to merge 3 commits into
Open
docs(guardrails): LLM Shield Proxy: which LiteLLM versions include it; quick start runs as written#2138ninadphalak wants to merge 3 commits into
ninadphalak wants to merge 3 commits into
Conversation
…e it, and make the quick start run as written
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
…release that includes it
This branch had an error being deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Follow-up to #2070, from running the page as written on the current image.
Version note.
llm_shield_proxywas merged on 2026-10-05 (BerriAI/litellm#42645); the first release that includes it is the v1.106.0-dev.1 pre-release (checked:litellm==1.106.0.dev1starts with the documented config and loads the guardrail;1.105.0rc1logs the skip line below). Onghcr.io/berriai/litellm:main-latest(1.105.0) the documentedconfig.yamlis accepted, the proxy logsSkipping guardrail 'llm-shield': ... Unsupported guardrail: llm_shield_proxy, starts without it, and requests reach the provider unredacted. The page now says so in an info box that names v1.106.0-dev.1 as the first release with it.Quick start as written. On
mainthe proxy refuses to start without a master key, and step 4 used$LITELLM_API_KEY, which the page never set. Step 3 now exportsLITELLM_MASTER_KEY(placeholder value, as in the other pages) and the two curl examples use it.Checked on a running LiteLLM built from
mainat the merge commit with an LLM Shield Proxy container: with the master key set, steps 3 and 4 run as written and the reply comes back restored.