Skip to content

test(e2e): prove the global guardrail is live before asserting the team bypass #34641

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
devin-ai-integration wants to merge 2 commits into
base: litellm_internal_staging
Choose a base branch
from
Open

test(e2e): prove the global guardrail is live before asserting the team bypass #34641

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
d731d57
test(e2e): make cache-settings and guardrail-bypass tests fail on a b…
devin-ai-integration[bot] Jul 25, 2026
ac25510
merge: litellm_internal_staging; drop the cache-settings round-trip r…
devin-ai-integration[bot] Jul 25, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 5 additions & 3 deletions tests/e2e/guardrails/test_team_disable_global_guardrail_e2e.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -73,12 +73,14 @@ def test_global_guardrail_blocks_key_without_team_opt_out(
exercised_on=["chat_completions"],
)
def test_team_with_disable_flag_bypasses_global_guardrail(
self, client: GuardrailsClient, resources: ResourceManager
self, client: GuardrailsClient, resources: ResourceManager, scoped_key: str
) -> None:
banned = unique_marker()
guardrail_id = client.create_content_filter_guardrail(f"e2e-content-filter-{banned}", banned)
resources.defer(lambda: client.delete_guardrail(guardrail_id))

_assert_eventually_blocked(client, scoped_key, banned)

team_id = client.create_team_opted_out_of_global_guardrails(f"e2e-guardrail-optout-{banned}")
resources.defer(lambda: client.delete_team(team_id))
key = client.create_key_in_team(team_id)
Expand All @@ -87,6 +89,6 @@ def test_team_with_disable_flag_bypasses_global_guardrail(
chat = unwrap(client.chat(key, MODEL, _prompt_with(banned)))

assert chat.choices, (
f"team opted out of global guardrails, so the banned keyword must pass "
f"through and the call must succeed, but no choices came back: {chat}"
f"the same prompt was just blocked for a key outside the team, so the opt-out "
f"is what must let it through, but no choices came back: {chat}"
)
Loading