Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
143 commits
Select commit Hold shift + click to select a range
58f1814
fix(mcp): surface rejected delegate-auth upstream tokens as connect-t…
tin-berri Jul 10, 2026
75dd70a
fix(model_cost): add supports_reasoning: false to Gemini image genera…
Jun 30, 2026
aa717bc
fix(model_cost): apply supports_reasoning: false to root pricing JSON
Jun 30, 2026
fd862bb
fix(model_cost): add supports_reasoning: false to gemini/gemini-3-pro…
Jul 1, 2026
43b69d8
fix(model_cost): align backup gemini/gemini-3-pro-image entry with ro…
mateo-berri Jul 10, 2026
e5421bf
fix(model_cost): add missing backup entries for gemini image models
mateo-berri Jul 10, 2026
831dbbc
fix(anthropic): translate raw adaptive thinking for chat completions …
akapur99 Jul 11, 2026
741220c
fix(bedrock-converse): translate adaptive thinking for pre-4.6 models
akapur99 Jul 11, 2026
b58ccb0
fix(anthropic): pass resolved provider to adaptive-thinking check
akapur99 Jul 11, 2026
a5b0f32
test(bedrock-converse): cover adaptive-thinking drop when max_tokens …
akapur99 Jul 11, 2026
2b2e8cf
feat(ui): working Test Connection for the complexity auto router
akapur99 Jul 11, 2026
ddc13b3
fix(ui): probe auto-router tiers via real proxy routing, not /health/…
akapur99 Jul 11, 2026
e0463a3
fix(completion): forward aws credential kwargs into litellm_params so…
mateo-berri Jul 11, 2026
b9aef1b
test(e2e): cover key rpm/tpm rate limiting, window reset, and pacing …
mateo-berri Jul 11, 2026
1ca1a9c
test(e2e): assert the tpm block at its exact token crossing instead o…
mateo-berri Jul 11, 2026
6f2435b
test(e2e): fail the rpm reset test when the limiter resets early
mateo-berri Jul 11, 2026
9f55925
test(e2e): name the tpm window deadline's latency margin
mateo-berri Jul 11, 2026
ca55fc2
refactor(e2e): model the tpm spend loop's two outcomes as values
mateo-berri Jul 11, 2026
36dff0f
test(e2e): source the ratelimit suite's model from E2E_CHEAP_ANTHROPI…
mateo-berri Jul 11, 2026
201730e
fix(bedrock): allow bedrock-mantle:CreateInference in the web identit…
mateo-berri Jul 11, 2026
a80f856
fix(ui): drop max_tokens from the auto-router connection probe
akapur99 Jul 11, 2026
cc27528
test(main): assert the responses bridge forwards static aws keys as w…
mateo-berri Jul 11, 2026
2deeeb7
docs(github): add QA runbook section to the PR template
mateo-berri Jul 12, 2026
1d58983
docs(github): scope the QA runbook to tests/e2e edits and add example…
mateo-berri Jul 12, 2026
a6c8fb2
docs(github): shape QA runbook examples as node id plus behavior bullets
mateo-berri Jul 12, 2026
81db114
Merge pull request #32950 from BerriAI/litellm_auto_router_test_conne…
akapur99 Jul 12, 2026
f947ef1
fix(xecguard): use StandardLoggingGuardrailInformation in logging hoo…
yucheng-berri Jul 12, 2026
8c5473f
feat(ui): adopt openapi-react-query ($api) and convert useCustomers (…
ryan-crabbe-berri Jul 12, 2026
b6dbda4
refactor(ui): colocate the mcp-servers view, keeping the shared mcp_t…
ryan-crabbe-berri Jul 12, 2026
0008d96
docs(github): add Final Attestation and per-test sanity-check step to…
mateo-berri Jul 12, 2026
5fc1a3c
refactor(ui): convert endpoint usage charts to shadcn/recharts (#32723)
ryan-crabbe-berri Jul 12, 2026
0de308a
fix(auto_router): filter embedding models out of tier selects, requir…
akapur99 Jul 12, 2026
2ed4ceb
fix(model-cost-map): anchor the bedrock-claude-ids routing rule to th…
mateo-berri Jul 12, 2026
d0d1c0e
fix(proxy-auth): deny provider-wildcard access inferred through an un…
mateo-berri Jul 12, 2026
3464b5e
fix(auto_router): reset inline validation errors when switching route…
akapur99 Jul 12, 2026
d6883d1
fix(auto_router): flag name field and tier fields together on empty s…
akapur99 Jul 12, 2026
053e64e
Merge pull request #32979 from BerriAI/litellm_anchor_bedrock_routing…
mateo-berri Jul 12, 2026
34c6cce
feat(mcp): mint gateway-bound envelope at the token endpoint for dcr_…
tin-berri Jul 10, 2026
85255c9
feat(mcp): seal the authorizing key hash in the dcr_bridge envelope
tin-berri Jul 11, 2026
7df848a
fix(mcp): return 502 not KeyError when a bridge upstream response lac…
tin-berri Jul 11, 2026
362c78e
fix(mcp): let a keyless-user active key mint a bridge envelope
tin-berri Jul 11, 2026
ceff2d1
style(mcp): use X | None annotations on the touched key-resolution he…
tin-berri Jul 11, 2026
2f349f6
fix(mcp): coerce numeric expires_in and make the active-key check total
tin-berri Jul 11, 2026
7a63e51
fix(mcp): harden the bridge token mint (multi-lens review pass)
tin-berri Jul 11, 2026
e16ad04
fix(mcp): close the burn-before-check gate for both grants and valida…
tin-berri Jul 11, 2026
2f0ddc8
refactor(mcp): make the bridge delegate mint a phased failures-as-val…
tin-berri Jul 12, 2026
4ba7221
fix(mcp): let the bridge envelope report expires_in 0 at the jwt exp …
tin-berri Jul 12, 2026
a07aba0
refactor(mcp): make bridge-mint resolvers return tagged unions so sta…
tin-berri Jul 12, 2026
55ff3a2
fix(mcp): treat a positive sub-second upstream lifetime as alive, not…
tin-berri Jul 12, 2026
0e90f61
fix(auto_router): inline error for missing LLM classifier model
akapur99 Jul 12, 2026
c9beaf8
build(dev-env): add make bootstrap and unprovisioned-checkout preflig…
mateo-berri Jul 12, 2026
f717e3b
feat(router): random-pick multi-model complexity tiers (#32967)
krrish-berri-2 Jul 12, 2026
f61fd2f
fix(xecguard): sanitize scan result before recording it for logging (…
yucheng-berri Jul 12, 2026
8d35857
Merge pull request #32978 from BerriAI/litellm_auto_router_qol
akapur99 Jul 12, 2026
c136797
Merge pull request #32944 from BerriAI/litellm_translate_effort_chat_…
akapur99 Jul 12, 2026
1bff68c
chore: keep it brief
mateo-berri Jul 12, 2026
732c382
chore: keep it brief
mateo-berri Jul 12, 2026
6401908
docs(readme): point developer-mode setup at make bootstrap
mateo-berri Jul 12, 2026
a523895
chore: keep it concise
mateo-berri Jul 12, 2026
85f9bdd
feat(router): add Router(plugins=[...]) routing-plugin pipeline (#32972)
krrish-berri-2 Jul 12, 2026
26ab730
feat(router): soft-floor adaptive mode for complexity router (#32947)
krrish-berri-2 Jul 12, 2026
b1de181
Merge pull request #32965 from BerriAI/litellm_pr_template_qa_runbook
mateo-berri Jul 12, 2026
8447cd3
Merge pull request #32836 from BerriAI/litellm_gemini_image_supports_…
mateo-berri Jul 12, 2026
3e9e520
Merge pull request #32981 from BerriAI/litellm_bootstrap_fresh_worktrees
mateo-berri Jul 12, 2026
3a2d14e
fix(responses): continue MCP gateway tool turns from the final respon…
thibault-linktree Jul 13, 2026
d0428cd
ci(ui): report only error-level knip findings in CI (#32971)
ryan-crabbe-berri Jul 13, 2026
c2141b1
feat(batches): track cost for unmanaged Bedrock batches, generalize t…
Sameerlite Jul 13, 2026
ff2b690
fix(guardrails): walk custom_tool_call_output items in _content_utils…
yucheng-berri Jul 13, 2026
e6d916b
fix: show and allow editing team model aliases after team creation (#…
ryan-crabbe-berri Jul 13, 2026
20e646c
fix(ci): bump pillow to 12.3.0 to resolve osv-scan CVEs (#33093)
yucheng-berri Jul 13, 2026
3d400b5
Merge pull request #32828 from BerriAI/litellm_lit4338_delegate_token…
tin-berri Jul 13, 2026
48fd124
Merge pull request #32741 from BerriAI/litellm_lit4194_delegate_inval…
tin-berri Jul 13, 2026
8936d07
fix(proxy): track unauthenticated pass-through requests in spend logs…
devin-ai-integration[bot] Jul 13, 2026
78e5c43
feat(lasso): send source.type=litellm for Used By attribution (#33090)
yucheng-berri Jul 13, 2026
45fed6a
feat(mcp): generalize the bridge envelope identity to a key_hash or u…
tin-berri Jul 11, 2026
02e9c56
feat(mcp): interactive SSO sign-in for dcr_bridge oauth_delegate DCR …
tin-berri Jul 11, 2026
095ccd7
Merge pull request #33025 from thibault-linktree/litellm_fix_mcp_gate…
tin-berri Jul 13, 2026
f96899a
fix(mcp): classify the user-subject reload's errors like the key path…
tin-berri Jul 13, 2026
c46863b
fix(mcp): admit a user-subject envelope with the user's own MCP objec…
tin-berri Jul 13, 2026
c75fccf
Merge pull request #32956 from BerriAI/litellm_fix_lit3859_wif_bridge
mateo-berri Jul 13, 2026
7fce761
fix(ui): respect litellm_key_header_name in BYOK credential save and …
ryan-crabbe-berri Jul 13, 2026
aa9dcb4
refactor(ui): standardize debounce waits behind shared DEBOUNCE_WAIT_…
ryan-crabbe-berri Jul 13, 2026
fa09cde
feat(ui): rebuild the Virtual Keys table on the shared DataTable (#32…
yuneng-berri Jul 13, 2026
f903825
fix(mcp): relay upstream OAuth token and DCR rejections instead of a …
tin-berri Jul 13, 2026
e940199
refactor(mcp): drop bridge relay status check made unreachable by the…
tin-berri Jul 13, 2026
61c7e70
fix(mcp): classify get_user_object's wrapped DB outage across the exc…
tin-berri Jul 13, 2026
8d7dd77
fix: redact async complete streaming response for custom callbacks (#…
yucheng-berri Jul 13, 2026
3a42011
build(ui): bump @tanstack/react-pacer from 0.2.0 to 0.22.1 (#33041)
ryan-crabbe-berri Jul 13, 2026
f448ea5
fix(ui): address Virtual Keys redesign review nits (#33112)
yuneng-berri Jul 13, 2026
0c376d8
fix(openai/responses): clamp max_output_tokens below API minimum (#33…
devin-ai-integration[bot] Jul 13, 2026
011e8e7
fix(prometheus): read v3 rate limiter remaining values for per-key mo…
yucheng-berri Jul 13, 2026
da5ed97
fix(ui): drop w-full from page-content wrappers to remove 32px horizo…
yuneng-berri Jul 13, 2026
20d021e
refactor(ui): migrate straightforward value debounces to react-pacer …
ryan-crabbe-berri Jul 13, 2026
c0ff81a
Merge pull request #32946 from BerriAI/litellm_lit4338_delegate_flow
tin-berri Jul 13, 2026
c4dd06a
feat(mcp): client-held refresh envelope for the dcr_bridge oauth_dele…
tin-berri Jul 12, 2026
67d54fd
fix(mcp): reject a refresh envelope explicitly at the tool-call edge
tin-berri Jul 12, 2026
52df186
fix(mcp): SecretStr the unwrapped refresh token, drop the dead reques…
tin-berri Jul 13, 2026
1f1628d
fix(mcp): make the dcr_bridge refresh path fail correctly on outages,…
tin-berri Jul 13, 2026
3f897b2
test(proxy): add regression tests for management_endpoints edge cases…
yuneng-berri Jul 13, 2026
39e0efa
fix(auto-router): correct Responses API tool_choice shape and propaga…
krrish-berri-2 Jul 13, 2026
0d9c3cf
fix(mcp): keep out-of-contract upstream error bodies out of client re…
tin-berri Jul 13, 2026
2eb37d7
fix(mcp): re-request the sealed scope on a bridge refresh when the cl…
tin-berri Jul 13, 2026
07d2a03
fix(ui): render the sidebar scrollbar with shadcn ScrollArea (#33124)
yuneng-berri Jul 13, 2026
539bc30
refactor(ui): migrate callback debounce sites to react-pacer with reg…
ryan-crabbe-berri Jul 13, 2026
a9fac3c
fix(mcp): carry the requested scope forward when the upstream omits i…
tin-berri Jul 13, 2026
9e94f2b
refactor(mcp): classify upstream OAuth faults once and derive status,…
tin-berri Jul 13, 2026
e809002
style(mcp): unquote annotations and use PEP 604 unions in the faults …
tin-berri Jul 13, 2026
9dbebf2
fix(mcp): detect upstream invalid_grant by the RFC 6749 error field, …
tin-berri Jul 13, 2026
9335ede
fix(mcp): keep upstream self-blame codes and gateway capability gaps …
tin-berri Jul 13, 2026
b745e5b
chore: add CODEOWNERS for ui and proxy UI build artifacts (#33131)
yuneng-berri Jul 13, 2026
53aaabb
Merge pull request #32980 from BerriAI/litellm_bridge_refresh_envelope
tin-berri Jul 14, 2026
b70de76
Merge origin/litellm_internal_staging (#32980 bridge refresh envelope…
tin-berri Jul 14, 2026
e35f5d2
feat(ui): rebuild the Teams table on the shared DataTable (#33128)
yuneng-berri Jul 14, 2026
384bbf7
Merge pull request #33113 from BerriAI/litellm_mcp_oauth_error_relay
tin-berri Jul 14, 2026
001457a
fix(keys): persist key_type so the UI shows correct key scope instead…
devin-ai-integration[bot] Jul 14, 2026
397c846
feat(router): opt-in session affinity for complexity router (#33126)
krrish-berri-2 Jul 14, 2026
07ea4b3
feat(prometheus): expose video duration and image count consumption m…
yucheng-berri Jul 14, 2026
948a43c
test(e2e): otel trace completeness on /chat/completions (#33132)
yucheng-berri Jul 14, 2026
bf501c3
fix(sso): paginate through all pages when fetching service principal …
ryan-crabbe-berri Jul 14, 2026
ab87ebe
Merge branch 'litellm_internal_staging' into litellm_e2e_key_rate_lim…
mateo-berri Jul 14, 2026
6a213de
test(e2e): otel trace completeness on /v1/messages (#33133)
yucheng-berri Jul 14, 2026
b200d66
feat(ui): add adaptive routing settings to Auto-Router v2 (#33146)
krrish-berri-2 Jul 14, 2026
a30c25a
refactor(mcp): extract the dcr_bridge token flow into bridge_token_fl…
tin-berri Jul 14, 2026
41b0300
Merge pull request #33141 from BerriAI/litellm_bridge_token_flow_module
tin-berri Jul 14, 2026
93b5ca9
bump: litellm-enterprise 0.1.49 -> 0.1.50, litellm-proxy-extras 0.4.7…
yuneng-berri Jul 14, 2026
8b32320
chore(deps): pin httplib2 and setuptools transitive floors (#33233)
yuneng-berri Jul 14, 2026
2166608
feat(ui): left-anchor the Create Key and Create Team CTAs (#33248)
yuneng-berri Jul 14, 2026
71dffc1
fix(anthropic/passthrough): drop incompatible temperature when downgr…
devin-ai-integration[bot] Jul 14, 2026
939117b
fix(guardrails): run apply_guardrail-style model-level pre_call guard…
yucheng-berri Jul 14, 2026
ffe0c4c
fix(proxy)!: enforce user budget on team keys (read-time + reservatio…
devin-ai-integration[bot] Jul 14, 2026
edd3bce
fix(e2e): bound spend-log snapshots to a /spend/logs/v2 window (#33265)
mubashir1osmani Jul 14, 2026
a21669a
refactor: make the code easier to read
mateo-berri Jul 14, 2026
598fa9d
feat(pricing): add gemini-omni-flash-preview with video output token …
mateo-berri Jul 14, 2026
ce3bf2d
fix(gemini): map video response modality instead of MODALITY_UNSPECIFIED
mateo-berri Jul 14, 2026
6ad2f85
Merge pull request #32914 from BerriAI/litellm_e2e_key_rate_limit_cov…
mateo-berri Jul 14, 2026
477ef3a
fix(anthropic): use native output capability (#33235)
krrish-berri-2 Jul 14, 2026
bb1b3dc
fix(ci): retry setup-uv installs to survive transient manifest fetch …
mateo-berri Jul 14, 2026
668df94
Merge pull request #33279 from BerriAI/litellm_setup_uv_retry
mateo-berri Jul 14, 2026
f31dacb
fix(proxy): never log raw virtual keys in key insertion debug output …
yucheng-berri Jul 14, 2026
8c77660
Merge pull request #33274 from BerriAI/litellm_gemini_omni_flash_prev…
mateo-berri Jul 14, 2026
f7849f9
fix(auth): scope the JWT enterprise gate to actual JWTs (#33296)
mubashir1osmani Jul 15, 2026
32af83d
fix(s3): sanitize slashes in response-id-derived object key file name…
yucheng-berri Jul 15, 2026
f8c49f5
refactor(ui): migrate guardrails table onto shared DataTable (#33303)
yuneng-berri Jul 15, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 2 additions & 0 deletions .github/CODEOWNERS
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
/ui/ @yuneng-jiang @ryan-crabbe-berri
/litellm/proxy/_experimental/out/ @yuneng-jiang @ryan-crabbe-berri
47 changes: 47 additions & 0 deletions .github/actions/setup-uv-with-retries/action.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,47 @@
name: "Set up uv with retries"
description: >-
Install uv via astral-sh/setup-uv, retrying on transient failures. Even with
an exact pinned version, the action resolves the artifact URL by fetching
https://raw.githubusercontent.com/astral-sh/versions/main/v1/uv.ndjson in a
single request with no retry, timeout, or fallback, so one connection-level
network error ("fetch failed") fails the whole job before any test runs.
Retrying the full step covers the manifest fetch and the binary download.

inputs:
version:
description: "uv version to install"
required: true

runs:
using: composite
steps:
- name: Set up uv (attempt 1)
id: attempt-1
continue-on-error: true
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7.6.0
with:
version: ${{ inputs.version }}

- name: Wait before attempt 2
if: steps.attempt-1.outcome == 'failure'
shell: bash
run: sleep 15

- name: Set up uv (attempt 2)
id: attempt-2
if: steps.attempt-1.outcome == 'failure'
continue-on-error: true
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7.6.0
with:
version: ${{ inputs.version }}

- name: Wait before attempt 3
if: steps.attempt-2.outcome == 'failure'
shell: bash
run: sleep 30

- name: Set up uv (attempt 3)
if: steps.attempt-2.outcome == 'failure'
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7.6.0
with:
version: ${{ inputs.version }}
24 changes: 24 additions & 0 deletions .github/pull_request_template.md
Original file line number Diff line number Diff line change
Expand Up @@ -41,3 +41,27 @@ If you're seeing a delay in your PR being merged, ping the LiteLLM Team on [Slac
✅ Test

## Changes

## QA runbook

<!-- Only needed when your PR edits tests/e2e; delete this section otherwise

For each e2e test you added or changed, list the manual steps a reviewer can follow to reproduce it by hand against a live proxy, mapping 1:1 to what the test asserts: one top-level bullet per test giving its pytest node id followed by what it proves in plain words, then a nested "- [ ]" checklist where each item is a concrete action (route, request body, expected response) and the final item is the sanity-check step shown in the examples. Note environment prerequisites (provider credentials, config flags) and any nuances a manual run will hit. See PRs #32914 and #32963 for full examples

Example checklists:

- tests/e2e/quota_management/ratelimit/test_rate_limit_e2e.py::TestKeyRateLimits::test_rpm_limit_blocks_over_limit - a key allowed 2 requests a minute serves exactly 2 and refuses the 3rd
- [ ] Generate a limited key: curl -X POST http://localhost:4000/key/generate -H "Authorization: Bearer sk-1234" -d '{"rpm_limit": 2}'
- [ ] Send three /v1/chat/completions requests with that key inside one minute
- [ ] Expect the first two to return 200 and the third to return 429 naming the rpm limit
- [ ] Sanity check: this test makes sense to add and is not hand-wavey (e.g., assert actual expected spend instead of just spend > 0) or potentially flaky

- tests/e2e/management/test_management_e2e.py::TestModelRoutes::test_model_create_appears_in_ui - a deployment created through the API shows up on the Admin UI models page
- [ ] POST /model/new with the master key, a bedrock model, and aws_region_name (needs STORE_MODEL_IN_DB=True and AWS credentials)
- [ ] Open http://localhost:4000/ui/?page=models and expect a deployment row showing the returned model id
- [ ] Sanity check: this test makes sense to add and is not hand-wavey (e.g., assert actual expected spend instead of just spend > 0) or potentially flaky
-->

### Final Attestation

- [ ] The tests check the right things, including the edge cases, and regressions in the respective real-world customer use-cases are not possible after this PR
2 changes: 1 addition & 1 deletion .github/workflows/_test-unit-base.yml
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ jobs:
python-version: "3.12"

- name: Set up uv
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7
uses: ./.github/actions/setup-uv-with-retries
with:
version: "0.10.9"

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/auto_update_price_and_context_window.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ jobs:
with:
persist-credentials: false
- name: Set up uv
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7
uses: ./.github/actions/setup-uv-with-retries
with:
version: "0.10.9"
- name: Update JSON Data
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/check-ui-api-types.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ jobs:
python-version: "3.12"

- name: Set up uv
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7
uses: ./.github/actions/setup-uv-with-retries
with:
version: "0.10.9"

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/codspeed.yml
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ jobs:
python-version: "3.12"

- name: Set up uv
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7
uses: ./.github/actions/setup-uv-with-retries
with:
version: "0.10.9"

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/mutation-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@ jobs:
python-version: "3.12"

- name: Set up uv
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7
uses: ./.github/actions/setup-uv-with-retries
with:
version: "0.10.9"

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/oss_daily_guardrails.yml
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ jobs:
python-version: "3.12"

- name: Set up uv
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7
uses: ./.github/actions/setup-uv-with-retries
with:
version: "0.10.9"

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test-code-quality.yml
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ jobs:
python-version: "3.12"

- name: Set up uv
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7
uses: ./.github/actions/setup-uv-with-retries
with:
version: "0.10.9"

Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/test-linting.yml
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ jobs:
python-version: "3.12"

- name: Set up uv
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7
uses: ./.github/actions/setup-uv-with-retries
with:
version: "0.10.9"

Expand Down Expand Up @@ -172,7 +172,7 @@ jobs:
python-version: "3.12"

- name: Set up uv
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7
uses: ./.github/actions/setup-uv-with-retries
with:
version: "0.10.9"

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test-litellm-ui-lint.yml
Original file line number Diff line number Diff line change
Expand Up @@ -89,4 +89,4 @@ jobs:

- name: Check for dead code (knip)
if: ${{ !cancelled() && steps.changed.outputs.has_files == 'true' }}
run: npm run knip
run: npm run knip:ci
2 changes: 1 addition & 1 deletion .github/workflows/test-mcp.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ jobs:
python-version: "3.12"

- name: Set up uv
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7
uses: ./.github/actions/setup-uv-with-retries
with:
version: "0.10.9"

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test-semgrep.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ jobs:
python-version: "3.12"

- name: Set up uv
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7
uses: ./.github/actions/setup-uv-with-retries
with:
version: "0.10.9"

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test-terraform-provider.yml
Original file line number Diff line number Diff line change
Expand Up @@ -74,7 +74,7 @@ jobs:
python-version: "3.12"

- name: Set up uv
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7
uses: ./.github/actions/setup-uv-with-retries
with:
version: "0.10.9"

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test-unit-documentation.yml
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ jobs:
python-version: "3.12"

- name: Set up uv
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7
uses: ./.github/actions/setup-uv-with-retries
with:
version: "0.10.9"

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test-unit-proxy-legacy.yml
Original file line number Diff line number Diff line change
Expand Up @@ -59,7 +59,7 @@ jobs:
python-version: "3.12"

- name: Set up uv
uses: astral-sh/setup-uv@37802adc94f370d6bfd71619e3f0bf239e1f3b78 # v7
uses: ./.github/actions/setup-uv-with-retries
with:
version: "0.10.9"

Expand Down
2 changes: 2 additions & 0 deletions CLAUDE.md
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,8 @@ Don't hesitate to use values in .env to get needed API keys and other secrets, a

Python max line length is 120, not 88

On a fresh worktree or clone, run `make bootstrap` before anything else. It provisions everything tests, `make pre-commit`, and a local proxy need

Run tests before you commit. Also, run `make pre-commit` right before each commit, which generates types (as needed) and formats/lints your code. Any errors found must be fixed. It only runs when there are staged frontend and/or backend changes and calculates violations, generates types, etc. based on the worktree, so stage what you need or stash/delete unwanted files in litellm/ or ui/ (where backend and frontend lint run, respectively) before running it. If it fails because dashboard api types are stale, it already regenerated them for you. You just need to stage the schema.d.ts, re-run `make pre-commit` to confirm it passes, and commit

When you fix violations gated by `ruff-strict-budget.json`, `type-discipline-budget.json`, or `basedpyright-code-budget.json`, run `make lint-budget-update` and commit the lowered limits so the ceilings ratchet down instead of leaving stale headroom. It measures the working tree, so it must contain exactly the fixes you're committing
Expand Down
15 changes: 14 additions & 1 deletion Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -9,11 +9,12 @@
lint-ruff-budget lint-ruff-budget-update lint-budget-update lint-gate \
install-dev install-proxy-dev install-test-deps install-hooks \
install-helm-unittest check-circular-imports check-import-safety pre-commit \
lint-install lint-fetch-base
lint-install lint-fetch-base bootstrap

# Default target
help:
@echo "Available commands:"
@echo " make bootstrap - Provision a fresh clone/worktree"
@echo " make install-dev - Install development dependencies"
@echo " make install-proxy-dev - Install proxy development dependencies"
@echo " make install-dev-ci - Install dev dependencies (CI-compatible, pins OpenAI)"
Expand Down Expand Up @@ -71,6 +72,18 @@ info:
install-dev:
$(UV) sync --inexact --frozen

bootstrap:
$(UV) sync --inexact --frozen --extra proxy --group proxy-dev --group e2e-dev
$(UV_RUN) python scripts/prisma_generate_if_needed.py
cd ui/litellm-dashboard && npm ci --no-audit --no-fund
@main_root=$$(git worktree list --porcelain | head -1 | sed 's/^worktree //'); \
if [ "$$main_root" != "$$(git rev-parse --show-toplevel)" ] && [ -f "$$main_root/.env" ] && [ ! -f .env ]; then \
cp "$$main_root/.env" .env && echo "bootstrap: copied .env from $$main_root"; \
else \
echo "bootstrap: .env left untouched"; \
fi
@echo "bootstrap: done"

install-proxy-dev:
$(UV) sync --frozen --group proxy-dev --extra proxy

Expand Down
13 changes: 4 additions & 9 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -552,17 +552,12 @@ The Terraform modules live at [`terraform/litellm/aws/`](./terraform/litellm/aws
2. Run dependent services `docker-compose up db prometheus`

#### Backend
1. (In root) create virtual environment `python -m venv .venv`
2. Activate virtual environment `source .venv/bin/activate`
3. Install dependencies `uv sync --all-extras --group proxy-dev`
4. `uv run prisma generate`
5. `prisma generate`
6. Start proxy backend `python litellm/proxy/proxy_cli.py`
1. Run `make bootstrap`
2. Start proxy backend: `uv run python litellm/proxy/proxy_cli.py`

#### Frontend
1. Navigate to `ui/litellm-dashboard`
2. Install dependencies `npm install`
3. Run `npm run dev` to start the dashboard
1. Navigate to `ui/litellm-dashboard` (dependencies were already installed w/ `make bootstrap`)
2. Start dashboard: `npm run dev`

### Verify Docker Image Signatures

Expand Down
Loading
Loading