Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
67 commits
Select commit Hold shift + click to select a range
492891c
CI: copy of #25177 (OCI GenAI: embeddings, streaming/reasoning fixes,…
mateo-berri May 23, 2026
3b2ce20
encrypt callback_vars in key/team metadata at rest (#27141)
Michael-RZ-Berri May 23, 2026
2eab9ee
perf: reduce per-request and per-chunk overhead across Anthropic stre…
yassin-berriai May 23, 2026
203b529
feat(azure): add speech transcription config support (#27482)
May 23, 2026
5e16f20
test(proxy): phase-4 payload behavior pinning for tier-2/3 key + team…
yuneng-berri May 23, 2026
14c0a2b
feat(prometheus): emit per-token-type detail metrics (LIT-3220) (#283…
May 23, 2026
886e91b
fix(otel): stamp http.response.status_code on all error responses (#2…
ryan-crabbe-berri May 23, 2026
8513d7f
chore: update Next.js build artifacts (2026-05-23 19:21 UTC, node v20…
yuneng-berri May 23, 2026
7c667b8
fix(helm): drop main- prefix from default image tag (#28710)
yuneng-berri May 23, 2026
3bcfe41
test(model_prices): allow audio_transcription_config in schema (#28708)
yuneng-berri May 23, 2026
06f6cfc
Merge pull request #28709 from BerriAI/litellm_internal_staging
yuneng-berri May 23, 2026
5f73ad4
fix(team): refresh team cache on team_model_add/delete (LIT-3244) (#2…
yuneng-berri May 23, 2026
92d4bba
fix(ui/add-model): stop vertex_ai-anthropic_models from leaking under…
ryan-crabbe-berri May 23, 2026
4148667
Fix spend logs v2 route permissions (#28705)
ryan-crabbe-berri May 23, 2026
f45909c
fix(proxy): Bedrock Knowledge Base pass-through: preserve SigV4 heade…
milan-berri May 25, 2026
f9407bc
chore(tests): migrate Bedrock CI to AWS account 941277531214 (#28728)
mateo-berri May 25, 2026
30551de
fix(otel): export SERVER span on management-endpoint success without …
yassin-berriai May 25, 2026
5f75be5
chore(ci): merge dev branch (#28801)
yuneng-berri May 25, 2026
d98ada8
chore(ci): merge dev branch (#28657)
yuneng-berri May 25, 2026
c127968
fix(ui): show 2-decimal precision for max_budget on key overview (#28…
ryan-crabbe-berri May 25, 2026
66f10bc
feat(proxy): allow `llm_api_routes` virtual keys to list MCP servers …
ryan-crabbe-berri May 25, 2026
0d5040f
chore(ci): merge dev branch (#28807)
yuneng-berri May 26, 2026
7cd9850
fix(team): keep team_alias cache in sync on _cache_team_object writes…
yuneng-berri May 26, 2026
1b6788e
fix(proxy): hydrate wildcard discovery credentials (#28284) (#28822)
yuneng-berri May 26, 2026
48dd71b
ci: add daily oss-agent-shin branch creation workflow (#28829)
May 26, 2026
f38c16c
test(proxy): add harness for proxy_server.py behavior-pinning (#28827)
yuneng-berri May 26, 2026
c23b19f
feat(openai): apply regional-processing cost uplift for EU/US data re…
mateo-berri May 26, 2026
48d7e15
chore(admin-ui): regenerate static export with trailingSlash: true (#…
mateo-berri May 26, 2026
96a2e8b
fix(azure): preserve AD token refresh in v1 OpenAI client path (#28627)
mateo-berri May 26, 2026
a8263cb
fix(ui): route API Reference back to query-param page (#28726)
ryan-crabbe-berri May 26, 2026
f75a7c6
fix(model-edit): allow clearing custom pricing on wildcard models (#2…
ryan-crabbe-berri May 26, 2026
533eab4
fix(tests/vcr): make Redis cassette cache replay deterministically (z…
mateo-berri May 26, 2026
fbff60e
fix(proxy): strip LiteLLM policy tracking from OpenAI batch metadata …
shivamrawat1 May 26, 2026
bd2d0ad
Litellm OpenAI double prefix bug (#28661)
shivamrawat1 May 26, 2026
d52fbfb
Litellm oss staging 250526 (#28770)
Sameerlite May 26, 2026
f17dfcd
fix(bedrock): align toolUse/toolSpec names and allow hyphens (#28874)
Sameerlite May 26, 2026
79a4909
fix(realtime): send TEXT frames and valid guardrail session.update (#…
Sameerlite May 26, 2026
123a9ce
fix(mcp): extend key access-group union to MCP servers (#28890)
ryan-crabbe-berri May 26, 2026
f25648c
fix(galileo): support hosted v2 spans API and string output extractio…
Sameerlite May 26, 2026
9c0a98c
fix(proxy): exclude proxy_server_request from its own body snapshot (…
michelligabriele May 26, 2026
3d0e0ce
[Feat] Add tool calling support for gemini and vertex ai live api (#2…
Sameerlite May 26, 2026
13512e7
refactor(ui): remove dead App Router scaffolding in (dashboard)/* (#2…
ryan-crabbe-berri May 26, 2026
a645d46
fix(docker): use system Node in componentized builders + retry apk ad…
yassin-berriai May 26, 2026
b6fd7f7
docs(agents): require consent before writing new third-party names (#…
yuneng-berri May 26, 2026
73e9071
refactor(ui): extract auth state into AuthContext (#28910)
ryan-crabbe-berri May 27, 2026
ea01533
fix(mcp): resolve team.access_group_ids → MCP servers (#28997)
ryan-crabbe-berri May 27, 2026
7cae5dc
test(ui): e2e cover team model edit + admin identity in navbar (#28652)
ryan-crabbe-berri May 27, 2026
b0ea013
test(e2e): cover add-fallback flow in Router Settings (#29069)
ryan-crabbe-berri May 27, 2026
9cac047
test(e2e): cover Team-BYOK add-model flow as proxy admin (#29068)
ryan-crabbe-berri May 27, 2026
157e7a0
fix(containers): record ownership for service-account keys + fix Pris…
Sameerlite May 28, 2026
bc31c57
test(e2e): cover add-MCP-server flow via discovery → custom form (#29…
ryan-crabbe-berri May 28, 2026
5699a06
test(e2e): cover AI Hub make-public flow and public model_hub_table (…
ryan-crabbe-berri May 28, 2026
95015de
feat: add support for claude code goal mode for bedrock opus output c…
mateo-berri May 28, 2026
5bd59b3
feat(guardrails): wire apply_guardrail into proxy logging callbacks (…
Sameerlite May 28, 2026
1cb19b1
chore(ci): merge dev brach (#29192)
yuneng-berri May 28, 2026
d5d6b26
fix: improve bedrock streaming hot path perf (#28720)
yassin-berriai May 28, 2026
eef1ec3
fix(proxy): enforce tag budgets for key-level tags (#29108)
Sameerlite May 28, 2026
69afcd0
fix(vertex-ai): use DB credentials in video handlers + implement Veo …
Sameerlite May 28, 2026
928f09f
fix(datadog): drain cost-management queue + opt-in FinOps tag allowli…
michelligabriele May 28, 2026
47c9266
feat(helm): split per-component ServiceAccounts for gateway, backend,…
yassin-berriai May 28, 2026
5e2d75d
bump deps (#29208) (#29226)
yuneng-berri May 28, 2026
76f56c3
fix(tests/vcr): mint Google OAuth tokens live to prevent stale-token …
yuneng-berri May 29, 2026
6b23d32
chore(cookbook): bump Go directive to 1.26.3 in gollem example (#29234)
yuneng-berri May 29, 2026
ffc113b
chore(ci): bump version (#29242)
yuneng-berri May 29, 2026
bae0459
feat(anthropic): add Claude Opus 4.8 and prune reasoning-effort flags…
mateo-berri May 29, 2026
a021a5b
Merge pull request #29243 from BerriAI/litellm_internal_staging
yuneng-berri May 29, 2026
c93b91d
test helm default image tag
koriyoshi2041 May 31, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
28 changes: 28 additions & 0 deletions .github/workflows/codeql.yml
Original file line number Diff line number Diff line change
Expand Up @@ -53,3 +53,31 @@ jobs:
uses: github/codeql-action/analyze@ebcb5b36ded6beda4ceefea6a8bc4cc885255bb3 # v3
with:
category: "/language:${{ matrix.language }}"
output: sarif-results
upload: failure-only

# py/weak-sensitive-data-hashing (CWE-328) fires on the OCI signing call at
# litellm/llms/oci/common_utils.py, which hashes the HTTP request body to
# produce the x-content-sha256 header required by the OCI HTTP signing spec —
# a content-integrity hash, not a password or secret hash. SHA-256 is mandated
# by Oracle for this header; see
# https://docs.oracle.com/en-us/iaas/Content/API/Concepts/signingrequests.htm
# The `usedforsecurity=False` flag on the hashlib.sha256 call already declares
# non-security intent, but CodeQL's taint flow still re-fires when callers
# further up the stack are modified. The suppression is scoped to this one
# file/rule pair via SARIF post-filtering so every other callsite of
# py/weak-sensitive-data-hashing in the repository continues to be analyzed.
- name: Filter SARIF (OCI sha256)
if: matrix.language == 'python'
uses: advanced-security/filter-sarif@2da736ff05ef065cb2894ac6892e47b5eac2c3c0 # v1.1
with:
patterns: |
-litellm/llms/oci/common_utils.py:py/weak-sensitive-data-hashing
input: sarif-results/python.sarif
output: sarif-results/python.sarif

- name: Upload SARIF
uses: github/codeql-action/upload-sarif@ebcb5b36ded6beda4ceefea6a8bc4cc885255bb3 # v3
with:
sarif_file: sarif-results
category: "/language:${{ matrix.language }}"
47 changes: 47 additions & 0 deletions .github/workflows/create_daily_oss_agent_shin_branch.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,47 @@
name: Create Daily oss-agent-shin Branch

on:
schedule:
- cron: "0 0 * * *" # Runs every day at midnight UTC
workflow_dispatch: # Allow manual trigger

jobs:
create-oss-agent-shin-branch:
if: github.repository == 'BerriAI/litellm'
runs-on: ubuntu-latest
permissions:
contents: write

steps:
- name: Checkout repository
uses: actions/checkout@08eba0b27e820071cde6df949e0beb9ba4906955 # v4.3.0
with:
fetch-depth: 0
persist-credentials: false

- name: Create daily oss-agent-shin branch
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
run: |
# Configure Git user
git config user.name "github-actions[bot]"
git config user.email "github-actions[bot]@users.noreply.github.com"

# Generate branch name with MM_DD_YYYY format
BRANCH_NAME="litellm_oss_agent_shin_$(date +'%m_%d_%Y')"
echo "Creating branch: $BRANCH_NAME"

# Fetch all branches
git fetch --all

# Check if the branch already exists
if git show-ref --verify --quiet refs/remotes/origin/$BRANCH_NAME; then
echo "Branch $BRANCH_NAME already exists. Skipping creation."
else
echo "Creating new branch: $BRANCH_NAME"
# Create the new branch from main
git checkout -b $BRANCH_NAME origin/main
# Push the new branch
git push origin $BRANCH_NAME
echo "Successfully created and pushed branch: $BRANCH_NAME"
fi
14 changes: 14 additions & 0 deletions .github/workflows/test-unit-proxy-endpoints.yml
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@ on:
- litellm_internal_staging
- litellm_oss_branch
- "litellm_**"
workflow_dispatch:

permissions:
contents: read
Expand Down Expand Up @@ -42,3 +43,16 @@ jobs:
workers: 2
reruns: 2
artifact-name: proxy-endpoints

# Behavior-pinning tests for litellm/proxy/proxy_server.py. Owns its
# own job (not a path on the proxy-endpoints job above) so its budget
# is independent and its coverage artifact is uploaded separately.
# See: https://www.notion.so/36c43b8acdab81ee845fd5365128a2fc
proxy-server:
uses: ./.github/workflows/_test-unit-base.yml
with:
test-path: tests/test_litellm/proxy/proxy_server
workers: 4
reruns: 2
timeout-minutes: 60
artifact-name: proxy-server
25 changes: 25 additions & 0 deletions .github/workflows/test_server_root_path.yml
Original file line number Diff line number Diff line change
Expand Up @@ -101,6 +101,31 @@ jobs:
docker logs litellm-test
exit 1

- name: Setup Node for Playwright
uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4.4.0
with:
node-version: "20"

- name: Install UI deps and Chromium
working-directory: ui/litellm-dashboard
run: |
npm ci
npx playwright install --with-deps chromium

- name: Run SERVER_ROOT_PATH redirect e2e
working-directory: ui/litellm-dashboard
env:
SERVER_ROOT_PATH: ${{ matrix.root_path }}
run: npx playwright test --config=e2e_tests/serverRootPath.config.ts

- name: Upload Playwright artifacts on failure
if: failure()
uses: actions/upload-artifact@ea165f8d65b6e75b540449e92b4886f43607fa02 # v4.6.2
with:
name: playwright-trace-${{ strategy.job-index }}
path: ui/litellm-dashboard/test-results/
retention-days: 7

- name: Cleanup
if: always()
run: |
Expand Down
13 changes: 13 additions & 0 deletions AGENTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,19 @@

This document provides comprehensive instructions for AI agents working in the LiteLLM repository.

## Confidentiality: Customer and Company Names in Code

The codebase is public. Before writing **any** third-party organization name into this repository — in source code, file or directory names, docstrings, comments, tests, fixtures, mock payloads, error messages, log lines, commit messages, or PR descriptions — pause and check:

**Already in the codebase** (OpenAI, Anthropic, Google, Azure, Bedrock, Fireworks, and other established LLM providers / integrations) — fine to use. Quick check: `git grep -i "<name>"` — if it returns hits in real code (not just your current diff), the name is established.

**Anything else** — customers, prospects, partners, new vendor integrations, observability tools, infra vendors, or any organization name that does not already appear in the repo. STOP and surface it to the user. Ask for explicit consent before writing the name into any file, commit message, or PR description. Do not write it speculatively and clean up later. Do not substitute a placeholder and proceed. Do not assume it is safe because it "looks like" a public company. The user must approve first.

**What to do instead of a customer-specific reference:**
- If you find yourself reaching for a customer name — real or fake — step back. The code shouldn't be customer-specific in the first place. Generalize the feature, or capture the customer motivation in internal docs (Notion / Linear / the internal staging PR description), never in the repo.
- Frame changes by the capability they add, not the customer who asked for it ("add per-team Bedrock guardrail routing", not "add routing for $CUSTOMER").
- Standard "fake value" markers (`example.com`, `localhost`, `127.0.0.1`, `test@example.com`) and abstract identifiers (`team_a`, `user_1`, `tenant_x`) are fine — those are not customer stand-ins.

## OVERVIEW

LiteLLM is a unified interface for 100+ LLMs that:
Expand Down
13 changes: 13 additions & 0 deletions CLAUDE.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,19 @@

This file provides guidance to Claude Code (claude.ai/code) when working with code in this repository.

## Confidentiality: Customer and Company Names in Code

The codebase is public. Before writing **any** third-party organization name into this repository — in source code, file or directory names, docstrings, comments, tests, fixtures, mock payloads, error messages, log lines, commit messages, or PR descriptions — pause and check:

**Already in the codebase** (OpenAI, Anthropic, Google, Azure, Bedrock, Fireworks, and other established LLM providers / integrations) — fine to use. Quick check: `git grep -i "<name>"` — if it returns hits in real code (not just your current diff), the name is established.

**Anything else** — customers, prospects, partners, new vendor integrations, observability tools, infra vendors, or any organization name that does not already appear in the repo. STOP and surface it to the user. Ask for explicit consent before writing the name into any file, commit message, or PR description. Do not write it speculatively and clean up later. Do not substitute a placeholder and proceed. Do not assume it is safe because it "looks like" a public company. The user must approve first.

**What to do instead of a customer-specific reference:**
- If you find yourself reaching for a customer name — real or fake — step back. The code shouldn't be customer-specific in the first place. Generalize the feature, or capture the customer motivation in internal docs (Notion / Linear / the internal staging PR description), never in the repo.
- Frame changes by the capability they add, not the customer who asked for it ("add per-team Bedrock guardrail routing", not "add routing for $CUSTOMER").
- Standard "fake value" markers (`example.com`, `localhost`, `127.0.0.1`, `test@example.com`) and abstract identifiers (`team_a`, `user_1`, `tenant_x`) are fine — those are not customer stand-ins.

## Documentation

Documentation lives in a separate repository: [BerriAI/litellm-docs](https://github.com/BerriAI/litellm-docs). It is served at [docs.litellm.ai](https://docs.litellm.ai). Do not create or edit documentation files in this repository — open doc PRs against `BerriAI/litellm-docs` instead.
Expand Down
18 changes: 16 additions & 2 deletions backend/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -12,17 +12,27 @@ USER root

COPY --from=uvbin /uv /uvx /usr/local/bin/

RUN apk add --no-cache bash gcc python3 python3-dev openssl openssl-dev libsndfile
# nodejs/npm so `prisma generate` uses Wolfi's Node via PRISMA_USE_GLOBAL_NODE
# instead of nodeenv downloading one whose dynamic deps may not be in Wolfi
# (e.g. Node 26.2.0 needs libatomic). Retry for transient apk.cgr.dev flakes.
RUN for i in 1 2 3; do \
apk add --no-cache bash gcc python3 python3-dev openssl openssl-dev libsndfile nodejs npm && break; \
[ $i = 3 ] && { echo "apk add failed after 3 retries" >&2; exit 1; }; \
sleep 5; \
done

# UV_COMPILE_BYTECODE=1 precompiles .pyc at install time → faster cold start.
# UV_LINK_MODE=copy avoids hardlink warnings when uv installs from a
# BuildKit cache mount (different filesystem).
# UV_PYTHON_DOWNLOADS=0 force uv to use the apk-installed CPython instead of
# silently pulling a managed interpreter.
# PRISMA_USE_GLOBAL_NODE explicit (matches default) so an env override can't
# silently re-enable nodeenv's Node download.
ENV UV_PROJECT_ENVIRONMENT=/app/.venv \
UV_LINK_MODE=copy \
UV_COMPILE_BYTECODE=1 \
UV_PYTHON_DOWNLOADS=0 \
PRISMA_USE_GLOBAL_NODE=true \
PATH="/app/.venv/bin:${PATH}"

# Stage 1 — install dependencies only.
Expand Down Expand Up @@ -58,7 +68,11 @@ FROM $LITELLM_RUNTIME_IMAGE AS runtime

USER root

RUN apk add --no-cache bash openssl tzdata python3 libsndfile libatomic
RUN for i in 1 2 3; do \
apk add --no-cache bash openssl tzdata python3 libsndfile libatomic && break; \
[ $i = 3 ] && { echo "apk add failed after 3 retries" >&2; exit 1; }; \
sleep 5; \
done

# wolfi-base ships an unprivileged `nonroot` account (UID/GID 65532) with
# /home/nonroot. We run the backend as that user
Expand Down
2 changes: 1 addition & 1 deletion cookbook/gollem_go_agent_framework/go.mod
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
module github.com/BerriAI/litellm/cookbook/gollem_go_agent_framework

go 1.25.1
go 1.26.3

require github.com/fugue-labs/gollem v0.1.0
2 changes: 1 addition & 1 deletion deploy/charts/litellm-helm/Chart.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ version: 1.1.0
# incremented each time you make changes to the application. Versions are not expected to
# follow Semantic Versioning. They should reflect the version the application is using.
# It is recommended to use it with quotes.
appVersion: v1.80.12
appVersion: v1.85.1

annotations:
org.opencontainers.image.source: "https://github.com/BerriAI/litellm"
Expand Down
4 changes: 2 additions & 2 deletions deploy/charts/litellm-helm/templates/deployment.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ spec:
checksum/config: {{ include (print $.Template.BasePath "/configmap-litellm.yaml") . | sha256sum }}
{{- end }}
{{- with .Values.podAnnotations }}
{{- toYaml . | nindent 8 }}
{{- tpl (toYaml .) $ | nindent 8 }}
{{- end }}
labels:
{{- include "litellm.labels" . | nindent 8 }}
Expand All @@ -53,7 +53,7 @@ spec:
- name: {{ include "litellm.name" . }}
securityContext:
{{- toYaml .Values.securityContext | nindent 12 }}
image: "{{ .Values.image.repository }}:{{ .Values.image.tag | default (printf "main-%s" .Chart.AppVersion) }}"
image: "{{ .Values.image.repository }}:{{ .Values.image.tag | default .Chart.AppVersion }}"
imagePullPolicy: {{ .Values.image.pullPolicy }}
env:
- name: HOST
Expand Down
2 changes: 1 addition & 1 deletion deploy/charts/litellm-helm/templates/migrations-job.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ spec:
{{- end }}
containers:
- name: prisma-migrations
image: "{{ .Values.image.repository }}:{{ .Values.image.tag | default (printf "main-%s" .Chart.AppVersion) }}"
image: "{{ .Values.image.repository }}:{{ .Values.image.tag | default .Chart.AppVersion }}"
imagePullPolicy: {{ .Values.image.pullPolicy }}
securityContext:
{{- toYaml .Values.securityContext | nindent 12 }}
Expand Down
35 changes: 35 additions & 0 deletions deploy/charts/litellm-helm/tests/deployment_tests.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,16 @@ templates:
- deployment.yaml
- configmap-litellm.yaml
tests:
- it: should default image tag to chart appVersion
template: deployment.yaml
asserts:
- equal:
path: spec.template.spec.containers[0].image
value: ghcr.io/berriai/litellm-database:v1.85.1
- notMatchRegex:
path: spec.template.spec.containers[0].image
pattern: :main-
Comment on lines +9 to +14

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 The equal assertion pins the exact string v1.85.1, which will cause this test to fail every time Chart.yaml's appVersion is bumped — requiring a manual update in both test files on every release. A matchRegex pattern that validates the semver-shaped tag already proves the default path uses the chart version, without tying the test to a specific version number. The notMatchRegex: :main- assertion beneath it becomes load-bearing after this change and is no longer redundant.

Suggested change
- equal:
path: spec.template.spec.containers[0].image
value: ghcr.io/berriai/litellm-database:v1.85.1
- notMatchRegex:
path: spec.template.spec.containers[0].image
pattern: :main-
- matchRegex:
path: spec.template.spec.containers[0].image
pattern: ^ghcr\.io/berriai/litellm-database:v\d+\.\d+\.\d+$
- notMatchRegex:
path: spec.template.spec.containers[0].image
pattern: :main-


- it: should work
template: deployment.yaml
set:
Expand Down Expand Up @@ -377,3 +387,28 @@ tests:
content:
name: sidecar-tpl
image: "ghcr.io/berriai/litellm-database:test"
- it: should support tpl in podAnnotations
template: deployment.yaml
set:
image:
repository: ghcr.io/berriai/litellm-database
tag: test
# Mirrors the real-world scenario this feature unblocks:
# user disables the built-in ConfigMap (and its built-in checksum/config
# annotation) and re-implements checksum/config themselves via tpl.
proxyConfigMap:
create: false
podAnnotations:
checksum/config: "{{ .Values.image.tag }}"
example.com/some-key: "{{ .Values.image.repository }}"
example.com/literal: "plain-string-value"
asserts:
- equal:
path: spec.template.metadata.annotations["checksum/config"]
value: "test"
- equal:
path: spec.template.metadata.annotations["example.com/some-key"]
value: "ghcr.io/berriai/litellm-database"
- equal:
path: spec.template.metadata.annotations["example.com/literal"]
value: "plain-string-value"
13 changes: 13 additions & 0 deletions deploy/charts/litellm-helm/tests/migrations-job_tests.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,19 @@ suite: test migrations job
templates:
- migrations-job.yaml
tests:
- it: should default image tag to chart appVersion
template: migrations-job.yaml
set:
migrationJob:
enabled: true
asserts:
- equal:
path: spec.template.spec.containers[0].image
value: ghcr.io/berriai/litellm-database:v1.85.1
- notMatchRegex:
path: spec.template.spec.containers[0].image
pattern: :main-
Comment on lines +11 to +16

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Same hardcoded version concern as in deployment_tests.yaml: pinning v1.85.1 means every appVersion bump breaks this test. Using a matchRegex for a semver-shaped tag is more resilient and still proves the default path does not produce a :main- tag.

Suggested change
- equal:
path: spec.template.spec.containers[0].image
value: ghcr.io/berriai/litellm-database:v1.85.1
- notMatchRegex:
path: spec.template.spec.containers[0].image
pattern: :main-
- matchRegex:
path: spec.template.spec.containers[0].image
pattern: ^ghcr\.io/berriai/litellm-database:v\d+\.\d+\.\d+$
- notMatchRegex:
path: spec.template.spec.containers[0].image
pattern: :main-


- it: should work with envVars
template: migrations-job.yaml
set:
Expand Down
2 changes: 1 addition & 1 deletion deploy/charts/litellm-helm/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ image:
repository: ghcr.io/berriai/litellm-database
pullPolicy: Always
# Overrides the image tag whose default is the chart appVersion.
# tag: "main-latest"
# tag: "latest"
tag: ""

imagePullSecrets: []
Expand Down
14 changes: 1 addition & 13 deletions docker/Dockerfile.non_root
Original file line number Diff line number Diff line change
Expand Up @@ -55,22 +55,10 @@ COPY . .
# Set non-root flag for build time consistency
ENV LITELLM_NON_ROOT=true

# Stage the pre-built Admin UI from the checked-in Next.js static export.
# _experimental/out/ is regenerated as part of the release runbook.
# Restructure extensionless routes (foo.html -> foo/index.html) to match the layout
# proxy_server.py expects, and drop a readiness marker.
RUN mkdir -p /var/lib/litellm/ui /var/lib/litellm/assets && \
cp -r /app/litellm/proxy/_experimental/out/. /var/lib/litellm/ui/ && \
cp /app/litellm/proxy/logo.jpg /var/lib/litellm/assets/logo.jpg && \
( cd /var/lib/litellm/ui && \
for html_file in *.html; do \
if [ "$html_file" != "index.html" ] && [ -f "$html_file" ]; then \
folder_name="${html_file%.html}" && \
mkdir -p "$folder_name" && \
mv "$html_file" "$folder_name/index.html"; \
fi; \
done && \
touch .litellm_ui_ready )
touch /var/lib/litellm/ui/.litellm_ui_ready

RUN --mount=type=cache,target=/app/.cache/uv,id=litellm-uv-cache \
if [ "$PROXY_EXTRAS_SOURCE" = "published" ]; then \
Expand Down
Loading
Loading