test: add e2e tests for spend, budgets and llms - #30869

Merged

yuneng-berri merged 40 commits into

litellm_internal_stagingfrom

litellm_e2e_testing

Jun 24, 2026

Commits on Jun 18, 2026

tests: add e2e tests for spend, budgets and llms
mubashir1osmani
committed
2e4066b
style: make chained comparison of status_code clearer

mateo-berri
and
greptile-apps[bot]
authored
2c24bd6

Commits on Jun 19, 2026

remove e2e_tests folder
mubashir1osmani
committed
8786e30
test: add spend tracking tests
mubashir1osmani
committed
f616056
test: multi-window budgets coverage
mubashir1osmani
committed
156ca9f
fix: p0 issues, added types and shared functions for each test suite
mubashir1osmani
committed
76affd0
chore: add config.yml
mubashir1osmani
committed
bf27579
test: passthrough endpoints stream/non-stream e2e
mubashir1osmani
committed
5782b74
style: carry clearer status_code comparison into renamed e2e dir
mubashir1osmani
committed
c727d96
fix: rename cost breakdown function
mubashir1osmani
committed
a143d74
fix: pydantic validation for budget info, dont allow explicit type cast
mubashir1osmani
committed
6843ca0
refactor: migrate to gateway client
mubashir1osmani
committed
ff7c3c5
test: add custom pricing tests
mubashir1osmani
committed
61e259c

Commits on Jun 20, 2026

Commits on Jun 21, 2026

Commits on Jun 24, 2026

test(e2e): set fast budget-reset cadence in gateway config so staging windows reset within e2e timeouts

mubashir1osmani
authored and
mateo-berri
committed
7ed2a95
test(e2e): surface real /spend/tags errors instead of masking them as missing tags

mubashir1osmani
authored and
mateo-berri
committed
4b692c7
test(e2e): drop flaky test_tag_spend_matches_sum_of_tagged_logs

mubashir1osmani
authored and
mateo-berri
committed
90bc446
test(e2e): widen budget-reset wait windows to de-flake wall-clock-aligned resets

mubashir1osmani
authored and
mateo-berri
committed
44389ee
test(e2e): let the spend-counter reseed test reach a cluster-mode TLS redis

mubashir1osmani
authored and
mateo-berri
committed
7528b02
test(e2e): take the direct-GET spend-counter path on E2E_REDIS_CLUSTER

mubashir1osmani
authored and
mateo-berri
committed
0822042
test(e2e): use REDIS_HOST/REDIS_PORT and drop the unused redis knobs

mubashir1osmani
authored and
mateo-berri
committed
edd1fd0
test(e2e): replace the vacuous failure-row test with per-model attribution

mubashir1osmani
authored and
mateo-berri
committed
fa2c782
test(e2e): assert /spend/logs returns the key's spend without 5xx

mubashir1osmani
authored and
mateo-berri
committed
54a4246
Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_e2e_testing
mateo-berri
committed
2353625