Skip to content

fix(batches): skip unnecessary batch input file reads #29114

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
mateo-berri merged 17 commits into from
Jun 2, 2026
Merged

fix(batches): skip unnecessary batch input file reads #29114

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
7afd657
fix(batches): skip unnecessary batch input file reads
Sameerlite May 28, 2026
b391f77
fix(batch-rate-limiter): prevent user metadata flag from bypassing mo…
cursoragent May 28, 2026
4f9cedd
fix(batch_rate_limiter): enforce model access check before honoring s…
cursoragent May 28, 2026
f41ec3e
fix(batch_rate_limiter): wildcard model bypass + fail-open embedded m…
cursoragent May 28, 2026
c976d84
perf(batch_rate_limiter): reuse rate-limit descriptors across skip ch…
mateo-berri May 30, 2026
4cda2c5
Merge remote-tracking branch 'origin/litellm_internal_staging' into l…
mateo-berri May 30, 2026
82c1a36
test(batch_rate_limiter): cover skip-path and file-fetch helpers
mateo-berri May 30, 2026
523a984
fix(batch_rate_limiter): resolve provider skip from trusted deploymen…
mateo-berri May 30, 2026
a115df8
fix(batch_rate_limiter): guard model-embedded credential lookup on ll…
mateo-berri May 30, 2026
1e71bdd
test(batch_rate_limiter): drive real no-skip fetch path and pin wildc…
mateo-berri May 30, 2026
9d5ea6f
fix(batch_rate_limiter): drop client-controlled skip flag to close qu…
mateo-berri May 30, 2026
00cd3ed
fix(batch_rate_limiter): match per-model skip on file-bound model only
mateo-berri May 30, 2026
7a7e24b
fix(batch_rate_limiter): drop forgeable per-model skip to close quota…
mateo-berri May 30, 2026
f0e7c45
fix(batch_rate_limiter): warn when no-op per-model skip key is config…
mateo-berri May 30, 2026
56d7069
test(batch_rate_limiter): patch llm_router so model-embedded credenti…
mateo-berri May 30, 2026
c44fafa
fix(batch_rate_limiter): resolve provider skip from file-bound model
mateo-berri Jun 1, 2026
092bd71
Merge remote-tracking branch 'origin/litellm_internal_staging' into l…
mateo-berri Jun 1, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading