Skip to content

docs(batches): document batch file record, upload, and download limits - #1910

Merged
mateo-berri merged 3 commits into
mainfrom
litellm_batch_file_usage_caps_docs
Oct 6, 2026
Merged

mateo-berri merged 3 commits into
mainfrom
litellm_batch_file_usage_caps_docs

Conversation

@mateo-berri

@mateo-berri mateo-berri commented Sep 29, 2026 •

Copy link
Copy Markdown
Contributor

TLDR

Documents the three batch file limits added in BerriAI/litellm#43632: max_batch_file_records, max_batch_file_uploads_per_day, and max_file_downloads_per_minute

docs/batches.md gets a record-limit section next to the existing size limit and a new "Batch Upload and Download Limits" section covering the 429 shape with Retry-After, per key, per team, and per JWT user counting, the admin-only metadata overrides, what does and does not count, and how Redis affects the counts. docs/proxy/config_settings.md gets one row per setting

This should merge after BerriAI/litellm#43632, since the settings do nothing on a proxy without that change


Note

Low Risk
Docs-only; no proxy or API behavior changes in this diff.

Overview
Documentation-only update for three proxy general_settings limits introduced in #43632: max_batch_file_records, max_batch_file_uploads_per_day, and max_file_downloads_per_minute.

docs/batches.md adds a record cap section (413 on excess lines, per-key/team overrides with the lower value winning) and a new Batch Upload and Download Limits section covering daily batch uploads vs per-file-per-minute downloads, 429 + Retry-After, JWT user counting, admin-only metadata changes, what increments counters, Redis vs in-process behavior, and which routes are in scope. docs/proxy/config_settings.md adds one table row per setting with defaults and links back to the batches guide.

No runtime code changes in this PR; behavior depends on merging after the implementing change lands.

Reviewed by Cursor Bugbot for commit 897fb5d. Bugbot is set up for automated code reviews on this repo. Configure here.

@mateo-berri

Copy link
Copy Markdown
Contributor Author

bugbot run

@vercel

vercel Bot commented Sep 29, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
litellm Ready Ready Preview Oct 3, 2026 7:59pm UTC

Request Review

@cursor cursor Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Stale Bugbot comment from a previous run.

@mateo-berri

Copy link
Copy Markdown
Contributor Author

bugbot run

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Bugbot reviewed your changes and found no new issues!

Comment @cursor review or bugbot run to trigger another review on this PR

Reviewed by Cursor Bugbot for commit 897fb5d. Configure here.

@mateo-berri
mateo-berri merged commit 8af7319 into main Oct 6, 2026
6 checks passed
@mateo-berri
mateo-berri deleted the litellm_batch_file_usage_caps_docs branch October 6, 2026 03:07

This branch was successfully deployed

1 active deployment
Preview — 897fb5d7 Deployed Oct 3, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant