docs: add per-tag rate limits documentation - #31855
docs: add per-tag rate limits documentation#31855devin-ai-integration[bot] wants to merge 1 commit into
Conversation
Add documentation page explaining the per-tag RPM limiting feature (PR #31502). Includes API examples for creating/updating keys with tag_rpm_limit, UI screenshot of the tag rate limit editor, and usage examples for sending tagged requests. These files are intended for the litellm-docs repo (docs/proxy/ and img/ directories) Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
🤖 Devin AI EngineerI'll be helping with this pull request! Here's what you should know: ✅ I will automatically:
Note: I can only respond to comments from users who have write access to this repository. ⚙️ Control Options:
|
Greptile SummaryThis PR adds a documentation page (
Confidence Score: 3/5These are documentation-only files with no runtime risk, but both are being added to the wrong repository against the team's established policy. The content cannot break any code, but the repo-placement policy is clear and the PR author is already aware of it (their own description says the files belong in Both
|
| Filename | Overview |
|---|---|
| docs/proxy/per_tag_rate_limits.md | New documentation page for per-tag RPM limits — well-structured content but placed in the wrong repository; docs belong in litellm-docs, not this repo. |
| docs/img/per_tag_rate_limits_create_key.png | Screenshot asset accompanying the new docs page — same wrong-repo placement issue as the markdown file. |
Reviews (1): Last reviewed commit: "docs: add per-tag rate limits documentat..." | Re-trigger Greptile
| import Image from '@theme/IdealImage'; | ||
| import Tabs from '@theme/Tabs'; | ||
| import TabItem from '@theme/TabItem'; | ||
|
|
||
| # Per-Tag Rate Limits |
There was a problem hiding this comment.
Documentation must live in the
litellm-docs repo
This file (and docs/img/per_tag_rate_limits_create_key.png) should not be committed to this repo — documentation belongs in the separate litellm-docs repository. The PR description itself acknowledges this: "These files are intended for the litellm-docs repo." Please open a PR in litellm-docs instead and remove these files from this changeset.
Rule Used: Prevent documentation from being added - needs to ... (source)
Note: If this suggestion doesn't match your team's coding style, reply to this and let me know. I'll remember it for next time!
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
|
Closing in favor of BerriAI/litellm-docs#458, which moves this per-tag rate limits documentation into the litellm-docs repo where the docs site is built from. The page and screenshot have been ported there and wired into the Budgets + Rate Limits sidebar. |
|
|
Relevant issues
Documents the per-tag RPM limiting feature from #31502
Pre-Submission checklist
Screenshots / Proof of Fix
Screenshot of the Per-Tag Rate Limits editor in the key creation form, showing
cell-1: 5 RPMandcell-2: 10 RPM:Type
📖 Documentation
Changes
Adds a documentation page (
docs/proxy/per_tag_rate_limits.md) and UI screenshot for the per-tag RPM limiting feature introduced in #31502. The page covers:tag_rpm_limitvia/key/generate/key/updatex-litellm-tagsheader or request body metadataThese files are intended for the
litellm-docsrepo (docs/proxy/andimg/directories). Thesidebars.jsentry should be added under the "Budgets + Rate Limits" section, afterproxy/tag_budgetsLink to Devin session: https://app.devin.ai/sessions/fafa21b563dc48adac7061db94aebcfc
Requested by: @yassin-berriai