合并 - #2287
Closed
Futureppo wants to merge 5 commits into
Closed
Conversation
Contributor
|
Caution Review failedThe pull request is closed. WalkthroughThis PR introduces channel-level rate limiting with per-model configuration. It adds Redis-backed rate limit enforcement (RPM/TPM/RPD), a monitoring endpoint for viewing real-time usage, backend rate limit checks in the relay loop, and a complete admin UI for managing and displaying rate limit metrics. Changes
Sequence DiagramsequenceDiagram
actor Admin as Admin
participant UI as Frontend UI
participant API as Backend API
participant Redis as Redis
participant DB as Database
rect rgb(220, 240, 255)
note over Admin,DB: Rate Limit Check During Relay
end
API->>API: Relay receives request
API->>DB: Fetch channel & model rate limits
API->>API: Determine RPM, TPM, RPD limits
API->>Redis: CheckChannelRateLimit(channel, model)
alt Limit Exceeded
Redis-->>API: Error (RPM/TPM/RPD exceeded)
API->>API: Return ChannelRateLimited error
else Limit OK
Redis-->>API: OK
API->>API: Forward request downstream
API->>Redis: RecordChannelRateLimit(usage)
Redis->>Redis: Log timestamp/counter
API-->>API: Return response
end
rect rgb(240, 255, 240)
note over Admin,DB: Rate Limit Monitoring Flow
end
Admin->>UI: Open rate limit monitor
UI->>API: GET /api/channel/:id/monitor
API->>DB: Fetch channel & models
API->>Redis: Read current RPM/TPM/RPD
Redis-->>API: Usage counters
API->>API: Calculate aggregates per model
API-->>UI: ChannelMonitorData (current/limits)
UI->>UI: Render progress bars & metrics
Estimated code review effort🎯 4 (Complex) | ⏱️ ~50 minutes Areas requiring extra attention:
Possibly related PRs
Suggested reviewers
Poem
✨ Finishing touches
🧪 Generate unit tests (beta)
📜 Recent review detailsConfiguration used: CodeRabbit UI Review profile: CHILL Plan: Pro 📒 Files selected for processing (21)
Tip 📝 Customizable high-level summaries are now available in beta!You can now customize how CodeRabbit generates the high-level summary in your pull requests — including its content, structure, tone, and formatting.
Example instruction:
Note: This feature is currently in beta for Pro-tier users, and pricing will be announced later. Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
合并
Summary by CodeRabbit
Release Notes
New Features
Documentation
✏️ Tip: You can customize this high-level summary in your review settings.