Try merge upstream main - #2527
Closed
CassiopeiaCode wants to merge 30 commits into
Closed
Conversation
Document differences between the current implementation and Newapi, detailing features such as model health monitoring, rate limiting, API call caching, user call statistics, random code generation, and role conversion.
…demptions, role mapping)
DashboardListModels now returns a flattened model list in data and keeps grouped data separately. Add regression test.
…wildcard mapping; improve UI load
- ModelHealthHourly: 模型选择下拉框改用独立 Select 组件 - RecentCalls: limit 下拉框改用独立 Select 组件 - UserHourlyCallsRank: limit 下拉框改用独立 Select 组件 Semi Design 的 Form.Select 在受控模式(value属性)下与动态 optionList 配合时存在显示问题
Contributor
|
Caution Review failedThe pull request is closed. WalkthroughThis pull request introduces a comprehensive monitoring and observability system with health tracking, recent calls caching, user hourly call rankings, per-channel model role mappings, and enhanced rate-limit exemptions. It includes new database models, async event processing, API endpoints, frontend pages, and an updated CI workflow for GHCR publishing. The VERSION is bumped to v0.1.29. Changes
Sequence Diagram(s)sequenceDiagram
participant C as Client
participant R as Relay Handler
participant RC as RecentCallsCache
participant E as Event Queue
participant H as HealthWriter
participant DB as Database
C->>R: POST /v1/chat/completions
R->>RC: BeginFromContext(c)
RC->>RC: Create RecentCallRecord
R->>R: Apply role mappings
R->>R: Process request
alt Streaming Response
R->>RC: EnsureStreamByContext
loop Each chunk
R->>RC: AppendStreamChunkByContext(chunk)
end
R->>RC: FinalizeStreamAggregatedTextByContext
else Error Path
R->>RC: UpsertErrorByContext(error)
else Success Path
R->>RC: UpsertUpstreamResponseByContext(response)
end
R->>E: RecordModelHealthEventAsync(event)
E->>H: Worker processes event
H->>DB: UpsertModelHealthSlice5m
R->>E: RecordUserCallHourlyEventAsync(event)
par Async Processing
E->>DB: UpsertUserCallHourly
end
C->>RC: GET /api/debug/recent_calls
RC-->>C: Return cached records
sequenceDiagram
participant Admin as Admin UI
participant API as Controller
participant Service as Service Layer
participant Cache as Redis/Memory
participant DB as Database
Admin->>API: GET /api/model_health/hourly
API->>Service: GetModelHealthCache
alt Cache Miss
Service->>DB: GetModelHealthHourlyStats
DB-->>Service: Hourly stats
Service->>Cache: Store with 5min TTL
else Cache Hit
Cache-->>Service: Return cached data
end
Service-->>API: Response
API-->>Admin: Hourly health data + chart
Public->>API: GET /api/public/model_health/hourly_last24h
API->>Cache: Check 24h cache
alt Cache Miss
API->>DB: GetAllModelsHealthHourlyStats
API->>Cache: Store last 24h
end
Cache-->>API: Cached data
API-->>Public: JSON response
Estimated code review effort🎯 5 (Critical) | ⏱️ ~120 minutes Possibly related PRs
Suggested reviewers
Poem
✨ Finishing touches
🧪 Generate unit tests (beta)
📜 Recent review detailsConfiguration used: Organization UI Review profile: CHILL Plan: Pro 📒 Files selected for processing (68)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Author
|
Apologies for the noise. I accidentally opened this PR due to a local git configuration error (mis-pushed my downstream branch to the upstream repo). I have closed the PR and deleted the branch. Sorry for the inconvenience! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary by CodeRabbit
✏️ Tip: You can customize this high-level summary in your review settings.