Repository navigation
fix: cap benchmark confidence to measured evidence - #51
Conversation
|
Warning Rate limit exceeded
To keep reviews running without waiting, you can enable usage-based add-on for your organization. This allows additional reviews beyond the hourly cap. Account admins can enable it under billing. ⌛ How to resolve this issue?After the wait time has elapsed, a review can be triggered using the We recommend that you space out your commits to avoid hitting the rate limit. 🚦 How do rate limits work?CodeRabbit enforces hourly rate limits for each developer per organization. Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout. Please see our FAQ for further information. ℹ️ Review info⚙️ Run configurationConfiguration used: Organization UI Review profile: ASSERTIVE Plan: Pro Run ID: 📒 Files selected for processing (12)
✨ Finishing Touches🧪 Generate unit tests (beta)
✨ Simplify code
Review rate limit: 0/5 reviews remaining, refill in 3 minutes and 48 seconds. Comment |
a126d31 to
e1b4987
Compare
c9a212e to
7d5031e
Compare
7d5031e to
a7c008d
Compare
6ca3a20 to
4dcb6ce
Compare
e677481 to
a7c008d
Compare
4dcb6ce to
6ca3a20
Compare
a7c008d to
d1947b5
Compare
6ca3a20 to
095b5ff
Compare
095b5ff to
3038201
Compare
d1947b5 to
5ee7fdd
Compare

Cap benchmark confidence to 0.75 and restrict 'high' label to ≥0.9
computeConfidenceinbenchmark.tsnow derives confidence solely from objective metrics: PSNR (0.35), SSIM (0.35), bitrate delta (0.2), and output colorspace (0.1); contributions from codec fields andoutput_matches_targetare removed.'high'label.confidenceLabelraises the'high'threshold from ≥0.8 to ≥0.9, so only manually-supplied values above the cap could reach that label.{label:'high', value:1}now report{label:'medium', value:0.75}; snapshots and integration test bounds updated accordingly.Macroscope summarized 5ee7fdd.