Skip to content

chore: disable CodeRabbit auto-incremental-review to reduce credit burn - #80

Merged
hardcoreerik merged 1 commit into
masterfrom
chore/coderabbit-reduce-review-frequency
Jul 20, 2026
Merged

chore: disable CodeRabbit auto-incremental-review to reduce credit burn#80
hardcoreerik merged 1 commit into
masterfrom
chore/coderabbit-reduce-review-frequency

Conversation

@hardcoreerik

Copy link
Copy Markdown
Owner

Summary

User asked to investigate why CodeRabbit reviews kept getting rate-limited and whether an account setting needed to change. Findings:

  • We're on Pro Plus (confirmed from review run-configuration metadata), not free tier — base allowance is 10 PR reviews/hour, not 1.
  • Root cause is the 7-day fair-use throttle, not a plan misconfiguration: Pro Plus drops to "1 review/hour, one at a time" once a developer crosses ~90 reviews in the trailing 7 days. Confirmed live via the non-consuming @coderabbitai rate limit command → "more reviews will be available in 56 minutes," matching that bracket.
  • Root cause of the volume: CodeRabbit's default auto_incremental_review: true re-reviews on every push, not just once. This workstream pushes several fix commits per PR (normal iteration), and each push was silently spending a review credit — e.g. PR feat(runtime): real load-time VRAM measurement from llama.cpp log lines #77 alone generated 4 separate CodeRabbit comment events across 3 pushes plus 2 manual triggers.

Change

Adds .coderabbit.yaml with auto_incremental_review: false. Keeps CodeRabbit's automatic review when a PR first opens, but stops it from auto-reviewing every subsequent push. Fix-commit batches get reviewed deliberately via @coderabbitai review/full review once a PR is actually ready to be looked at again, instead of on every intermediate commit.

Not done (billing decision, not mine to make)

CodeRabbit also offers a paid usage-based add-on ($0.25/file) to bypass the fair-use throttle entirely — left entirely to the user's discretion, not enabled.

Caveat

Per CodeRabbit's docs, config is read from "the feature branch under review" — it's not fully certain this retroactively changes behavior on PR #77/#78/#79 (opened before this file existed) without those branches picking it up too. It will apply cleanly to all new PRs branched from master after this merges.

🤖 Generated with Claude Code

CodeRabbit's default auto_incremental_review re-reviews on every push. This
workstream pushes several fix commits per PR (a normal iteration pattern), and
each push was silently spending a review credit whether or not a fresh review
was actually wanted yet. On the Pro Plus plan's 7-day fair-use throttle, this
was enough activity to drop per-developer availability to "1 review/hour, one
at a time" -- confirmed via the non-consuming `@coderabbitai rate limit` check,
not a free-tier/plan misconfiguration.

Keeps the automatic review CodeRabbit already does when a PR first opens, but
stops it from auto-reviewing every subsequent push. Fix-commit batches now get
reviewed deliberately via `@coderabbitai review`/`full review` once a PR is
actually ready to be looked at again.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
@coderabbitai

coderabbitai Bot commented Jul 19, 2026

Copy link
Copy Markdown
Contributor

Warning

Review limit reached

@hardcoreerik, you've reached your PR review limit, so we couldn't start this review.

Next review available in: 53 minutes

Enable usage-based reviews in Billing to review now. Otherwise, wait until the next included review is available.
You're only billed for reviews past your plan's rate limits ($0.25/file).

How can I continue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews.

How do review limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please refer docs for additional details.

Review details
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: 5f200f0a-db00-48e9-8f47-1a351cfb8a1d

📥 Commits

Reviewing files that changed from the base of the PR and between 0a31aa0 and 3299699.

📒 Files selected for processing (1)
  • .coderabbit.yaml
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch chore/coderabbit-reduce-review-frequency

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@hardcoreerik
hardcoreerik merged commit aa07f41 into master Jul 20, 2026
2 checks passed
@hardcoreerik
hardcoreerik deleted the chore/coderabbit-reduce-review-frequency branch July 20, 2026 04:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant