docs: document gated-marker coverage audit (#61) - #89
Conversation
Add a "Pre-release coverage audit" section to CONTRIBUTING.md with a one-shot command that runs all gated markers under --cov, plus guidance on interpreting the default-vs-gated coverage delta. Cross-reference it from .claude/rules/testing-signal.md § "Known gap: excluded markers". Closes #61 Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. 🗂️ Base branches to auto review (4)
Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Organization UI Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
Comment |
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
There was a problem hiding this comment.
Pull request overview
This docs-only PR adds maintainer guidance for auditing coverage from pytest markers excluded from the default coverage badge, and cross-references that guidance from the testing rules.
Changes:
- Adds a pre-release gated-marker coverage audit section to
CONTRIBUTING.md. - Links
.claude/rules/testing-signal.mdto the new contributing guide section.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.
| File | Description |
|---|---|
CONTRIBUTING.md |
Adds the gated-marker coverage audit command and interpretation guidance. |
.claude/rules/testing-signal.md |
Adds a cross-reference to the new pre-release audit documentation. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
|
@CodeRabbit review |
✅ Actions performedReview triggered.
|
Fix the pre-release coverage audit command per Copilot review: - Add --cov-fail-under=0 so the inherited 80% gate from addopts does not make the measurement command exit non-zero on passing gated tests. - Use --cov-append so the gated run combines with the default run into one .coverage file; the "additional coverage" claim is now reproducible from the documented command instead of being a standalone gated-only %. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
PR Review SummaryFixed (2 items)
Both fixed in one change: the audit command now uses False Positives (0 items)None. |
Summary
## Pre-release coverage auditsection toCONTRIBUTING.md— a one-shot command that runs all gated markers (bigquery,anthropic,cli_subprocess,e2e,wheel_smoke) under--covin a single invocation, plus guidance on interpreting the default-vs-gated coverage delta..claude/rules/testing-signal.md§ "Known gap: excluded markers".Docs-only; no code paths touched. Addresses LOW finding L7 from the 2026-05-11 codebase review.
Closes #61
Test plan
CONTRIBUTING.md§ Pre-release coverage audit renders correctly.claude/rules/testing-signal.mdresolves🤖 Generated with Claude Code
Summary by CodeRabbit