corpus: harvest realized-outcome verifier cases

[stranske]

Automated corpus growth (#2819 move 2).

High-confidence cases derived from realized PR outcomes — see the run
summary for the promoted case list. Ambiguous cases were routed to the
auto-expiring staging file, not here.

Expected verdicts here come from what the world already adjudicated by
merging or reverting each PR. The semantic NON_PASS categories
(stale-verifier-claim, review-thread-debt, missing-acceptance-criterion)
remain owner-sourced and are never machine-added.

Summary by CodeRabbit

• Tests
  • Expanded the staging evaluation corpus with 11 additional passing cases.
  • Added coverage across Workflows, Manager-Database, Inv-Man-Intake, Pension-Data, trip-planner, and Fine-Art-Archive pull requests.
  • Recorded consistent provenance and harvest metadata for the new cases.

[cursor]

Bugbot is not enabled for your account, so this pull request was not reviewed.

Enable Bugbot in the Cursor dashboard to get automatic reviews on future PRs.

[stranske-keepalive]

Workflow source needed

PR #2906 needs either a linked GitHub issue or one valid non-issue Workflow Source before PR metadata automation can manage it safely.

Please do one of:

• Add <!-- meta:issue:123 --> or a normal Closes #123 / Related to #123 line.
• Check one Workflow Source option in the PR body.
• Add a hidden marker such as <!-- workflow-source:local_request -->, <!-- workflow-source:manual_remote -->, <!-- workflow-source:review_followup -->, <!-- workflow-source:sync_campaign -->, or <!-- workflow-source:dependabot -->.
• Add a workflow source label such as workflow:source-direct-pr, workflow:source-local-request, workflow:source-review-followup, workflow:source-sync, or workflow:no-automation.

Once a valid source is present, this warning will not be reposted.

[coderabbitai]

📝 Walkthrough

Walkthrough

The staging evaluation corpus adds 11 harvested PASS cases from six pull requests. Each record uses the clean-pass category, harvested provenance, and the 2026-08-03 harvest date.

Changes

Staging evaluation corpus

Layer / File(s)	Summary
Add harvested evaluation cases config/model_eval_corpus_staging.json	Adds 11 corpus records for Workflows, Manager-Database, Inv-Man-Intake, Pension-Data, trip-planner, and Fine-Art-Archive pull requests.

Estimated code review effort: 2 (Simple) | ~5 minutes

Suggested reviewers: copilot

🚥 Pre-merge checks | ✅ 5

✅ Passed checks (5 passed)

Check name	Status	Explanation
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title clearly summarizes the addition of harvested realized-outcome verifier cases to the evaluation corpus.

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch verifier-corpus-harvest/auto

---

_{Comment @coderabbitai help to get the list of available commands.}

[stranske-keepalive]

Automated Status Summary

Head SHA: ef615fb
Latest Runs: ⏳ pending — Gate
Required contexts: summary
Required: core tests (3.12): ⏳ pending, core tests (3.13): ⏳ pending, docker smoke: ⏳ pending, gate: ⏳ pending

Workflow / Job	Result	Logs
(no jobs reported)	⏳ pending	—

Coverage Overview

• Coverage history entries: 0

Updated automatically; will refresh on subsequent CI/Docker completions.

---

Keepalive checklist

Scope

No scope information available

Tasks

• No tasks defined

Acceptance criteria

• No acceptance criteria defined

[Copilot]

Pull request overview

Expands the verifier corpus staging dataset with newly harvested “clean-pass” cases derived from realized PR outcomes, supporting ongoing automated corpus growth for verifier model evaluation (move 2 of #2819).

Changes:

• Added multiple new harvested PASS / clean-pass entries to the staging corpus file.
• Recorded harvested_at timestamps for the newly added cases (2026-08-03).