Tighten weekly auth metrics contracts - #1855
Conversation
Automated Status SummaryHead SHA: b1766d2
Coverage Overview
Coverage Trend
Top Coverage Hotspots (lowest coverage)
Updated automatically; will refresh on subsequent CI/Docker completions. Keepalive checklistScopeNo scope information available Tasks
Acceptance criteria
|
🤖 Keepalive Loop StatusPR #1855 | Agent: Codex | Iteration 0/5 Current State
🔍 Failure Classification| Error type | infrastructure | |
Keepalive Work Log (click to expand)
|
There was a problem hiding this comment.
Pull request overview
Updates weekly auth-metrics contracts so “missing organic evidence” blockers are still surfaced even when no auth coverage records are present, and ensures the weekly metrics aggregation entrypoint is available in consumer sparse checkouts via template + sync-manifest alignment.
Changes:
- Extend bot-comment auth coverage summarization to emit organic “missing-*” blockers even when
records.length === 0, while keeping overall status asno-datain pure no-record scenarios. - Sync
scripts/aggregate_agent_metrics.pyinto the consumer template and include it in.github/sync-manifest.yml; add a workflow regression test to prevent drift. - Add/adjust Node tests to cover the updated organic-evidence/no-auth-record behavior.
Reviewed changes
Copilot reviewed 6 out of 6 changed files in this pull request and generated no comments.
Show a summary per file
| File | Description |
|---|---|
tests/workflows/test_workflow_agents_consolidation.py |
Adds a regression test ensuring the weekly metrics aggregator script is referenced in workflows and present in the sync manifest + template. |
templates/consumer-repo/scripts/aggregate_agent_metrics.py |
Adds the aggregator script into the consumer template so sparse checkouts can run it. |
templates/consumer-repo/.github/scripts/bot_comment_auth_coverage.js |
Mirrors bot-comment auth organic-evidence contract tightening in the consumer template copy. |
.github/sync-manifest.yml |
Adds scripts/aggregate_agent_metrics.py to the consumer sync manifest. |
.github/scripts/bot_comment_auth_coverage.js |
Implements organic “missing evidence” blockers for the no-auth-record path and refines no-data blocker classification. |
.github/scripts/__tests__/bot-comment-auth-coverage.test.js |
Updates assertions to validate missing-organic blockers are emitted and carried into enforcement blockers even with zero auth records. |
Summary
Verification
Source queue items: stranske/Travel-Plan-Permission#895 and stranske/Template#582.