chore: sync workflow templates - #612
Conversation
Automated sync from stranske/Workflows Template hash: fb60c1f4950b Changes synced from sync-manifest.yml
🤖 Keepalive Loop StatusPR #612 | Agent: Codex | Iteration 0/5 Current State
🔍 Failure Classification| Error type | infrastructure | |
Keepalive Work Log (click to expand)
|
There was a problem hiding this comment.
Pull request overview
Syncs updated workflow templates/scripts from stranske/Workflows, expanding weekly metrics collection/telemetry and adding new terminal-disposition + verifier follow-up ledger reporting.
Changes:
- Extend weekly metrics aggregation to emit a JSON contract, include parse-error details, infer artifact families, and summarize verifier model/ledger metadata.
- Add a download-manifest contract for weekly metrics artifacts and enrich artifact selection reporting (priority-family statuses).
- Enhance automation telemetry (wrapper terminal dispositions, keepalive actionable checklist counting, coverage monitor summary contract, setup-api-client setup contract).
Reviewed changes
Copilot reviewed 14 out of 14 changed files in this pull request and generated 13 comments.
Show a summary per file
| File | Description |
|---|---|
scripts/aggregate_agent_metrics.py |
Adds richer NDJSON parsing (with per-file parse error details), artifact/source inference, and outputs both markdown + JSON summary contracts including verifier/ledger/model metadata. |
.github/workflows/agents-weekly-metrics.yml |
Tracks artifact download/unzip outcomes via a manifest, sanitizes artifact dirs, and uploads the new JSON summary + manifest artifacts. |
.github/workflows/agents-verify-to-new-pr.yml |
Updates follow-up issue creation/telemetry, adds verifier follow-up ledger artifact, and modifies several uses: pins. |
.github/workflows/agents-bot-comment-handler.yml |
Emits/upload wrapper terminal disposition artifacts and exposes a skip_reason output for telemetry. |
.github/workflows/agents-81-gate-followups.yml |
Minor jq invocation change (-cn) for compact JSON output. |
.github/scripts/weekly_metrics_download_manifest.js |
New script to maintain a machine-readable download/unzip manifest + markdown summary. |
.github/scripts/weekly_metrics_artifacts.js |
Adds missing/priority family reporting to the artifact selection contract + markdown. |
.github/scripts/terminal_disposition_coverage.js |
Adds verifier model compatibility checks and surfaces priority-family statuses in coverage reporting/markdown. |
.github/scripts/terminal_disposition.js |
Adds verifier follow-up ledger normalization and expands terminal disposition optional fields (model, mode, reason). |
.github/scripts/keepalive_loop.js |
Changes checkbox counting to focus on actionable checklist items (filters status/placeholder entries). |
.github/scripts/coverage_monitor_summary.js |
New weekly coverage monitor “summary contract” that consolidates monitor statuses and next actions. |
.github/scripts/bot_comment_auth_coverage.js |
Adds optional wrapper/reusable invocation fields and richer missing/skipped organic-evidence requirement reporting. |
.github/scripts/agents_pr_meta_update_body.js |
Adjusts preamble generation to treat campaign issues differently (avoid “Closes” for campaign issues). |
.github/actions/setup-api-client/action.yml |
Adds a redacted setup_contract output describing auth/dependency state for downstream telemetry/debugging. |
| - name: Checkout repository | ||
| if: steps.check-merged.outputs.merged == 'true' | ||
| uses: actions/checkout@de0fac2e4500dabe0009e67214ff5f5447ce83dd # v6 | ||
| uses: actions/checkout@v6 |
There was a problem hiding this comment.
This step uses actions/checkout@v6 (floating tag). Please pin to the exact commit SHA (with a '# v6' comment) to match the repo’s workflow security/reproducibility convention.
| uses: actions/checkout@v6 | |
| uses: actions/checkout@08c6903cd8c0fde910a37f88322edcfb5dd907a8 # v6 |
| - name: Set up Python | ||
| if: steps.check-merged.outputs.merged == 'true' | ||
| uses: actions/setup-python@a309ff8b426b58ec0e2a45f0f869d46889d02405 # v6 | ||
| uses: actions/setup-python@v6 |
There was a problem hiding this comment.
This step uses actions/setup-python@v6 (floating tag). Please pin to a full commit SHA (with '# v6') as done elsewhere in this repo to avoid unreviewed upstream changes.
| uses: actions/setup-python@v6 | |
| uses: actions/setup-python@61a6322f88396a6271a6ee3565807d608ecaddd1 # v6 |
| steps.chain-check.outputs.exceeded != 'true' && | ||
| steps.extract-verdict.outputs.needs_human != 'true' | ||
| uses: actions/github-script@3a2844b7e9c422d3c10d287c895573f7108da1b3 # v9 | ||
| uses: actions/github-script@v9 |
There was a problem hiding this comment.
This step uses actions/github-script@v9 (floating tag). Please pin to a full commit SHA as used in other workflows in this repository.
| uses: actions/github-script@v9 | |
| uses: actions/github-script@60a0d83039c74a4aee543508d2ffcb1c3799cdea |
| steps.chain-check.outputs.exceeded != 'true' && | ||
| steps.extract-verdict.outputs.needs_human != 'true' | ||
| uses: actions/github-script@3a2844b7e9c422d3c10d287c895573f7108da1b3 # v9 | ||
| uses: actions/github-script@v9 |
There was a problem hiding this comment.
This step uses actions/github-script@v9 (floating tag). Please pin to an exact commit SHA to keep workflows reproducible and reduce supply-chain risk.
| steps.chain-check.outputs.exceeded != 'true' && | ||
| steps.extract-verdict.outputs.needs_human != 'true' | ||
| uses: actions/github-script@3a2844b7e9c422d3c10d287c895573f7108da1b3 # v9 | ||
| uses: actions/github-script@v9 |
There was a problem hiding this comment.
This step uses actions/github-script@v9 (floating tag). Please pin to a full commit SHA to avoid automatic updates to workflow behavior without review.
| id: collect | ||
| if: steps.check-merged.outputs.merged == 'true' | ||
| uses: actions/github-script@3a2844b7e9c422d3c10d287c895573f7108da1b3 # v9 | ||
| uses: actions/github-script@v9 |
There was a problem hiding this comment.
This step uses a floating action tag (actions/github-script@v9). Please pin to the action’s commit SHA (retain '# v9') to align with the repo’s pinned-actions workflow convention.
| uses: actions/github-script@v9 | |
| uses: actions/github-script@60a0d83039c74a4aee543508d2ffcb1c3799cdea # v9 |
| id: chain-check | ||
| if: steps.check-merged.outputs.merged == 'true' | ||
| uses: actions/github-script@3a2844b7e9c422d3c10d287c895573f7108da1b3 # v9 | ||
| uses: actions/github-script@v9 |
There was a problem hiding this comment.
This step uses a floating action tag (actions/github-script@v9). Please switch back to a full commit SHA pin to maintain workflow supply-chain hardening and consistency with other workflows in this repo.
| steps.chain-check.outputs.exceeded != 'true' && | ||
| steps.extract-verdict.outputs.needs_human == 'true' | ||
| uses: actions/github-script@3a2844b7e9c422d3c10d287c895573f7108da1b3 # v9 | ||
| uses: actions/github-script@v9 |
There was a problem hiding this comment.
This step uses actions/github-script@v9 (floating tag). Please pin to the specific commit SHA (keeping the major version comment) to match the repository’s action-pinning policy.
| steps.extract-verdict.outputs.needs_human != 'true' && | ||
| steps.create-issue.outputs.issue_number != '' | ||
| uses: actions/github-script@3a2844b7e9c422d3c10d287c895573f7108da1b3 # v9 | ||
| uses: actions/github-script@v9 |
There was a problem hiding this comment.
This step uses actions/github-script@v9 (floating tag). Please pin to the action commit SHA (with '# v9') to align with the pinned-actions convention across this repo’s workflows.
| - name: Remove trigger label | ||
| if: steps.check-merged.outputs.merged == 'true' | ||
| uses: actions/github-script@3a2844b7e9c422d3c10d287c895573f7108da1b3 # v9 | ||
| uses: actions/github-script@v9 |
There was a problem hiding this comment.
This step uses actions/github-script@v9 (floating tag). Please pin to a full commit SHA to match the repo’s workflow hardening convention and keep behavior reproducible.
Sync Summary
Files Updated
Files Skipped
Review Checklist
Source: stranske/Workflows
Manifest:
.github/sync-manifest.yml