Conversation
Automated sync from stranske/Workflows Template hash: a3e3f6fa23d5 Changes synced from sync-manifest.yml
stranske
added
sync
stranske
added
sync
Contributor
Contributor
🤖 Keepalive Loop StatusPR #922 | Agent: Codex | Iteration 0/5 Current State
🔍 Failure Classification| Error type | infrastructure | |
Contributor
Keepalive Work Log (click to expand)
|
Contributor
There was a problem hiding this comment.
Pull request overview
Syncs workflow templates and supporting scripts from stranske/Workflows, primarily improving weekly metrics artifact handling/telemetry and expanding coverage/contract reporting across workflows.
Changes:
- Adds a weekly metrics artifact download manifest (JSON+Markdown) and updates weekly-metrics aggregation to emit a structured JSON contract alongside Markdown.
- Enhances terminal disposition coverage and verifier model compatibility reporting (unsupported models + missing model metadata) and extends terminal disposition normalization to carry model metadata.
- Updates bot-comment handler wrapper workflow to emit a review-thread terminal disposition artifact; updates bot-comment auth coverage and PR meta body updater behaviors.
Reviewed changes
Copilot reviewed 11 out of 11 changed files in this pull request and generated 1 comment.
Show a summary per file
| File | Description |
|---|---|
scripts/aggregate_agent_metrics.py |
Adds parse error details, artifact-family inference, verifier model metadata stats, and writes a JSON summary contract. |
.github/workflows/agents-weekly-metrics.yml |
Produces/records artifact download manifest; downloads into artifacts/<name>/<id>; uploads new JSON artifacts. |
.github/workflows/agents-bot-comment-handler.yml |
Exposes skip_reason and emits a wrapper terminal disposition artifact for coverage/telemetry. |
.github/workflows/agents-81-gate-followups.yml |
Uses compact JSON output for metrics payload (jq -cn). |
.github/scripts/weekly_metrics_download_manifest.js |
New helper to initialize/record/finalize a weekly artifact download manifest (JSON+Markdown). |
.github/scripts/weekly_metrics_artifacts.js |
Adds priority-family status reporting and includes missing-priority-family info in selection output/markdown. |
.github/scripts/terminal_disposition_coverage.js |
Adds verifier model compatibility checks and enriches artifact selection normalization with priority-family statuses and metadata. |
.github/scripts/terminal_disposition.js |
Extends terminal disposition records with llm_model, model_selection_reason, and verifier_mode. |
.github/scripts/coverage_monitor_summary.js |
New weekly “coverage monitor” summary contract (aggregates terminal + bot-auth coverage reports). |
.github/scripts/bot_comment_auth_coverage.js |
Tracks skipped/missing organic evidence requirements and supports wrapper decisions about reusable invocation expectations. |
.github/scripts/agents_pr_meta_update_body.js |
Writes an issue meta marker and adds Closes #<issue> when a source issue is detected. |
|
|
||
|
|
||
| def _unsupported_verifier_models() -> set[str]: | ||
| raw = os.environ.get("UNSUPPORTED_VERIFIER_MODELS", "") |
There was a problem hiding this comment.
The unsupported-model list is configured via UNSUPPORTED_VERIFIER_MODELS here, but the terminal-disposition coverage script uses TERMINAL_DISPOSITION_UNSUPPORTED_CODEX_MODELS. This makes it easy for the weekly metrics markdown/JSON and the coverage preflight to disagree when configuration is added. Consider accepting TERMINAL_DISPOSITION_UNSUPPORTED_CODEX_MODELS as an alias (or renaming to a shared env var) so both scripts use the same setting.
Suggested change
| raw = os.environ.get("UNSUPPORTED_VERIFIER_MODELS", "") | |
| raw = ( | |
| os.environ.get("UNSUPPORTED_VERIFIER_MODELS") | |
| or os.environ.get("TERMINAL_DISPOSITION_UNSUPPORTED_CODEX_MODELS") | |
| or "" | |
| ) |
This was referenced Apr 26, 2026
14 tasks
This was referenced Apr 26, 2026
17 tasks
This was referenced Apr 26, 2026
19 tasks
19 tasks
19 tasks
Owner
Author
|
Superseded by the latest Workflows sync lane #938; closing this older automated sync PR so review and CI focus on the canonical branch. |
19 tasks
This branch was previously deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Sync Summary
Files Updated
Files Skipped
Review Checklist
Source: stranske/Workflows
Manifest:
.github/sync-manifest.yml