docs(#5372): add escalation ladder for core agent changes - #5373
Conversation
Add a prove-it escalation ladder that guides teams through least-invasive options before deriving or replacing a core agent role. The ladder defines four levels: 1. Configure — AGENTS.md, skills, env vars, harness extension points 2. Contribute — upstream the improvement to the default agent 3. Derive — inherit via base, replace identity-defining components 4. Replace — build a parallel agent from scratch Each level documents what evidence is needed to escalate. A prove-it checklist summarizes the requirements before creating derived or replacement agents. Cross-links added from default-vs-custom, bring-your-own-agent, customizing-agents, and building-custom-agents pages. Sidebar entry added under the Agents section in the VitePress config. Note: pre-commit could not run in sandbox (network error fetching hook repos). The post-script runs pre-commit authoritatively. Closes #5372
|
🤖 Finished Review · ✅ Success · Started 5:44 PM UTC · Completed 5:55 PM UTC |
Site previewPreview: https://892d39bd-site.fullsend-ai.workers.dev Commit: |
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
|
Looks good to me Previous runLooks good to me Labels: PR modifies only documentation files under docs/ and website config |
waynesun09
left a comment
There was a problem hiding this comment.
Automated 3-agent review-squad pass (claude-coder, claude-researcher, grok). 5 findings survived verification and cross-checking against the repo's own docs (1 HIGH, 4 MEDIUM) — no CRITICAL findings, and link/anchor integrity across the new page is otherwise clean. See inline comments for details.
Correct Level 3 merge-rule evidence, clarify Level 1 harness vs identity, mark the page Proposed pending #5372 agreement, note the vouch gate for Level 2 contributions, and document extending the sandbox image for the Level 1 link target. Signed-off-by: Adam Scerra <ascerra@redhat.com> Co-authored-by: Cursor <cursoragent@cursor.com>
|
🤖 Review · |
Resolve customizing-agents.md conflict: keep main's Configuration Examples rename and fix-role note, retain Extending the sandbox image subsection from the review fixes. Signed-off-by: Adam Scerra <ascerra@redhat.com> Co-authored-by: Cursor <cursoragent@cursor.com>
|
🤖 Finished Review · ✅ Success · Started 8:29 PM UTC · Completed 8:42 PM UTC |
|
🤖 Finished Review · ✅ Success · Started 1:14 PM UTC · Completed 1:32 PM UTC Commit: |
|
🤖 Finished Retro · ✅ Success · Started 1:28 PM UTC · Completed 1:46 PM UTC Commit: |
|
Review skipped — this PR is already merged. The Posted by fullsend post-review check |
Retro: PR #5373 — Escalation ladder docsTimeline: Issue #5372 was filed by ascerra on Jul 20. Triage (run 29763872347) and code (run 29764233222) agents processed it within 14 minutes, producing PR #5373 with a new Key finding: review quality gap. The review agent approved the PR while missing all 5 substantive findings the external review squad caught. The correctness sub-agent verified structural properties (anchors exist, identifiers match, specific technical claims match code) but did not verify semantic consistency within the new text. Three distinct failure modes:
Fix agent was not triggered. waynesun09's review was posted as COMMENTED (not CHANGES_REQUESTED), so the dispatch filter silently dropped it. The human fixed the issues manually 13 days later. This is already well-covered by existing issues: fullsend#5967 (dispatch filter), fullsend#3514 (processing human inline comments), and fullsend#3783 (triggerable from review comments). Evidence for existing issues:
No resource waste found. The failed dispatch on Aug 6 (run 31119802507) was a transient GitHub Actions CDN outage (503 Service Unavailable during action download). Post-merge review runs were correctly attributed to other PRs; concurrency groups are working as designed. Agents repo: Proposals filed
|
Summary
Add a prove-it escalation ladder that defines a structured path for teams to follow before deriving or replacing a core agent role (triage, code, review, fix, retro, prioritize). The ladder has four levels — configure, contribute, derive, replace — each with concrete evidence requirements for escalation.
Related Issue
Closes #5372
Changes
docs/agents/topics/escalation-ladder.mdwith four escalation levels, evidence requirements at each step, and a prove-it checklistdefault-vs-custom.md,bring-your-own-agent.md,customizing-agents.md, andbuilding-custom-agents.mdTesting
make lint— pre-commit could not run in sandbox (network error); post-script runs it authoritativelyChecklist
!for breaking changes)Closes #5372
Post-script verification
agent/5372-escalation-ladder)bf051001ad0ddc22d58e95d9d9b46d57e62e5b97..HEAD)