fix(#1839): add technical doc accuracy to correctness sub-agent - #1840
Conversation
Site previewPreview: https://55e523de-site.fullsend-ai.workers.dev Commit: |
ReviewFindingsMedium
Low
Info
Previous runReviewFindingsMedium
Low
Info
|
|
/fs-fix |
Remove `docs/plans/` and `docs/` path references from SKILL.md dispatch rules and correctness.md guidance. The pr-review skill is deployed to repos with varying directory structures and cannot depend on fullsend-specific paths. Addresses review feedback on #1840 Signed-off-by: fullsend-fix <fullsend-code@users.noreply.github.com>
🔧 Fix agent — iteration 1 (human-triggered)Addressed all 3 review findings from ralphbean. Removed repo-specific path references (docs/plans/, docs/) from the generic pr-review skill's SKILL.md and correctness sub-agent definition. Fixed (3):
Tests: passed Updated by fullsend fix agent |
|
/fs-fix fix merge conflicts with latest main. |
ralphbean
left a comment
There was a problem hiding this comment.
LGTM — the docs/plans/ specificity is gone, guidance looks solid.
The correctness sub-agent was declaring "zero correctness surface area" on documentation-only PRs, even when those documents contained implementation plans with verifiable technical claims (algorithm descriptions, pseudocode, CLI flag semantics, API behavior claims). Human reviewers on PR #1804 found 9 confirmed technical accuracy issues that the bot missed. Changes: - Updated the correctness sub-agent definition to own technical accuracy in implementation plans and design documents, with specific evaluation guidance for algorithm logic, API/library behavior claims, design document alignment, internal consistency, and edge case correctness. - Updated SKILL.md section 3b to classify docs/plans/ files and technical documentation as having correctness surface area, ensuring the correctness sub-agent is dispatched for such PRs. - Added an implementation plan example to the dispatch table. Note: make lint could not run (sandbox Go toolchain permission error unrelated to these markdown-only changes). Pre-commit encountered the same infrastructure error (exit code 3). The post-script runs authoritative pre-commit on the runner. Closes #1839 Signed-off-by: fullsend-code <fullsend-code@users.noreply.github.com>
Remove `docs/plans/` and `docs/` path references from SKILL.md dispatch rules and correctness.md guidance. The pr-review skill is deployed to repos with varying directory structures and cannot depend on fullsend-specific paths. Addresses review feedback on #1840 Signed-off-by: fullsend-fix <fullsend-code@users.noreply.github.com>
c6c6702 to
3bdd71b
Compare
The correctness sub-agent was declaring "zero correctness surface area" on documentation-only PRs, even when those documents contained implementation plans with verifiable technical claims (algorithm descriptions, pseudocode, CLI flag semantics, API behavior claims). Human reviewers on PR #1804 found 9 confirmed technical accuracy issues that the bot missed.
Changes:
accuracy in implementation plans and design documents, with
specific evaluation guidance for algorithm logic, API/library
behavior claims, design document alignment, internal
consistency, and edge case correctness.
technical documentation as having correctness surface area,
ensuring the correctness sub-agent is dispatched for such PRs.
Note: make lint could not run (sandbox Go toolchain permission error unrelated to these markdown-only changes). Pre-commit encountered the same infrastructure error (exit code 3). The post-script runs authoritative pre-commit on the runner.
Closes #1839
Post-script verification
agent/1839-correctness-technical-docs)1088f9b74b9ed046b902bf25e6ce4204339c99ee..HEAD)