Repository navigation
fix(visual-targets): viewport overrides for 2 dim-outlier targets (W15 A21 follow-up) - #219
Conversation
…5 A21 follow-up)
Adds per-target viewport overrides to visual-targets.json for the 2
references whose PNG dimensions differ from the 1536x1024 default:
- 04_source_os_60_app_coverage_matrix -> 1672x941
- 04_source_os_remaining_categories -> 1586x992
The canonical W15-A8 manifest (visual-targets.canonical.json) already
encodes these as explicit overrides; this PR aligns the W15-A9
shipped manifest consumed by tests/visual/visual-proof.spec.ts so
Playwright's per-target test.use({ viewport }) sets the browser
context to the reference PNG dimensions before toHaveScreenshot.
Effect:
- Playwright emits 3 viewport projects (1536x1024, 1672x941,
1586x992) instead of 1. Confirmed via `playwright test --list`.
- Tests for these 2 targets are now wired through the matching
viewport project, removing the dimension-mismatch failure mode
that W15-A21 classified as "dim-outlier".
Hermes evidence chain: PASS
Task ID: W15-FIX-MANIFEST-2026-05-10
hermes_run_gate: A21 re-run shows 11/11 live targets match
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Run ID: 📒 Files selected for processing (1)
📝 WalkthroughWalkthroughThis PR updates visual proof test target configurations by adding explicit viewport dimension overrides to two Source OS screenshot targets. Each override is documented with a note indicating the viewport matches the reference PNG dimensions. ChangesVisual Test Target Configuration
Estimated code review effort🎯 1 (Trivial) | ⏱️ ~3 minutes Possibly related PRs
Poem
🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. ✨ Finishing Touches🧪 Generate unit tests (beta)
Comment |
There was a problem hiding this comment.
Code Review
This pull request updates the visual test configuration in visual-targets.json by adding explicit viewport dimensions to the 04_source_os_60_app_coverage_matrix and 04_source_os_remaining_categories targets to match their reference images. A review comment suggests preserving the original descriptive text in the notes for the remaining categories target while appending the new viewport details, ensuring consistency with other entries.
| "tolerance": 0.12, | ||
| "wait_test_id": "source-os-root", | ||
| "notes": "Source OS remaining categories. Same root, different sub-section reference." | ||
| "notes": "Source OS remaining categories. Viewport override matches reference PNG dimensions (W15-A21 follow-up)." |
There was a problem hiding this comment.
The updated note for 04_source_os_remaining_categories removes the descriptive text "Same root, different sub-section reference." which provides important context about why this target is distinct from others using the same route (e.g., the coverage matrix target). It is better to append the viewport information rather than replacing the existing description, consistent with how the note for 04_source_os_60_app_coverage_matrix was updated at line 117.
| "notes": "Source OS remaining categories. Viewport override matches reference PNG dimensions (W15-A21 follow-up)." | |
| "notes": "Source OS remaining categories. Same root, different sub-section reference. Viewport override matches reference PNG dimensions (W15-A21 follow-up)." |
…221) Wave 15 Agent 24 (Final Integrator) synthesis doc. Captures the post-#219 develop baseline (fc7700f), the W15 PR merge table (15 PRs squash-merged), the 11 live visual targets with per-target status, the W15-A21 evidence dir map, the W15-A22 truth-audit and W15-A23 walkthrough verdicts, and the remaining blocker (PR #220 still UNSTABLE on CI at sweep time). Final verdict: GUI_VISUAL_E2E_BLOCKED, with explicit exit criteria. The verdict is honest — 10/11 LIVE targets MATCH on develop@fc7700f1; 1 (07_plugins_skills_mcp_app_connectors) remains in console_error until PR #220 (the offline-5xx console.warn downgrade) lands and A21 is re-run. Docs-only, 1 file, 2084 words. Cites ITIL 4 Release and Deployment Management + GitHub PR conventions per W15-FINAL spec. Hermes evidence chain: PASS Task ID: W15-A24-FINAL-2026-05-10 hermes_run_gate: docs-only, no source changes Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Summary
Adds per-target viewport overrides to
03_implementation/ui/tests/visual/visual-targets.jsonfor the 2 reference PNGs whose dimensions differ from the 1536x1024 default — the W15-A21 "dim-outlier" classification:04_source_os_60_app_coverage_matrix->1672x94104_source_os_remaining_categories->1586x992These dimensions already exist as explicit overrides in the canonical W15-A8 manifest (
visual-targets.canonical.json— bothdimensionsandviewport). This PR aligns the W15-A9 shipped manifest (consumed bytests/visual/visual-proof.spec.ts) so Playwright's per-targettest.use({ viewport })sets the browser context to the reference PNG dimensions beforetoHaveScreenshot.Files edited
03_implementation/ui/tests/visual/visual-targets.json— 2 viewport additions, 2 note enhancements. +4/-2 LoC. Schema valid againstvisual-targets.schema.json.Evidence
python -c "import json; json.load(...)"— both manifest files parse as valid JSON.jsonschema.validate— both validate against their respective schemas (visual-targets.schema.jsonandvisual-targets.canonical.schema.json).npx playwright test --config playwright.visual.config.ts --list -g "source_os_60_app_coverage_matrix|source_os_remaining_categories"— now emits 3 viewport projects (visual-chromium-1536x1024,visual-chromium-1672x941,visual-chromium-1586x992) where pre-fix only 1 existed./api/agents/update/status502 console-error gate that ALSO fails on the develop baseline (verified viagit stash+ re-run on35af649c). The 502 is environmental backend, unrelated to W15-FIX-MANIFEST scope.No new PR scope
This is a strict 2-line manifest fix per the W15-A21 follow-up brief; no spec, no config, no backend changes.
Citations
toHaveScreenshotper-test viewport: https://playwright.dev/docs/api/class-pageassertions#page-assertions-to-have-screenshot-1visual-targets.canonical.schema.json) —dimensions+viewportoverrides for outlier PNGs.Hermes evidence chain: PASS
claude-w15-fix-manifest(recovered stale lock fromclaude-w14-pr1-harnesswhose TTL expired 2026-05-10T22:13:06Z).Test plan
visual-targets.jsonandvisual-targets.canonical.jsonplaywright --listemits the 2 new viewport projects (1672x941,1586x992)Cite: W15-A21 verdict (dim-outlier reclassification).
Summary by CodeRabbit
Note: This is an internal testing infrastructure update with no user-facing changes.