Skip to content

Repair wp/6.5 branch Actions: Remove the broken flaky-test-to-GitHub-issues reporting job - #135

Closed
desrosj wants to merge 1 commit into
fix-actions-6.5/fix-wp-env-debian-busterfrom
fix-actions-6.5/disable-flaky-test-issue-reporting
Closed

desrosj wants to merge 1 commit into
fix-actions-6.5/fix-wp-env-debian-busterfrom
fix-actions-6.5/disable-flaky-test-issue-reporting

Conversation

@desrosj

@desrosj desrosj commented Aug 31, 2026 •

Copy link
Copy Markdown
Owner

What?

Removes the report-to-issues job (display name "Report to GitHub") from end2end-test.yml on wp/6.5. Unlike wp/6.8 (#130), this branch has no merge-artifacts job or has-flaky-test-report output feeding it — e2e-puppeteer and e2e-playwright each upload a flaky-tests-report artifact directly, and report-to-issues depends on both directly (needs: [e2e-puppeteer, e2e-playwright], if: always()).

Why?

report-to-issues checks out live trunk before running packages/report-flaky-tests, rather than this frozen branch's own copy. Trunk retired the build:packages npm script this job calls, as part of migrating the action to run directly from TypeScript source via Node 24's native type-stripping (WordPress/gutenberg#81218) — the step will fail with npm error Missing script: "build:packages" the next time it actually runs (it's gated on steps.download_artifact.outcome == 'success', i.e. only when a test genuinely flakes, so it hasn't fired yet on this branch, but it's the identical failure mode already confirmed and fixed on wp/6.8 via #130).

Retrofitting the job to match trunk's current implementation was rejected: trunk's replacement is also a real product-policy change (flaky tests become PR-comments-only, no more GitHub issues filed), out of scope for a frozen, security-maintenance-only branch. Removing the job only drops an automated notification; no test-correctness signal depends on it. packages/report-flaky-tests is left in place, unused by any workflow on this branch — removing the package itself is optional cleanup out of scope here.

Use of AI Tools

This PR was created by Claude Code under my supervision. All code should be treated as AI-produced and not yet reviewed by a human until this PR is marked Ready for Review.

@desrosj
desrosj removed this pull request from stack #87 September 10, 2026 19:37
@desrosj
desrosj force-pushed the fix-actions-6.5/disable-flaky-test-issue-reporting branch from 682feca to c16692e Compare September 10, 2026 19:40
@desrosj
desrosj added this pull request to stack #190 September 10, 2026 19:40
@desrosj
desrosj force-pushed the fix-actions-6.5/disable-flaky-test-issue-reporting branch from c16692e to 3f49564 Compare September 11, 2026 00:04
@desrosj
desrosj force-pushed the fix-actions-6.5/disable-flaky-test-issue-reporting branch from 3f49564 to fdfeea7 Compare September 11, 2026 00:29
@desrosj
desrosj force-pushed the fix-actions-6.5/disable-flaky-test-issue-reporting branch from fdfeea7 to 275ddf5 Compare September 11, 2026 01:15
@desrosj
desrosj force-pushed the fix-actions-6.5/disable-flaky-test-issue-reporting branch from 275ddf5 to 20053c6 Compare September 11, 2026 02:19
@desrosj
desrosj force-pushed the fix-actions-6.5/disable-flaky-test-issue-reporting branch 2 times, most recently from 2be4e7e to 51acb23 Compare September 11, 2026 16:08
@desrosj
desrosj force-pushed the fix-actions-6.5/disable-flaky-test-issue-reporting branch 2 times, most recently from e1d6973 to 64da41b Compare September 13, 2026 02:50
@desrosj
desrosj force-pushed the fix-actions-6.5/disable-flaky-test-issue-reporting branch 2 times, most recently from 4ff569c to 53e82dc Compare September 14, 2026 17:37
…2end-test.yml`.

The `report-to-issues` job in `end2end-test.yml` (display name "Report
to GitHub") always does `actions/checkout ... ref: trunk`, so it builds
and runs live current trunk's `packages/report-flaky-tests` action,
never this frozen branch's own copy. Trunk has since retired the
`build:packages` npm script this job's "Npm build" step calls, as part
of migrating the action to run straight from TypeScript source via
Node 24's native type-stripping (WordPress#81218, "Flaky
tests: Report as a PR comment only, stop creating issues"). Trunk's
current `package.json` has no `build:packages` script at all, so the
step will fail with `npm error Missing script: "build:packages"` the
moment it actually executes.

That step is gated behind a successful `actions/download-artifact` for
a `flaky-tests-report` artifact that `e2e-puppeteer` and
`e2e-playwright` only produce when a test genuinely flakes (fails, then
passes on retry); no `merge-artifacts`-style job or
`has-flaky-test-report` output exists on this branch to gate it
instead. In every `end2end-test.yml` run checked across this branch's
CI history, that precondition hadn't been met recently, so this exact
failure hasn't shown up live yet here. The mechanism is nonetheless
current and confirmed directly against trunk's `package.json`, and will
fire the next time a genuinely flaky test occurs on this branch.

Retrofitting the job to match trunk's current implementation was
considered and rejected: trunk's replacement is also a real
product-policy change (flaky tests become PR-comments-only, no more
GitHub issues filed), which is out of scope for a frozen,
security-maintenance-only branch. Removing the job only drops an
automated notification; no test-correctness signal depends on it.
`packages/report-flaky-tests` is left in place, now unused by any
workflow on this branch; removing the package itself is optional
cleanup out of scope here.
@desrosj
desrosj force-pushed the fix-actions-6.5/disable-flaky-test-issue-reporting branch from 53e82dc to 897d399 Compare September 15, 2026 19:23
@desrosj
desrosj removed this pull request from stack #190 September 15, 2026 21:18
@desrosj
desrosj added this pull request to stack #376 September 15, 2026 21:22
@desrosj
desrosj marked this pull request as ready for review September 15, 2026 23:36
@github-actions

Copy link
Copy Markdown

The following accounts have interacted with this PR and/or linked issues. I will continue to update these lists as activity occurs. You can also manually ask me to refresh this list by adding the props-bot label.

If you're merging code through a pull request on GitHub, copy and paste the following into the bottom of the merge commit message.

Co-authored-by: desrosj <desrosj@git.wordpress.org>

To understand the WordPress project's expectations around crediting contributors, please review the Contributor Attribution page in the Core Handbook.

@desrosj

desrosj commented Sep 16, 2026

Copy link
Copy Markdown
Owner Author

Migrated to the real WordPress/gutenberg repository as WordPress#82996.

@desrosj desrosj closed this Sep 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant