Skip to content

fix(ci): make Registry Harness E2E executable - #783

Merged
ytallo merged 3 commits into
mainfrom
fix/harness-e2e-runs-input
Aug 12, 2026
Merged

fix(ci): make Registry Harness E2E executable#783
ytallo merged 3 commits into
mainfrom
fix/harness-e2e-runs-input

Conversation

@ytallo

@ytallo ytallo commented Aug 12, 2026

Copy link
Copy Markdown
Contributor

Summary

  • coerce the workflow_dispatch runs input to the numeric type required by the reusable workflow
  • load the scenario validator from the workflow revision while testing historical release source
  • serialize Registry provisioning to avoid parallel bootstrap overload

Validation

  • actionlint v1.7.12
  • Registry E2E run 31618785914 compiled the exact Harness release source and materialized the requested scenario matrix
  • the run installed the exact harness 1.8.1 Registry stack and then exposed the separate provider registration token mismatch

The E2E product result is intentionally not claimed as green: scored_runs remained 0 because provider registration failed before scenario execution.

Summary by CodeRabbit

  • Chores
    • Improved end-to-end workflow validation by using the validator from the workflow revision.
    • Updated registry end-to-end test execution to use JSON-based run configuration.
    • Limited registry end-to-end tests to a single parallel job for more consistent execution.

@vercel

vercel Bot commented Aug 12, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
workers Ready Ready Preview Aug 12, 2026 4:59pm
workers-tech-spec Ready Ready Preview Aug 12, 2026 4:59pm

Request Review

@github-actions

Copy link
Copy Markdown
Contributor

skill-check — worker

0 verified, 57 skipped (no docs/).

Layer Result
structure
vale
ai
render

Four for four. Nicely done.

@coderabbitai

coderabbitai Bot commented Aug 12, 2026

Copy link
Copy Markdown

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: 5f2fa06e-2a63-4ddd-b1d9-c28cfd064c95

📥 Commits

Reviewing files that changed from the base of the PR and between a6dfe06 and ad37dd0.

📒 Files selected for processing (2)
  • .github/workflows/_harness-e2e.yml
  • .github/workflows/harness-e2e-registry.yml

📝 Walkthrough

Walkthrough

The E2E build now validates scenarios with the validator from the workflow revision. The registry workflow passes a JSON-derived runs value and limits parallel execution to one job.

Changes

E2E workflow controls

Layer / File(s) Summary
Workflow-pinned scenario validation
.github/workflows/_harness-e2e.yml
The build job sparsely checks out the validator from github.sha and runs it from _workflow/.github/scripts.
Registry execution controls
.github/workflows/harness-e2e-registry.yml
The reusable workflow receives runs through JSON conversion and uses max_parallel: 1.

Estimated code review effort: 2 (Simple) | ~10 minutes

Possibly related PRs

Suggested labels: no-ticket

Poem

A rabbit checks the workflow trail,
With validator tucked in a pail.
One registry run hops through,
JSON guides what it must do.
Parallel paws now wait in line.

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly summarizes the main CI change: making the Registry Harness E2E workflow executable.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches 💡 1
🛠️ Fix failing CI checks 💡
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch fix/harness-e2e-runs-input

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@ytallo ytallo added the no-ticket PR deliberately has no Linear ticket (bump/typo/CI-only) label Aug 12, 2026
@ytallo
ytallo merged commit 67ba77d into main Aug 12, 2026
28 of 42 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

no-ticket PR deliberately has no Linear ticket (bump/typo/CI-only)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant