chore(web): #363 experiment, observe run creation for the baseline bot push - #748
chore(web): #363 experiment, observe run creation for the baseline bot push#748thomasluizon wants to merge 2 commits into
Conversation
Throwaway. This branch exists only to run #363's experiment: trigger a labeled re-seed and observe whether GitHub creates pull_request runs for the baseline commit the workflow's GITHUB_TOKEN pushes. Deleting one baseline guarantees the re-seed produces a non-empty staged diff, so the bot push actually happens rather than hitting the workflow's "Baselines already up to date" branch. This branch is deleted once the observation is recorded. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
The latest updates on your projects. Learn more about Vercel for GitHub. 1 Skipped Deployment
|
There was a problem hiding this comment.
✅ No new issues found.
Reviewed changes The review covered the deliberate visual-baseline deletion and the seed workflow behavior it triggers.
- Forced baseline seed — Removing the LFS-tracked login snapshot guarantees the labeled visual run recreates and stages that exact baseline, producing the bot push needed for the experiment.
- Throwaway scope — The PR clearly records that the deletion is experimental only and that the PR and branch are to be removed after the observation, not merged.
GPT Sol | 𝕏
Result recorded. Closing.The experiment answered the question. Full output is on Runs ARE created for the bot head, and held. So The operator step is to approve, verified live: Closing without merging, as stated when this was opened. The deleted baseline was only ever a device to force the bot push. |
|




Throwaway. Do not merge. It is closed and its branch deleted once the observation is recorded on
#363.What this is measuring
#363asks whether GitHub createspull_requestruns for the baseline commit thatvisual.ymlpushes with the workflow'sGITHUB_TOKEN.The comment at
.github/workflows/visual.yml:86says GitHub never starts runs for events that token causes, so the operator's next real push is what puts the 21 required contexts on the bot head. Pullfrog's review of #744 says GitHub documents an exception: aGITHUB_TOKENupdate to an existing pull request createssynchronizeruns held in an approval-required state.History could not settle it. The only bot baseline push that exists,
309967d4on #744, carried[skip ci], which suppresses run creation on its own. Nothing in that sample separates token suppression from marker suppression.Why it can be settled now
The current workflow no longer carries
[skip ci]. #744 removed it. So a re-seed run againstmainas it stands is exactly the clean experiment, with no workflow edit needed.The design
visual:updatelabel is applied at creation, soHAS_UPDATE_LABELis true and the first run seeds.#363's recorded constraint. Reading the branch would not separate token suppression from[skip ci]suppression.My head, the control:
acb3ebc0da51f9955057161159610ff2ecfe7f27.What is deliberately not tested
A checks re-run. GitHub re-runs retain the original run's
GITHUB_SHAandGITHUB_REF, so the contexts land on the pre-baseline SHA.#363records that constraint explicitly, and a re-run is never the correct operator step.