Skip to content

test(transcript): Claude cohesion variant measures its turn's Worked for - #35410

Merged
teamleaderleo merged 3 commits into
feat-cmux-nextfrom
leo/fix-transcript-cohesion-red
Nov 4, 2026
Merged

teamleaderleo merged 3 commits into
feat-cmux-nextfrom
leo/fix-transcript-cohesion-red

Conversation

@teamleaderleo

@teamleaderleo teamleaderleo commented Nov 4, 2026 •

Copy link
Copy Markdown
Collaborator

Fixes the base red in webviews/test/transcript-cohesion.test.ts on feat-cmux-next (web / react-apps-base-check (2) reported "webview test red step (base): test/transcript-cohesion.test.ts", which then charged unrelated PRs such as #34881 with "claude keeps the activity rhythm (light)").

Regressing PR: #34774 ("a finished Claude turn folds under one Worked for, its runs inside"). It gave a finished Claude turn the same Worked for header Codex has, per Leo: "ofc claude code doesn't actually have the worked for... but i think we should be able to do that replacing the top level thingy maybe". #34607 had written the cohesion test while Claude still drew no header, so its claude variant asserted headers.count() === 0. The two landed about an hour apart and neither ran against the other, which left both claude keeps the activity rhythm tests failing on base (2 of 48 failed, reproduced at 6e9fc2c).

Fix: the test is stale against the settled design, so the test changes and the product code doesn't. The claude variant now goes through the same checks as codex-closed: a 22px header, a 16px gap to the reply, and 38.375 centre to centre (step-to-prose in design/transcript-spacing.md). The gallery note and header comment drop "no whole-turn Worked for". No spacing value changes.

Fleet run at this head: 48 pass, 0 fail (claude light/dark measured headerHeight 22, replyGap 16, replyCenterGap 38).

Agent session: agent session

🤖 Generated with Claude Code


Autofix with [code]smith
Open in [code]smith · Need help on this PR? Tag @codesmith-bot with what you need.


Summary by cubic

Fixes the stale transcript-cohesion test so the claude variant measures its turn's Worked for header instead of asserting none exists. PR #34774 folded finished Claude turns under the same header Codex has, which left this test red on feat-cmux-next.

  • Updates the claude variant to check the same 22px header and 16px reply gap as closed Codex.
  • Updates the gallery note to drop the "no whole-turn Worked for" wording. No product code or spacing values change.

Written for commit 8707f1d. Summary will update on new commits.

View guided diff Turn on auto-fix

#34774 folded a finished Claude turn under one Worked for, but
transcript-cohesion still asserted the Claude variant draws no header,
which left the file red on feat-cmux-next. The Claude variant now
checks the same 22px header and 16px reply gap as closed Codex.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Agent-Session: https://cmux.com/deeplink/agent?id=aid-82f54cd5a2280880c43b
@github-actions

github-actions Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

cmux status (one comment, edited in place; each line is updated by the job that owns it)

Review eb6204c: HQ feed card · gallery before/after runs · checks

App of this head (app.zip, kept 1 day)

gh workflow run reload-build.yml -R manaflow-ai/cmux --ref feat-cmux-next -f tag=pr35410 -f ref=leo/fix-transcript-cohesion-red -f platform=macos -f backend_mode=local

Gallery before/after for 8707f1d: 16 states rendered, 12 images differ, 1001 more touched states not rendered. Images are in the run's artifact, not on this public PR; the independent review of this head reads them on its own, so the PR needs no hand-made screenshots of these states.

gh run download 41847647711 -R manaflow-ai/cmux -n gallery-advisory-35410-8707f1dd1830ac8eb6e15d12905d3e4babc4c74f (then read gallery-review.json)

States
State Theme Status Diff Picked by
agent-pane.transcript-cohesion/live-peers Apple System Colors Light changed 0.0651% own TranscriptCohesion.gallery.ts
agent-pane.transcript-cohesion/live-peers Apple System Colors unchanged 0% own TranscriptCohesion.gallery.ts
agent-pane.transcript-cohesion/live-tools Apple System Colors Light unchanged 0% own TranscriptCohesion.gallery.ts
agent-pane.transcript-cohesion/live-tools Apple System Colors unchanged 0% own TranscriptCohesion.gallery.ts
agent-pane.transcript-cohesion/live-status Apple System Colors changed 0.119% own TranscriptCohesion.gallery.ts
agent-pane.transcript-cohesion/live-status Apple System Colors Light unchanged 0% own TranscriptCohesion.gallery.ts
agent-pane.transcript-cohesion/codex-closed Apple System Colors Light unchanged 0% own TranscriptCohesion.gallery.ts
agent-pane.transcript-cohesion/codex-closed Apple System Colors unchanged 0% own TranscriptCohesion.gallery.ts
agent-pane.transcript-cohesion/codex-open Apple System Colors Light changed 0% own TranscriptCohesion.gallery.ts
agent-pane.transcript-cohesion/codex-open Apple System Colors changed 0% own TranscriptCohesion.gallery.ts
agent-pane.transcript-cohesion/claude Apple System Colors Light unchanged 0% own TranscriptCohesion.gallery.ts
agent-pane.transcript-cohesion/claude Apple System Colors unchanged 0% own TranscriptCohesion.gallery.ts
agent-pane.access-offer/turn-no-credits Apple System Colors Light unchanged 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.access-offer/turn-no-credits Apple System Colors unchanged 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.access-offer/turn-low-credits Apple System Colors Light unchanged 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.access-offer/turn-low-credits Apple System Colors unchanged 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.access-offer/turn-no-offer Apple System Colors Light unchanged 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.access-offer/turn-no-offer Apple System Colors unchanged 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.acpmux-batch-send/batches Apple System Colors Light changed 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.acpmux-batch-send/batches Apple System Colors changed 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.acpmux-batch-send/batch-raw Apple System Colors Light changed 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.acpmux-batch-send/batch-raw Apple System Colors changed 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.acpmux-batch-send/loop-eight Apple System Colors Light unchanged 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.acpmux-batch-send/loop-eight Apple System Colors unchanged 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.acpmux-batch-send/loop-eight-open Apple System Colors Light changed 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.acpmux-batch-send/loop-eight-open Apple System Colors changed 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.acpmux-batch-send/batch-sending Apple System Colors Light unchanged 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.acpmux-batch-send/batch-sending Apple System Colors unchanged 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.activity-line-looks/none Apple System Colors Light unchanged 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.activity-line-looks/none Apple System Colors unchanged 0% same-folder TranscriptCohesion.gallery.ts
agent-pane.activity-line-looks/spinner Apple System Colors Light changed 0.0483% same-folder TranscriptCohesion.gallery.ts
agent-pane.activity-line-looks/spinner Apple System Colors changed 0.0476% same-folder TranscriptCohesion.gallery.ts

Pick other states with a Gallery: entry.id, entry.id/variant line in the PR body.

Passes: CI passes on 8707f1dd18.

CI passes on 8707f1dd18 (run 41847649098 attempt 1).

Written by scripts/ci/classify_failures.py (ci-failure-attribution.yml); signatures are its SIGNATURES table. A machine verdict is the runner's fault, not this PR's; yours means the failing file is one this PR changes, also red on main that main's latest full suite fails the same way, seen on other PRs that it failed on another pull request's run lately.

web and size checks: green

Shipped in:

@teamleaderleo

Copy link
Copy Markdown
Collaborator Author

Owned by an agent session · session

@github-actions github-actions Bot added the risk:normal Risk tier (docs/ci/risk-tiers.md) label Nov 4, 2026
@teamleaderleo

Copy link
Copy Markdown
Collaborator Author

Review (codex, router-review): SHIP at eb6204c

Reviewer: codex gpt-6.1-sol xhigh, fast tier.

Follow-ups: 1. They land as checklist items in this PR's one follow-up tracking issue in this repo (Follow-ups: #N ..., label follow-up; add to an open one before filing, never one issue per finding), linking this receipt; the lane that opened the PR fixes them forward.

SHIP at eb6204c

Visual verdict: no images; Leo tries the build

  • [P2] [follow-up] [category:ux] [finding:F1] [outcome:pending] No after screenshots were supplied, so visual comparison remains unverified.

Follow-ups: F1.

@teamleaderleo

Copy link
Copy Markdown
Collaborator Author

Finding outcome: comment-6631604013/F1 dismissed test-only change; the rendered UI is unchanged and screenshots never block (the fleet run's measured geometry is in the body).

@blacksmith-sh

blacksmith-sh Bot commented Nov 4, 2026 •

Copy link
Copy Markdown

Found 3 test failures on Blacksmith runners:

Failures

Test View Logs
nightly cmux-tui resolve/nightly cmux-tui resolve View Logs
nightly.yml must not read vars.NIGHTLY_SIGN while nightly-sign.yml is in shadow mode/
nightly.yml must not read vars.NIGHTLY_SIGN while nightly-sign.yml is in shadow mode
View Logs
the short nightly decide gate must use the pooled Linux route with a Blacksmith fallbac
k/
the short nightly decide gate must use the pooled Linux route with a Blacksmith fallbac
k
View Logs

Fix with [code]smith
Need help on this PR? Tag @codesmith-bot with what you need.

cmux-bot[bot]
cmux-bot Bot previously approved these changes Nov 4, 2026

@cmux-bot cmux-bot Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cmux-bot approves eb6204c: an independent review passed this exact head (router-review receipt by teamleaderleo). A push needs a new review; a later BLOCK at this head dismisses this approval.

@cmux-bot
cmux-bot Bot dismissed their stale review November 4, 2026 13:44

A newer verdict blocks 443045e (no independent SHIP at the head).

@teamleaderleo

Copy link
Copy Markdown
Collaborator Author

Review (codex, router-review): SHIP at 443045e

Reviewer: codex gpt-6-astra high, fast tier.

Follow-ups: 1. They land as checklist items in this PR's one follow-up tracking issue in this repo (Follow-ups: #N ..., label follow-up; add to an open one before filing, never one issue per finding), linking this receipt; the lane that opened the PR fixes them forward.

SHIP at 443045e

Visual verdict: no images; Leo tries the build

  • [P2] [follow-up] [category:ux] [finding:F1] [outcome:pending] webviews/src/agent-session/acpmux/conversation/TranscriptCohesion.gallery.ts:93: no after gallery stills were available for visual comparison.

Follow-ups:

  • [finding:F1] Capture and review the updated gallery state when the artifact is available.

cmux-bot[bot]
cmux-bot Bot previously approved these changes Nov 4, 2026

@cmux-bot cmux-bot Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cmux-bot approves 443045e: an independent review passed this exact head (router-review receipt by teamleaderleo). A push needs a new review; a later BLOCK at this head dismisses this approval.

@cmux-bot
cmux-bot Bot dismissed their stale review November 4, 2026 14:29

A newer verdict blocks 8707f1d (no independent SHIP at the head).

@teamleaderleo

Copy link
Copy Markdown
Collaborator Author

Review (codex, router-review): SHIP at 8707f1d

Reviewer: codex gpt-6-astra high, fast tier.

Follow-ups: 1. They land as checklist items in this PR's one follow-up tracking issue in this repo (Follow-ups: #N ..., label follow-up; add to an open one before filing, never one issue per finding), linking this receipt; the lane that opened the PR fixes them forward.

SHIP at 8707f1d
Visual verdict: no images; Leo tries the build

Follow-ups:

  • [P2] [follow-up] [category:tooling] [finding:F1] [outcome:pending] No gallery stills were produced for this head, so visual comparison remains unverified.

@cmux-bot cmux-bot Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cmux-bot approves 8707f1d: an independent review passed this exact head (router-review receipt by teamleaderleo). A push needs a new review; a later BLOCK at this head dismisses this approval.

@teamleaderleo

Copy link
Copy Markdown
Collaborator Author

For awareness: #35537 makes a finished Claude turn draw no whole-turn Worked for by default again, which follows leo-workspace#3287 (Leo: "you can't do it for Claude ... it's just too lossy if you do it for Claude"). The fold #35113/#34774 gave Claude is now an opt-in, the claude-turn-fold experiment. With #35537 applied, webviews/test/transcript-cohesion.test.ts passes as written on base (48/48, claude asserts no header). That means this PR's change to the claude variant, which measures a 22px Worked for header, would fail once #35537 lands. I haven't pushed anything here.

@teamleaderleo
teamleaderleo merged commit b659812 into feat-cmux-next Nov 4, 2026
211 of 215 checks passed
@teamleaderleo
teamleaderleo deleted the leo/fix-transcript-cohesion-red branch November 4, 2026 15:09
@teamleaderleo

Copy link
Copy Markdown
Collaborator Author

Finding outcome: comment-6633355342/F1 dismissed test-only change with no rendered UI change; the fleet run's measured geometry is in the body.

teamleaderleo added a commit that referenced this pull request Nov 4, 2026
…ked for again (undoes #35410's expectation)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Agent-Session: https://cmux.com/deeplink/agent?id=aid-92fa78a91e29868c5eaa
teamleaderleo added a commit that referenced this pull request Nov 4, 2026
…its version, plus the 480 s file limit

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Agent-Session: https://cmux.com/deeplink/agent?id=aid-fb75b7af9902231028aa
cmux-bot Bot pushed a commit that referenced this pull request Nov 4, 2026
…-turn Worked for is an opt-in (#35537)

* Agent pane: a finished Claude turn keeps its runs in place; its whole-turn Worked for is an opt-in

Leo (2026-11-04): "you can't do it for Claude ... it's just too lossy if you do it for Claude".
The claude row of TURN_FOLD_STYLES stops folding a whole turn; the Worked for fold #35113 made
Claude's default is the opt-in arm of a new claude-turn-fold experiment. The tests and gallery
plays #34774 moved to Claude's Worked for go back to its per-run lines. Codex, Gemini and Muse
are unchanged.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Agent-Session: https://cmux.com/deeplink/agent?id=aid-92fa78a91e29868c5eaa

* gallery: the per-harness fold entry covers the rows it draws

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Agent-Session: https://cmux.com/deeplink/agent?id=aid-92fa78a91e29868c5eaa

* test: a finished Claude turn of the send loop draws its run in place, no Worked for

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Agent-Session: https://cmux.com/deeplink/agent?id=aid-92fa78a91e29868c5eaa

* test(transcript): the Claude cohesion variant draws no whole-turn Worked for again (undoes #35410's expectation)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Agent-Session: https://cmux.com/deeplink/agent?id=aid-92fa78a91e29868c5eaa

---------

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>

This branch was previously deployed

1 inactive deployment
ci-routing-agent — 8707f1dd Deployed Nov 4, 2026 by teamleaderleo via wait for same-key tree publisher #112030
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

risk:normal Risk tier (docs/ci/risk-tiers.md)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant