Skip to content

test(app): fix 4 first-run e2e specs left red by #11509's runtime-chip removal - #11656

Merged
lalalune merged 1 commit into
developfrom
fix/11509-stale-runtime-other-e2e-spec
Jul 2, 2026
Merged

test(app): fix 4 first-run e2e specs left red by #11509's runtime-chip removal#11656
lalalune merged 1 commit into
developfrom
fix/11509-stale-runtime-other-e2e-spec

Conversation

@lalalune

@lalalune lalalune commented Jul 2, 2026

Copy link
Copy Markdown
Member

What

PR #11509 ("clean two-option onboarding chooser", commit d534de09f3) removed the third runtime chip — runtime:other = "Bring your own keys" — from the in-chat first-run conductor, because it put an inference-provider concept on the runtime-location axis. But four packages/app/test/ui-smoke specs still assert that chip is visible, so they are guaranteed-red on develop:

  • runtime-configurability.spec.ts
  • first-run-startup.spec.ts
  • walkthrough/walkthrough-capture-smoke.spec.ts
  • walkthrough/journey.ts (journey step 02, onboarding-runtime)

Each now asserts the chip is absent (toHaveCount(0)) instead of visible. Stale header/expectation comments and the option list in IN_CHAT_ONBOARDING_DESIGN.md are corrected to the shipped Cloud / Local chooser.

Why it's correct

The live conductor seeds only two runtime chips — use-first-run-conductor.ts:108-113:

runtime:cloud=Eliza Cloud (managed)
runtime:local=On this device

BYOK stays reachable one step later as provider:other ("Other / configure in Settings"). The handler at use-first-run-conductor.ts:480 rejects any runtime id other than cloud|local, and the unit tests already assert a stale runtime:other pick is consumed as a no-op (use-first-run-conductor.test.ts:294, .fuzz.test.ts:157) — those are correct and left unchanged. This PR only aligns the e2e visibility assertions with that shipped behavior.

Testing

  • biome check clean on all 4 touched specs.
  • Grep confirms no remaining toBeVisible() / locator on choice-__first_run__:runtime:other anywhere in test/ui-smoke; the only remaining references are the new toHaveCount(0) absence checks and the correct no-op unit tests.
  • Full Playwright test:e2e run: N/A in this environment (needs a full app build + browser); the change is a pure test-assertion alignment to already-merged fix(first-run/runtime): clean two-option onboarding chooser + runtime/instance-management hardening #11509 behavior, and the assertion now matches the conductor source cited above. Reviewer CI exercises the specs.

Context

Surfaced by an on-device onboarding review: a Pixel 6a running a build from before #11509 merged still shows the old three-option chooser ("Bring your own keys"), which is a stale-build artifact — the fix is on develop but these specs were left red behind it.

Refs #11509

🤖 Generated with Claude Code

#11509)

PR #11509 removed the third runtime chip (`runtime:other` = "Bring your own
keys") from the in-chat onboarding conductor — it conflated the inference-
provider axis with the runtime-location axis. Four ui-smoke specs still asserted
that deleted chip is VISIBLE, so they are guaranteed-red on develop:
- runtime-configurability.spec.ts
- first-run-startup.spec.ts
- walkthrough/walkthrough-capture-smoke.spec.ts
- walkthrough/journey.ts (step 02)

Each now asserts the chip is absent (`toHaveCount(0)`) instead of visible, and
the stale header/expectation comments + the IN_CHAT_ONBOARDING_DESIGN.md option
list are corrected to the shipped Cloud/Local chooser. The conductor seeds only
runtime:cloud + runtime:local (use-first-run-conductor.ts:108-113); BYOK remains
reachable as provider:other one step later. The unit tests that assert a stale
runtime:other pick is consumed as a no-op are correct and left unchanged.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Your trial has ended. Reactivate Greptile to resume code reviews.

@coderabbitai

coderabbitai Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Important

Review skipped

Auto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 2f6b0e27-c753-4621-ac11-9c8a9b2b644d

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch fix/11509-stale-runtime-other-e2e-spec

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@lalalune
lalalune merged commit af4a026 into develop Jul 2, 2026
26 of 63 checks passed
@lalalune
lalalune deleted the fix/11509-stale-runtime-other-e2e-spec branch July 2, 2026 22:58
@claude

claude Bot commented Jul 3, 2026

Copy link
Copy Markdown
Contributor

Claude encountered an error —— View job


I'll analyze this and get back to you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants