Skip to content

Conversation

@christian-byrne
Copy link
Contributor

@christian-byrne christian-byrne commented May 30, 2025

Adds all setup necessary to use Playwright MCP with Claude Code. Run npm install then simply tell coding assistant to navigate to localhost:5173 and take a screenshot in order to verify some visual changes or iterate on browser tests. Example:

Selection_1447

┆Issue is synchronized with this Notion page by Unito

@christian-byrne christian-byrne requested review from a team as code owners May 30, 2025 17:44
@socket-security
Copy link

socket-security bot commented May 30, 2025

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff Package Supply Chain
Security
Vulnerability Quality Maintenance License
Updated@​playwright/​test@​1.45.1 ⏵ 1.52.01001001009980
Added@​executeautomation/​playwright-mcp-server@​1.0.59110010091100

View full report

@christian-byrne
Copy link
Contributor Author

christian-byrne commented May 30, 2025

Results of upgrading playwright version to 1.52.0

(and upgrading associated dev deps)

Test Failures

  • Can zoom in/out with ctrl+shift+vertical-drag: Test expection is different by 1 pixel
  • Can toggle link visibility: Test expection is different by 10 pixels
  • Can open properties panel: Test expectation is different by 738 pixels due to font change in properties panel node title

Artifact download URL

https://github.com/Comfy-Org/ComfyUI_frontend/actions/runs/15352514819/artifacts/3230579536

@christian-byrne christian-byrne added the New Browser Test Expectations New browser test screenshot should be set by github action label May 30, 2025
Copy link
Contributor

@webfiltered webfiltered left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice! Good to go once criteria are met:

  1. #4029 is resolved
  2. This is rebased
  3. Expectations commit reverted
    • Re-add label if still failing CI, and we can look again

@christian-byrne
Copy link
Contributor Author

christian-byrne commented May 31, 2025

The flaky tests have been resolved by #4031 and this has been rebased.

Thee three failing tests detailed in above comment still occur, but are simply due to bumping to new playwright version. 2/3 are <10 pixel differences and 1 is due to font changing in node title within litegraph properties panel. Going to re-add the label to update test expectations.

@christian-byrne christian-byrne added New Browser Test Expectations New browser test screenshot should be set by github action and removed New Browser Test Expectations New browser test screenshot should be set by github action labels May 31, 2025
@christian-byrne christian-byrne enabled auto-merge (squash) May 31, 2025 20:51
@christian-byrne christian-byrne disabled auto-merge May 31, 2025 20:51
@christian-byrne christian-byrne merged commit 86a7dd0 into main May 31, 2025
2 checks passed
@christian-byrne christian-byrne deleted the add-claude-command-2 branch May 31, 2025 20:51
webfiltered added a commit that referenced this pull request Jun 1, 2025
webfiltered added a commit that referenced this pull request Jun 1, 2025
lordTyrion pushed a commit to playbook3d/ComfyUI_frontend that referenced this pull request Jul 2, 2025
lordTyrion pushed a commit to playbook3d/ComfyUI_frontend that referenced this pull request Jul 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

New Browser Test Expectations New browser test screenshot should be set by github action

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants