Skip to content

Conversation

microsoft-playwright-automation[bot]
Copy link
Contributor

@microsoft-playwright-automation microsoft-playwright-automation bot commented Sep 9, 2025

Regressions

page/page-event-console.spec.ts:130 › should trigger correct Log

  1) [chromium-page] › tests/page/page-event-console.spec.ts:130:3 › should trigger correct Log ────

    Error: expect(received).toContain(expected) // indexOf

    Expected substring: "Access-Control-Allow-Origin"
    Received string:    "Access to fetch at 'http://localhost:8907/empty.html' from origin 'null' has been blocked by CORS policy: The request client is not a secure context and the resource is in more-private address space `loopback`."

      135 |     page.evaluate(async url => fetch(url).catch(e => {}), server.EMPTY_PAGE)
      136 |   ]);
    > 137 |   expect(message.text()).toContain('Access-Control-Allow-Origin');
          |                          ^
      138 |   expect(message.type()).toEqual('error');
      139 | });
      140 |
        at /workspaces/playwright/tests/page/page-event-console.spec.ts:137:26

  1 failed

Bisect RANGE: https://chromium.googlesource.com/chromium/src/+log/8830c7b23bb2769bb55cd57bff9b94fb025b2f5d..aa32c3e01de3ce013ad2a29d2112370ae0984aa3
Suspect: https://chromium.googlesource.com/chromium/src/+/8eb52611bcb7d11aae6884aeda43b5290e9f0f3c

Action: Rebase?

page/page-route.spec.ts:515 › should work with encoded server


  1) [chromium-page] › tests/page/page-route.spec.ts:515:3 › should work with encoded server - 2 ───

    TypeError: Cannot read properties of null (reading 'status')

      527 |   else
      528 |     expect(requests.length).toBe(1);
    > 529 |   expect((await requests[0].response()).status()).toBe(404);
          |                                         ^
      530 | });
      531 |
      532 | it('should not throw "Invalid Interception Id" if the request was cancelled', async ({ page, server }) => {
        at /workspaces/playwright/tests/page/page-route.spec.ts:529:41

  1 failed
    [chromium-page] › tests/page/page-route.spec.ts:515:3 › should work with encoded server - 2 ─

Bisect RANGE: https://chromium.googlesource.com/chromium/src/+log/8830c7b23bb2769bb55cd57bff9b94fb025b2f5d..aa32c3e01de3ce013ad2a29d2112370ae0984aa3
Suspect: https://chromium.googlesource.com/chromium/src/+/8eb52611bcb7d11aae6884aeda43b5290e9f0f3c

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

@mxschmitt mxschmitt added CQ1 and removed CQ1 labels Sep 11, 2025
Copy link
Contributor

Test results for "tests 1"

2 failed
❌ [firefox-page] › page/page-route.spec.ts:515 › should work with encoded server - 2 @firefox-ubuntu-22.04-node18
❌ [playwright-test] › ui-mode-test-output.spec.ts:80 › should show console messages for test @ubuntu-latest-node18-1

5 flaky ⚠️ [chromium-library] › library/popup.spec.ts:258 › should not throw when click closes popup `@chromium-ubuntu-22.04-node22`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-ubuntu-22.04-node18`
⚠️ [firefox-page] › page/page-wait-for-function.spec.ts:104 › should work with strict CSP policy `@firefox-ubuntu-22.04-node18`
⚠️ [installation tests] › playwright-electron-should-work.spec.ts:21 › electron should work `@package-installations-macos-latest`
⚠️ [chromium-library] › library/chromium/oopif.spec.ts:374 › should allow to re-connect to OOPIFs with CDP when iframes were there already `@ubuntu-22.04-chromium-tip-of-tree`

46813 passed, 821 skipped


Merge workflow run.

Copy link
Contributor

Test results for "tests 2"

29 failed
❌ [chromium-library] › library/headful.spec.ts:252 › should click bottom row w/ infobar in OOPIF @channel-chromium-macos-latest
❌ [chromium-library] › library/inspector/cli-codegen-3.spec.ts:672 › cli codegen › should consume contextmenu events, despite a custom context menu @channel-chromium-windows-latest
❌ [chromium-library] › library/headful.spec.ts:252 › should click bottom row w/ infobar in OOPIF @chrome-beta-macos-latest
❌ [chromium-library] › library/inspector/cli-codegen-3.spec.ts:672 › cli codegen › should consume contextmenu events, despite a custom context menu @chrome-beta-windows-latest
❌ [chromium-library] › library/headful.spec.ts:252 › should click bottom row w/ infobar in OOPIF @chrome-macos-latest
❌ [chromium-library] › library/inspector/cli-codegen-3.spec.ts:672 › cli codegen › should consume contextmenu events, despite a custom context menu @chrome-windows-latest
❌ [chromium-library] › library/inspector/cli-codegen-3.spec.ts:672 › cli codegen › should consume contextmenu events, despite a custom context menu @chromium-headed-windows-latest
❌ [chromium-library] › library/inspector/cli-codegen-3.spec.ts:672 › cli codegen › should consume contextmenu events, despite a custom context menu @chromium-tip-of-tree-windows-latest
❌ [chromium-library] › library/inspector/cli-codegen-3.spec.ts:672 › cli codegen › should consume contextmenu events, despite a custom context menu @chromium-tip-of-tree-windows-latest--headed
❌ [chromium-library] › library/inspector/cli-codegen-3.spec.ts:672 › cli codegen › should consume contextmenu events, despite a custom context menu @chromium-windows-latest
❌ [firefox-page] › page/page-route.spec.ts:515 › should work with encoded server - 2 @firefox-beta-macos-latest
❌ [firefox-page] › page/page-route.spec.ts:515 › should work with encoded server - 2 @firefox-beta-ubuntu-22.04
❌ [firefox-page] › page/page-route.spec.ts:515 › should work with encoded server - 2 @firefox-beta-windows-latest
❌ [firefox-page] › page/page-route.spec.ts:515 › should work with encoded server - 2 @firefox-headed-macos-14-xlarge
❌ [firefox-page] › page/page-route.spec.ts:515 › should work with encoded server - 2 @firefox-headed-ubuntu-24.04
❌ [firefox-page] › page/page-route.spec.ts:515 › should work with encoded server - 2 @firefox-headed-windows-latest
❌ [firefox-page] › page/page-route.spec.ts:515 › should work with encoded server - 2 @firefox-macos-13-large
❌ [firefox-page] › page/page-route.spec.ts:515 › should work with encoded server - 2 @firefox-macos-13-xlarge
❌ [firefox-page] › page/page-route.spec.ts:515 › should work with encoded server - 2 @firefox-macos-14-large
❌ [firefox-page] › page/page-route.spec.ts:515 › should work with encoded server - 2 @firefox-macos-14-xlarge
❌ [firefox-page] › page/page-route.spec.ts:515 › should work with encoded server - 2 @firefox-ubuntu-24.04
❌ [firefox-page] › page/page-route.spec.ts:515 › should work with encoded server - 2 @firefox-windows-latest
❌ [chromium-library] › library/headful.spec.ts:252 › should click bottom row w/ infobar in OOPIF @msedge-beta-macos-latest
❌ [chromium-library] › library/headful.spec.ts:252 › should click bottom row w/ infobar in OOPIF @msedge-dev-macos-latest
❌ [chromium-library] › library/inspector/cli-codegen-3.spec.ts:672 › cli codegen › should consume contextmenu events, despite a custom context menu @msedge-dev-windows-latest
❌ [chromium-library] › library/headful.spec.ts:252 › should click bottom row w/ infobar in OOPIF @msedge-macos-latest
❌ [chromium-library] › library/inspector/cli-codegen-3.spec.ts:672 › cli codegen › should consume contextmenu events, despite a custom context menu @msedge-windows-latest
❌ [firefox-page] › page/page-route.spec.ts:515 › should work with encoded server - 2 @tracing-firefox
❌ [webkit-library] › library/video.spec.ts:378 › screencast › should capture navigation @webkit-macos-15-large

82 flaky ⚠️ [chromium-library] › library/chromium/oopif.spec.ts:374 › should allow to re-connect to OOPIFs with CDP when iframes were there already `@channel-chromium-macos-latest`
⚠️ [chromium-library] › library/multiclient.spec.ts:63 › should connect two clients `@channel-chromium-macos-latest`
⚠️ [chromium-library] › library/trace-viewer.spec.ts:1179 › should update highlight when typing locator `@channel-chromium-macos-latest`
⚠️ [chromium-library] › library/video.spec.ts:378 › screencast › should capture navigation `@channel-chromium-macos-latest`
⚠️ [chromium-page] › page/page-network-request.spec.ts:478 › should not allow to access frame on popup main request `@channel-chromium-macos-latest`
⚠️ [chromium-page] › page/workers.spec.ts:25 › Page.workers @smoke `@channel-chromium-macos-latest`
⚠️ [chromium-library] › library/chromium/oopif.spec.ts:374 › should allow to re-connect to OOPIFs with CDP when iframes were there already `@channel-chromium-ubuntu-latest`
⚠️ [chromium-library] › library/popup.spec.ts:258 › should not throw when click closes popup `@channel-chromium-ubuntu-latest`
⚠️ [chromium-library] › library/browsercontext-pages.spec.ts:142 › should keep selection in multiple pages `@chrome-beta-macos-latest`
⚠️ [chromium-library] › library/chromium/chromium.spec.ts:707 › should throw when connecting twice to an already running persistent context (--remote-debugging-port) `@chrome-beta-macos-latest`
⚠️ [chromium-library] › library/permissions.spec.ts:244 › should be able to use the local-fonts API `@chrome-beta-macos-latest`
⚠️ [chromium-page] › page/workers.spec.ts:271 › should support extra http headers `@chrome-beta-macos-latest`
⚠️ [chromium-library] › library/video.spec.ts:206 › screencast › should continue recording main page after popup closes `@chrome-macos-latest`
⚠️ [chromium-page] › page/workers.spec.ts:150 › should report network activity `@chrome-macos-latest`
⚠️ [chromium-library] › library/chromium/oopif.spec.ts:374 › should allow to re-connect to OOPIFs with CDP when iframes were there already `@chromium-headed-macos-14-xlarge`
⚠️ [chromium-page] › page/page-mouse.spec.ts:244 › should tween mouse movement `@chromium-headed-windows-latest`
⚠️ [chromium-library] › library/chromium/oopif.spec.ts:374 › should allow to re-connect to OOPIFs with CDP when iframes were there already `@chromium-macos-13-xlarge`
⚠️ [chromium-library] › library/video.spec.ts:795 › screencast › should work with video+trace `@chromium-macos-13-xlarge`
⚠️ [chromium-page] › page/workers.spec.ts:25 › Page.workers @smoke `@chromium-tip-of-tree-macos-13`
⚠️ [chromium-page] › page/workers.spec.ts:150 › should report network activity `@chromium-tip-of-tree-macos-13`
⚠️ [chromium-page] › page/workers.spec.ts:271 › should support extra http headers `@chromium-tip-of-tree-macos-13`
⚠️ [chromium-library] › library/chromium/oopif.spec.ts:374 › should allow to re-connect to OOPIFs with CDP when iframes were there already `@chromium-tip-of-tree-macos-13--headed`
⚠️ [chromium-library] › library/browsercontext-reuse.spec.ts:270 › reuse connect › should reset mouse position `@chromium-tip-of-tree-ubuntu-22.04--headed`
⚠️ [chromium-library] › library/inspector/cli-codegen-1.spec.ts:120 › cli codegen › should type after clicking twice `@chromium-tip-of-tree-ubuntu-22.04--headed`
⚠️ [chromium-library] › library/trace-viewer.spec.ts:476 › should show snapshot URL `@chromium-tip-of-tree-ubuntu-22.04--headed`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-beta-macos-latest`
⚠️ [firefox-page] › page/page-wait-for-function.spec.ts:104 › should work with strict CSP policy `@firefox-beta-macos-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-beta-ubuntu-22.04`
⚠️ [firefox-page] › page/page-event-request.spec.ts:182 › should return response body when Cross-Origin-Opener-Policy is set `@firefox-beta-ubuntu-22.04`
⚠️ [firefox-page] › page/page-goto.spec.ts:83 › should work with Cross-Origin-Opener-Policy `@firefox-beta-ubuntu-22.04`
⚠️ [firefox-library] › library/browsercontext-cookies.spec.ts:378 › should parse cookie with large Max-Age correctly `@firefox-beta-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-beta-windows-latest`
⚠️ [firefox-library] › library/capabilities.spec.ts:244 › requestFullscreen `@firefox-headed-macos-14-xlarge`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-headed-macos-14-xlarge`
⚠️ [firefox-library] › library/browsercontext-basic.spec.ts:36 › should be able to click across browser contexts `@firefox-headed-ubuntu-24.04`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-headed-ubuntu-24.04`
⚠️ [firefox-page] › page/page-event-request.spec.ts:182 › should return response body when Cross-Origin-Opener-Policy is set `@firefox-headed-ubuntu-24.04`
⚠️ [firefox-library] › library/browsercontext-basic.spec.ts:36 › should be able to click across browser contexts `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/browsertype-connect.spec.ts:174 › launchServer › should ignore page.pause when headed `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-3.spec.ts:492 › cli codegen › should generate getByTestId `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-aria.spec.ts:63 › should inspect aria snapshot `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-csharp.spec.ts:195 › should not print context options method override in nunit if no options were passed `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/trace-viewer.spec.ts:1357 › should highlight locator in iframe while typing `@firefox-headed-windows-latest`
⚠️ [firefox-page] › page/page-wait-for-function.spec.ts:104 › should work with strict CSP policy `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-macos-13-large`
⚠️ [firefox-page] › page/page-wait-for-function.spec.ts:104 › should work with strict CSP policy `@firefox-macos-13-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-macos-13-xlarge`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-macos-14-large`
⚠️ [firefox-page] › page/page-wait-for-function.spec.ts:104 › should work with strict CSP policy `@firefox-macos-14-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-macos-14-xlarge`
⚠️ [firefox-library] › library/inspector/cli-codegen-aria.spec.ts:76 › should update aria snapshot highlight `@firefox-macos-14-xlarge`
⚠️ [firefox-page] › page/page-goto.spec.ts:83 › should work with Cross-Origin-Opener-Policy `@firefox-macos-14-xlarge`
⚠️ [firefox-page] › page/page-wait-for-function.spec.ts:104 › should work with strict CSP policy `@firefox-macos-14-xlarge`
⚠️ [firefox-library] › library/capabilities.spec.ts:102 › should support webgl @smoke `@firefox-ubuntu-24.04`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-ubuntu-24.04`
⚠️ [firefox-library] › library/browsercontext-cookies.spec.ts:378 › should parse cookie with large Max-Age correctly `@firefox-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-windows-latest`
⚠️ [chromium-library] › library/browsercontext-fetch.spec.ts:789 › should throw informative error on corrupted gzip body `@msedge-beta-macos-latest`
⚠️ [chromium-library] › library/browsercontext-reuse.spec.ts:150 › reuse launch › should reset serviceworker that hangs in importScripts `@msedge-dev-macos-latest`
⚠️ [chromium-library] › library/browsercontext-reuse.spec.ts:150 › reuse connect › should reset serviceworker that hangs in importScripts `@msedge-dev-macos-latest`
⚠️ [chromium-library] › library/debug-controller.spec.ts:414 › should not work with browser._launchServer(_debugController: false) `@msedge-dev-macos-latest`
⚠️ [chromium-library] › library/browsercontext-proxy.spec.ts:103 › should set cookie for top-level domain `@msedge-dev-windows-latest`
⚠️ [chromium-library] › library/browsercontext-reuse.spec.ts:114 › reuse launch › should reset serviceworker `@msedge-macos-latest`
⚠️ [chromium-library] › library/browsercontext-reuse.spec.ts:355 › reuse launch › should work with routeWebSocket `@msedge-macos-latest`
⚠️ [chromium-library] › library/video.spec.ts:579 › screencast › should capture static page in persistent context @smoke `@msedge-macos-latest`
⚠️ [chromium-page] › page/workers.spec.ts:271 › should support extra http headers `@msedge-macos-latest`
⚠️ [chromium-library] › library/browsercontext-proxy.spec.ts:103 › should set cookie for top-level domain `@msedge-windows-latest`
⚠️ [firefox-page] › page/page-wait-for-function.spec.ts:104 › should work with strict CSP policy `@tracing-firefox`
⚠️ [webkit-page] › page/wheel.spec.ts:70 › should dispatch wheel events after context menu was opened `@webkit-headed-macos-14-xlarge`
⚠️ [webkit-library] › library/inspector/cli-codegen-1.spec.ts:290 › cli codegen › should not target selector preview by text regexp `@webkit-headed-ubuntu-22.04`
⚠️ [webkit-library] › library/inspector/cli-codegen-3.spec.ts:74 › cli codegen › should click locator.nth `@webkit-headed-ubuntu-22.04`
⚠️ [webkit-library] › library/inspector/cli-codegen-3.spec.ts:718 › cli codegen › should generate hover action `@webkit-headed-ubuntu-22.04`
⚠️ [webkit-page] › page/page-click.spec.ts:251 › should click on checkbox input and toggle `@webkit-headed-ubuntu-24.04`
⚠️ [webkit-library] › library/browsercontext-reuse.spec.ts:114 › reuse launch › should reset serviceworker `@webkit-headed-windows-latest`
⚠️ [webkit-library] › library/inspector/cli-codegen-3.spec.ts:492 › cli codegen › should generate getByTestId `@webkit-headed-windows-latest`
⚠️ [webkit-library] › library/inspector/cli-codegen-3.spec.ts:524 › cli codegen › should generate getByPlaceholder `@webkit-headed-windows-latest`
⚠️ [webkit-library] › library/inspector/cli-codegen-3.spec.ts:829 › cli codegen › should assert value on disabled select `@webkit-headed-windows-latest`
⚠️ [webkit-library] › library/trace-viewer.spec.ts:1319 › should pick locator in iframe `@webkit-macos-13-large`
⚠️ [webkit-library] › library/client-certificates.spec.ts:712 › browser › should have ignoreHTTPSErrors=false by default `@webkit-macos-13-xlarge`
⚠️ [webkit-page] › page/page-request-continue.spec.ts:193 › post data › should amend post data `@webkit-macos-14-xlarge`
⚠️ [webkit-page] › page/wheel.spec.ts:70 › should dispatch wheel events after context menu was opened `@webkit-macos-15-xlarge`

253939 passed, 9964 skipped


Merge workflow run.

Copy link
Contributor

Test results for "tests others"

2 fatal errors, not part of any test

1 flaky ⚠️ [chromium-library] › library/chromium/oopif.spec.ts:374 › should allow to re-connect to OOPIFs with CDP when iframes were there already `@frozen-time-library-chromium-linux`
1 interrupted ⚠️ [electron-page] › page/page-keyboard.spec.ts:446 › should move to the start of the document `@electron-macos-latest`

21565 passed, 482 skipped, 846 did not run


Merge workflow run.

@mxschmitt mxschmitt requested a review from dgozman September 11, 2025 16:01
@mxschmitt mxschmitt merged commit 2f1b923 into main Sep 11, 2025
80 of 113 checks passed
@mxschmitt mxschmitt deleted the roll-into-pw-chromium-tip-of-tree/1367 branch September 11, 2025 21:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants