Skip to content

Conversation

@Skn0tt
Copy link
Member

@Skn0tt Skn0tt commented Nov 26, 2025

No description provided.

@Skn0tt Skn0tt requested a review from dgozman November 26, 2025 12:51
@Skn0tt Skn0tt self-assigned this Nov 26, 2025
onTestBegin?(test: TestCase, result: TestResult): void;
onStdOut?(chunk: string | Buffer, test?: TestCase, result?: TestResult): void;
onStdErr?(chunk: string | Buffer, test?: TestCase, result?: TestResult): void;
onTestPaused?(test: TestCase, result: TestResult): void;
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I played around with different variants of invoking the reporter. A special function ended being the easiest to reason about. This should probably replace FailureTracker#onTestPaused.

return;
}

if (data.apiName === 'page.pause' && data.frames.length === 0 && channel.params?.location)
Copy link
Member Author

@Skn0tt Skn0tt Nov 26, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is hella hacky. i'm all ears for a better solution

return true;
}

export function findTestEndPosition(text: string, location: Location): Location | undefined {
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure at what time we already parse the test code. Potentially we could do this at scanning time, and then the Extension could get the end position from the Reporter API?


export type ConfigCLIOverrides = {
debug?: boolean;
pause?: boolean;
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This could replace new TestRun(options=)

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions
Copy link
Contributor

Test results for "MCP"

3 failed
❌ [webkit] › mcp/launch.spec.ts:113 › isolated context @mcp-ubuntu-latest
❌ [webkit] › mcp/video.spec.ts:21 › should work with --save-video (persistent) @mcp-ubuntu-latest
❌ [chrome] › mcp/autowait.spec.ts:19 › racy navigation destroys context @mcp-windows-latest

1 flaky ⚠️ [chrome] › mcp/cdp.spec.ts:24 › cdp server `@mcp-windows-latest`

2606 passed, 116 skipped


Merge workflow run.

@github-actions
Copy link
Contributor

Test results for "tests 1"

1 failed
❌ [playwright-test] › reporter-html.spec.ts:3005 › created › execSync doesnt produce a second stdout attachment @macos-latest-node18-2

9 flaky ⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-ubuntu-22.04-node18`
⚠️ [firefox-page] › page/page-event-request.spec.ts:182 › should return response body when Cross-Origin-Opener-Policy is set `@firefox-ubuntu-22.04-node18`
⚠️ [playwright-test] › ui-mode-test-output.spec.ts:117 › should collapse repeated console messages for test `@macos-latest-node18-2`
⚠️ [playwright-test] › ui-mode-trace.spec.ts:397 › should work behind reverse proxy `@macos-latest-node18-2`
⚠️ [webkit-library] › library/browsercontext-cookies-third-party.spec.ts:161 › save/load third party non-partitioned cookies `@webkit-ubuntu-22.04-node18`
⚠️ [webkit-library] › library/browsercontext-har.spec.ts:208 › should goForward to redirected navigation `@webkit-ubuntu-22.04-node18`
⚠️ [webkit-library] › library/browsertype-connect.spec.ts:435 › run-server › should respect selectors `@webkit-ubuntu-22.04-node18`
⚠️ [webkit-library] › library/video.spec.ts:378 › screencast › should capture navigation `@webkit-ubuntu-22.04-node18`
⚠️ [playwright-test] › ui-mode-test-attachments.spec.ts:102 › should linkify string attachments `@windows-latest-node18-2`

40307 passed, 787 skipped


Merge workflow run.

@Skn0tt
Copy link
Member Author

Skn0tt commented Nov 28, 2025

superceded by #38345

@Skn0tt Skn0tt closed this Nov 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant