-
Notifications
You must be signed in to change notification settings - Fork 8.5k
[Scout] Capture test run target, mode and parallel info #229846
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Adds 3 new fields to Scout events collected by the Playwright reporter: - `test_run.target.type` - `local` or `cloud` - `test_run.target.mode` - the mode the stack is running in (`stateful`, `ess`, `serverless=es`, etc.) - `test_run.fully_parallel` - whether the tests are running in parallel mode; collected from the Playwright config
a19cbcb to
619acd0
Compare
jbudz
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
.buildkite/pipeline-utils/ci-stats/pick_test_group_run_order.ts LGTM
💛 Build succeeded, but was flaky
Failed CI StepsTest Failures
Metrics [docs]Public APIs missing comments
Unknown metric groupsAPI count
cc @dolaru |
dmlemeshko
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
|
Starting backport for target branches: 8.19, 9.0, 9.1 https://github.com/elastic/kibana/actions/runs/16654026178 |
## Summary Adds 3 new fields to Scout events collected by the Playwright reporter: - `test_run.target.type` - `local` or `cloud` - `test_run.target.mode` - the mode the stack is running in (`stateful`, `ess`, `serverless=es`, etc.) - `test_run.fully_parallel` - whether the tests are running in parallel mode; collected from the Playwright config (cherry picked from commit 55bd984)
💔 Some backports could not be created
Note: Successful backport PRs will be merged automatically after passing CI. Manual backportTo create the backport manually run: Questions ?Please refer to the Backport tool documentation |
… (#230098) # Backport This will backport the following commits from `main` to `9.1`: - [[Scout] Capture test run target, mode and parallel info (#229846)](#229846) <!--- Backport version: 9.6.6 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"David Olaru","email":"dolaru@elastic.co"},"sourceCommit":{"committedDate":"2025-07-31T16:01:41Z","message":"[Scout] Capture test run target, mode and parallel info (#229846)\n\n## Summary\n\nAdds 3 new fields to Scout events collected by the Playwright reporter:\n- `test_run.target.type` - `local` or `cloud`\n- `test_run.target.mode` - the mode the stack is running in (`stateful`,\n`ess`, `serverless=es`, etc.)\n- `test_run.fully_parallel` - whether the tests are running in parallel\nmode; collected from the Playwright config","sha":"55bd9843c4b240d623a2079daee597a509019524","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:version","v9.2.0","v9.0.5","v9.1.1","v8.19.1"],"title":"[Scout] Capture test run target, mode and parallel info","number":229846,"url":"https://github.com/elastic/kibana/pull/229846","mergeCommit":{"message":"[Scout] Capture test run target, mode and parallel info (#229846)\n\n## Summary\n\nAdds 3 new fields to Scout events collected by the Playwright reporter:\n- `test_run.target.type` - `local` or `cloud`\n- `test_run.target.mode` - the mode the stack is running in (`stateful`,\n`ess`, `serverless=es`, etc.)\n- `test_run.fully_parallel` - whether the tests are running in parallel\nmode; collected from the Playwright config","sha":"55bd9843c4b240d623a2079daee597a509019524"}},"sourceBranch":"main","suggestedTargetBranches":["9.0","9.1","8.19"],"targetPullRequestStates":[{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/229846","number":229846,"mergeCommit":{"message":"[Scout] Capture test run target, mode and parallel info (#229846)\n\n## Summary\n\nAdds 3 new fields to Scout events collected by the Playwright reporter:\n- `test_run.target.type` - `local` or `cloud`\n- `test_run.target.mode` - the mode the stack is running in (`stateful`,\n`ess`, `serverless=es`, etc.)\n- `test_run.fully_parallel` - whether the tests are running in parallel\nmode; collected from the Playwright config","sha":"55bd9843c4b240d623a2079daee597a509019524"}},{"branch":"9.0","label":"v9.0.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.1","label":"v9.1.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT--> Co-authored-by: David Olaru <dolaru@elastic.co>
## Summary Adds 3 new fields to Scout events collected by the Playwright reporter: - `test_run.target.type` - `local` or `cloud` - `test_run.target.mode` - the mode the stack is running in (`stateful`, `ess`, `serverless=es`, etc.) - `test_run.fully_parallel` - whether the tests are running in parallel mode; collected from the Playwright config
## Summary Adds 3 new fields to Scout events collected by the Playwright reporter: - `test_run.target.type` - `local` or `cloud` - `test_run.target.mode` - the mode the stack is running in (`stateful`, `ess`, `serverless=es`, etc.) - `test_run.fully_parallel` - whether the tests are running in parallel mode; collected from the Playwright config
## Summary Adds 3 new fields to Scout events collected by the Playwright reporter: - `test_run.target.type` - `local` or `cloud` - `test_run.target.mode` - the mode the stack is running in (`stateful`, `ess`, `serverless=es`, etc.) - `test_run.fully_parallel` - whether the tests are running in parallel mode; collected from the Playwright config (cherry picked from commit 55bd984)
💚 All backports created successfully
Note: Successful backport PRs will be merged automatically after passing CI. Questions ?Please refer to the Backport tool documentation |
…) (#239270) # Backport This will backport the following commits from `main` to `8.19`: - [[Scout] Capture test run target, mode and parallel info (#229846)](#229846) <!--- Backport version: 10.0.2 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"David Olaru","email":"dolaru@elastic.co"},"sourceCommit":{"committedDate":"2025-07-31T16:01:41Z","message":"[Scout] Capture test run target, mode and parallel info (#229846)\n\n## Summary\n\nAdds 3 new fields to Scout events collected by the Playwright reporter:\n- `test_run.target.type` - `local` or `cloud`\n- `test_run.target.mode` - the mode the stack is running in (`stateful`,\n`ess`, `serverless=es`, etc.)\n- `test_run.fully_parallel` - whether the tests are running in parallel\nmode; collected from the Playwright config","sha":"55bd9843c4b240d623a2079daee597a509019524","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:version","v9.2.0","v9.0.5","v9.1.1","v8.19.1"],"title":"[Scout] Capture test run target, mode and parallel info","number":229846,"url":"https://github.com/elastic/kibana/pull/229846","mergeCommit":{"message":"[Scout] Capture test run target, mode and parallel info (#229846)\n\n## Summary\n\nAdds 3 new fields to Scout events collected by the Playwright reporter:\n- `test_run.target.type` - `local` or `cloud`\n- `test_run.target.mode` - the mode the stack is running in (`stateful`,\n`ess`, `serverless=es`, etc.)\n- `test_run.fully_parallel` - whether the tests are running in parallel\nmode; collected from the Playwright config","sha":"55bd9843c4b240d623a2079daee597a509019524"}},"sourceBranch":"main","suggestedTargetBranches":["9.0","8.19"],"targetPullRequestStates":[{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/229846","number":229846,"mergeCommit":{"message":"[Scout] Capture test run target, mode and parallel info (#229846)\n\n## Summary\n\nAdds 3 new fields to Scout events collected by the Playwright reporter:\n- `test_run.target.type` - `local` or `cloud`\n- `test_run.target.mode` - the mode the stack is running in (`stateful`,\n`ess`, `serverless=es`, etc.)\n- `test_run.fully_parallel` - whether the tests are running in parallel\nmode; collected from the Playwright config","sha":"55bd9843c4b240d623a2079daee597a509019524"}},{"branch":"9.0","label":"v9.0.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.1","label":"v9.1.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/230098","number":230098,"state":"MERGED","mergeCommit":{"sha":"7fedd5465a6238da23bc92e53c19f5a058e52019","message":"[9.1] [Scout] Capture test run target, mode and parallel info (#229846) (#230098)\n\n# Backport\n\nThis will backport the following commits from `main` to `9.1`:\n- [[Scout] Capture test run target, mode and parallel info\n(#229846)](https://github.com/elastic/kibana/pull/229846)\n\n\n\n### Questions ?\nPlease refer to the [Backport tool\ndocumentation](https://github.com/sorenlouv/backport)\n\n\n\nCo-authored-by: David Olaru <dolaru@elastic.co>"}},{"branch":"8.19","label":"v8.19.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT--> Co-authored-by: David Olaru <dolaru@elastic.co>
Summary
Adds 3 new fields to Scout events collected by the Playwright reporter:
test_run.target.type-localorcloudtest_run.target.mode- the mode the stack is running in (stateful,ess,serverless=es, etc.)test_run.fully_parallel- whether the tests are running in parallel mode; collected from the Playwright config