Skip to content

Conversation

@dolaru
Copy link
Contributor

@dolaru dolaru commented Jul 29, 2025

Summary

Adds 3 new fields to Scout events collected by the Playwright reporter:

  • test_run.target.type - local or cloud
  • test_run.target.mode - the mode the stack is running in (stateful, ess, serverless=es, etc.)
  • test_run.fully_parallel - whether the tests are running in parallel mode; collected from the Playwright config

@dolaru dolaru self-assigned this Jul 29, 2025
@dolaru dolaru requested a review from a team as a code owner July 29, 2025 16:30
@dolaru dolaru added release_note:skip Skip the PR/issue when compiling release notes backport:version Backport to applied version labels v9.2.0 v9.0.5 v9.1.1 v8.19.1 labels Jul 29, 2025
Adds 3 new fields to Scout events collected by the Playwright reporter:
- `test_run.target.type` - `local` or `cloud`
- `test_run.target.mode` - the mode the stack is running in (`stateful`, `ess`, `serverless=es`, etc.)
- `test_run.fully_parallel` - whether the tests are running in parallel mode; collected from the Playwright config
@dolaru dolaru force-pushed the scout_runtime_info branch from a19cbcb to 619acd0 Compare July 29, 2025 16:48
@dolaru dolaru requested a review from a team as a code owner July 30, 2025 13:55
Copy link
Contributor

@jbudz jbudz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

.buildkite/pipeline-utils/ci-stats/pick_test_group_run_order.ts LGTM

@elasticmachine
Copy link
Contributor

💛 Build succeeded, but was flaky

Failed CI Steps

Test Failures

  • [job] [logs] FTR Configs #133 / Serverless Common UI - Dev Tools Search Profiler Editor With a test index profiles a simple query

Metrics [docs]

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id before after diff
@kbn/scout-info 13 15 +2
@kbn/scout-reporting 107 109 +2
total +4
Unknown metric groups

API count

id before after diff
@kbn/scout-info 13 15 +2
@kbn/scout-reporting 126 128 +2
total +4

cc @dolaru

Copy link
Contributor

@dmlemeshko dmlemeshko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dolaru dolaru merged commit 55bd984 into elastic:main Jul 31, 2025
13 checks passed
@kibanamachine
Copy link
Contributor

Starting backport for target branches: 8.19, 9.0, 9.1

https://github.com/elastic/kibana/actions/runs/16654026178

kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Jul 31, 2025
## Summary

Adds 3 new fields to Scout events collected by the Playwright reporter:
- `test_run.target.type` - `local` or `cloud`
- `test_run.target.mode` - the mode the stack is running in (`stateful`,
`ess`, `serverless=es`, etc.)
- `test_run.fully_parallel` - whether the tests are running in parallel
mode; collected from the Playwright config

(cherry picked from commit 55bd984)
@kibanamachine
Copy link
Contributor

💔 Some backports could not be created

Status Branch Result
8.19 Backport failed because of merge conflicts

You might need to backport the following PRs to 8.19:
- [scout] support log level override (#228841)
9.0 Backport failed because of merge conflicts

You might need to backport the following PRs to 9.0:
- SKA: Relocate "platform" packages that remain on /packages (#208704)
9.1

Note: Successful backport PRs will be merged automatically after passing CI.

Manual backport

To create the backport manually run:

node scripts/backport --pr 229846

Questions ?

Please refer to the Backport tool documentation

kibanamachine added a commit that referenced this pull request Jul 31, 2025
… (#230098)

# Backport

This will backport the following commits from `main` to `9.1`:
- [[Scout] Capture test run target, mode and parallel info
(#229846)](#229846)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"David
Olaru","email":"dolaru@elastic.co"},"sourceCommit":{"committedDate":"2025-07-31T16:01:41Z","message":"[Scout]
Capture test run target, mode and parallel info (#229846)\n\n##
Summary\n\nAdds 3 new fields to Scout events collected by the Playwright
reporter:\n- `test_run.target.type` - `local` or `cloud`\n-
`test_run.target.mode` - the mode the stack is running in
(`stateful`,\n`ess`, `serverless=es`, etc.)\n- `test_run.fully_parallel`
- whether the tests are running in parallel\nmode; collected from the
Playwright
config","sha":"55bd9843c4b240d623a2079daee597a509019524","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:version","v9.2.0","v9.0.5","v9.1.1","v8.19.1"],"title":"[Scout]
Capture test run target, mode and parallel
info","number":229846,"url":"https://github.com/elastic/kibana/pull/229846","mergeCommit":{"message":"[Scout]
Capture test run target, mode and parallel info (#229846)\n\n##
Summary\n\nAdds 3 new fields to Scout events collected by the Playwright
reporter:\n- `test_run.target.type` - `local` or `cloud`\n-
`test_run.target.mode` - the mode the stack is running in
(`stateful`,\n`ess`, `serverless=es`, etc.)\n- `test_run.fully_parallel`
- whether the tests are running in parallel\nmode; collected from the
Playwright
config","sha":"55bd9843c4b240d623a2079daee597a509019524"}},"sourceBranch":"main","suggestedTargetBranches":["9.0","9.1","8.19"],"targetPullRequestStates":[{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/229846","number":229846,"mergeCommit":{"message":"[Scout]
Capture test run target, mode and parallel info (#229846)\n\n##
Summary\n\nAdds 3 new fields to Scout events collected by the Playwright
reporter:\n- `test_run.target.type` - `local` or `cloud`\n-
`test_run.target.mode` - the mode the stack is running in
(`stateful`,\n`ess`, `serverless=es`, etc.)\n- `test_run.fully_parallel`
- whether the tests are running in parallel\nmode; collected from the
Playwright
config","sha":"55bd9843c4b240d623a2079daee597a509019524"}},{"branch":"9.0","label":"v9.0.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.1","label":"v9.1.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: David Olaru <dolaru@elastic.co>
delanni pushed a commit to delanni/kibana that referenced this pull request Aug 5, 2025
## Summary

Adds 3 new fields to Scout events collected by the Playwright reporter:
- `test_run.target.type` - `local` or `cloud`
- `test_run.target.mode` - the mode the stack is running in (`stateful`,
`ess`, `serverless=es`, etc.)
- `test_run.fully_parallel` - whether the tests are running in parallel
mode; collected from the Playwright config
@wildemat wildemat mentioned this pull request Aug 7, 2025
10 tasks
NicholasPeretti pushed a commit to NicholasPeretti/kibana that referenced this pull request Aug 18, 2025
## Summary

Adds 3 new fields to Scout events collected by the Playwright reporter:
- `test_run.target.type` - `local` or `cloud`
- `test_run.target.mode` - the mode the stack is running in (`stateful`,
`ess`, `serverless=es`, etc.)
- `test_run.fully_parallel` - whether the tests are running in parallel
mode; collected from the Playwright config
dmlemeshko pushed a commit to dmlemeshko/kibana that referenced this pull request Oct 16, 2025
## Summary

Adds 3 new fields to Scout events collected by the Playwright reporter:
- `test_run.target.type` - `local` or `cloud`
- `test_run.target.mode` - the mode the stack is running in (`stateful`,
`ess`, `serverless=es`, etc.)
- `test_run.fully_parallel` - whether the tests are running in parallel
mode; collected from the Playwright config

(cherry picked from commit 55bd984)
@dmlemeshko
Copy link
Contributor

💚 All backports created successfully

Status Branch Result
8.19

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

dmlemeshko added a commit that referenced this pull request Oct 16, 2025
…) (#239270)

# Backport

This will backport the following commits from `main` to `8.19`:
- [[Scout] Capture test run target, mode and parallel info
(#229846)](#229846)

<!--- Backport version: 10.0.2 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"David
Olaru","email":"dolaru@elastic.co"},"sourceCommit":{"committedDate":"2025-07-31T16:01:41Z","message":"[Scout]
Capture test run target, mode and parallel info (#229846)\n\n##
Summary\n\nAdds 3 new fields to Scout events collected by the Playwright
reporter:\n- `test_run.target.type` - `local` or `cloud`\n-
`test_run.target.mode` - the mode the stack is running in
(`stateful`,\n`ess`, `serverless=es`, etc.)\n- `test_run.fully_parallel`
- whether the tests are running in parallel\nmode; collected from the
Playwright
config","sha":"55bd9843c4b240d623a2079daee597a509019524","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:version","v9.2.0","v9.0.5","v9.1.1","v8.19.1"],"title":"[Scout]
Capture test run target, mode and parallel
info","number":229846,"url":"https://github.com/elastic/kibana/pull/229846","mergeCommit":{"message":"[Scout]
Capture test run target, mode and parallel info (#229846)\n\n##
Summary\n\nAdds 3 new fields to Scout events collected by the Playwright
reporter:\n- `test_run.target.type` - `local` or `cloud`\n-
`test_run.target.mode` - the mode the stack is running in
(`stateful`,\n`ess`, `serverless=es`, etc.)\n- `test_run.fully_parallel`
- whether the tests are running in parallel\nmode; collected from the
Playwright
config","sha":"55bd9843c4b240d623a2079daee597a509019524"}},"sourceBranch":"main","suggestedTargetBranches":["9.0","8.19"],"targetPullRequestStates":[{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/229846","number":229846,"mergeCommit":{"message":"[Scout]
Capture test run target, mode and parallel info (#229846)\n\n##
Summary\n\nAdds 3 new fields to Scout events collected by the Playwright
reporter:\n- `test_run.target.type` - `local` or `cloud`\n-
`test_run.target.mode` - the mode the stack is running in
(`stateful`,\n`ess`, `serverless=es`, etc.)\n- `test_run.fully_parallel`
- whether the tests are running in parallel\nmode; collected from the
Playwright
config","sha":"55bd9843c4b240d623a2079daee597a509019524"}},{"branch":"9.0","label":"v9.0.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.1","label":"v9.1.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/230098","number":230098,"state":"MERGED","mergeCommit":{"sha":"7fedd5465a6238da23bc92e53c19f5a058e52019","message":"[9.1]
[Scout] Capture test run target, mode and parallel info (#229846)
(#230098)\n\n# Backport\n\nThis will backport the following commits from
`main` to `9.1`:\n- [[Scout] Capture test run target, mode and parallel
info\n(#229846)](https://github.com/elastic/kibana/pull/229846)\n\n\n\n###
Questions ?\nPlease refer to the [Backport
tool\ndocumentation](https://github.com/sorenlouv/backport)\n\n\n\nCo-authored-by:
David Olaru
<dolaru@elastic.co>"}},{"branch":"8.19","label":"v8.19.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: David Olaru <dolaru@elastic.co>
@dmlemeshko dmlemeshko removed the v9.0.5 label Oct 16, 2025
@dolaru dolaru deleted the scout_runtime_info branch December 2, 2025 10:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:version Backport to applied version labels release_note:skip Skip the PR/issue when compiling release notes v8.19.1 v8.19.6 v9.1.1 v9.2.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants