Skip to content

[APM] Migrate the Transaction Overview tests to Scout/Playwright/Component/API tests#245972

Merged
sbelastic merged 21 commits intoelastic:mainfrom
sbelastic:238515-migrate-transaction-overview-tests
Dec 17, 2025
Merged

[APM] Migrate the Transaction Overview tests to Scout/Playwright/Component/API tests#245972
sbelastic merged 21 commits intoelastic:mainfrom
sbelastic:238515-migrate-transaction-overview-tests

Conversation

@sbelastic
Copy link
Copy Markdown
Contributor

@sbelastic sbelastic commented Dec 11, 2025 •
edited
Loading

Closes #238515

Summary

Migrating transactions overview tests from Cypress to Scout

Running tests e2e

Run server (first terminal):

node scripts/scout.js start-server --stateful

Run tests (second terminal):

npx playwright test --project local --ui --config x-pack/solutions/observability/plugins/apm/test/scout/ui/parallel.playwright.config.ts

Running tests api

Run server (first terminal):

node scripts/functional_tests_server --config x-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts

Run tests (second terminal):

node scripts/functional_test_runner --config x-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts --include=x-pack/solutions/observability/test/api_integration_deployment_agnostic/apis/apm/transactions/transactions_groups_order.spec.ts

New tests result output

image

Checklist

Check the PR satisfies following conditions.

Reviewers should verify this PR satisfies this list as well.

@sbelastic sbelastic self-assigned this Dec 11, 2025
@sbelastic sbelastic added release_note:skip Skip the PR/issue when compiling release notes backport:skip This PR does not require backporting v9.3.0 Team:obs-presentation Focus: APM UI, Infra UI, Hosts UI, Universal Profiling, Obs Overview and left Navigation labels Dec 11, 2025
@sbelastic sbelastic marked this pull request as ready for review December 11, 2025 10:44
@sbelastic sbelastic requested a review from a team as a code owner December 11, 2025 10:44
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Dec 11, 2025

Pinging @elastic/obs-presentation-team (Team:obs-presentation)

@sbelastic sbelastic requested a review from a team as a code owner December 11, 2025 18:16
@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Dec 12, 2025

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#10065

[✅] x-pack/solutions/observability/plugins/apm/test/scout/ui/parallel.playwright.config.ts: 15/15 tests passed.

see run history

@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Dec 15, 2025

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#10078

[✅] x-pack/solutions/observability/plugins/apm/test/scout/ui/parallel.playwright.config.ts: 15/15 tests passed.

see run history

jennypavlova
jennypavlova reviewed Dec 15, 2025
View reviewed changes
Copy link
Copy Markdown
Member

@jennypavlova jennypavlova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well done 💯 I added some suggestions ⬇️

@elastic-vault-github-plugin-prod elastic-vault-github-plugin-prod bot requested a review from a team as a code owner December 16, 2025 09:57
@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Dec 16, 2025

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#10097

[✅] x-pack/solutions/observability/plugins/apm/test/scout/ui/parallel.playwright.config.ts: 15/15 tests passed.

see run history

jennypavlova
jennypavlova reviewed Dec 16, 2025
View reviewed changes
Copy link
Copy Markdown
Member

@jennypavlova jennypavlova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for addressing the comments, just a few small things ⬇️

@markov00 markov00 removed the request for review from a team December 16, 2025 17:11
jennypavlova
jennypavlova approved these changes Dec 16, 2025
View reviewed changes
Copy link
Copy Markdown
Member

@jennypavlova jennypavlova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 💯 Thanks for all the fixes!

@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Dec 16, 2025

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#10111

[✅] x-pack/solutions/observability/plugins/apm/test/scout/ui/parallel.playwright.config.ts: 15/15 tests passed.

see run history

@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Dec 16, 2025

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#10114

[✅] x-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts: 25/25 tests passed.
[❌] x-pack/solutions/observability/test/api_integration_deployment_agnostic/apis/apm/transactions/index.ts: 0/15 tests passed.

see run history

@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Dec 16, 2025

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#10117

[✅] x-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts: 25/25 tests passed.
[✅] x-pack/solutions/observability/plugins/apm/test/scout/ui/parallel.playwright.config.ts: 15/15 tests passed.

see run history

@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Dec 17, 2025

💛 Build succeeded, but was flaky

Failed CI Steps

Test Failures

  • [job] [logs] Scout: [ platform / discover_enhanced ] plugin / serverless-es - Discover app - value suggestions: useTimeRange enabled - show up if in range
  • [job] [logs] Scout: [ platform / discover_enhanced ] plugin / show up if in range

Metrics [docs]

✅ unchanged

History

cc @sbelastic

@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Dec 17, 2025

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#10129

[✅] x-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts: 25/25 tests passed.
[✅] x-pack/solutions/observability/plugins/apm/test/scout/ui/parallel.playwright.config.ts: 15/15 tests passed.

see run history

@sbelastic sbelastic merged commit 23c0e3c into elastic:main Dec 17, 2025
13 checks passed
mbondyra added a commit to mbondyra/kibana that referenced this pull request Dec 17, 2025
@mbondyra
Merge commit 'bb1f55fa520b30ceb923af069ef403b24dcb1606' into vega_rea…
e5a4d99 
…donly

* commit 'bb1f55fa520b30ceb923af069ef403b24dcb1606': (52 commits)
  [CPS][Maps] Support CPS Picker in Maps  (elastic#246382)
  [APM] Migrate the Transaction Overview tests to Scout/Playwright/Component/API tests (elastic#245972)
  [Cases] Change nested field search to be case insensitive (elastic#246643)
  [ES|QL] PromQL parser initial implementation (elastic#246552)
  [Agent Builder] Adds keyboard shortcut and toggle behavior to AI Agent button (elastic#246659)
  Retry on "all shards failed" from ES (elastic#246533)
  [Streams] Test enable wired streams flow (elastic#246113)
  [Agent Builder] Fast-follow bugfixes for MCP Tool type  (elastic#246665)
  [Entity Store][API] Fix snake case on CRUD API List response (elastic#246003)
  [ResponseOps][Slack] Simplify channel configuration  (elastic#245423)
  Add Canonical Name Badge to Documentation (elastic#246647)
  [Streams] Add simulation filtering by conditions (elastic#245400)
  [o11y AI] Add `get_hosts` tool (elastic#246541)
  [agent builder] create_visualization: support heatmap and regionmap (elastic#246671)
  [AI Infra] Chat experience: Selection modal title change (elastic#246683)
  [Background search] Change polling behavior (elastic#244760)
  [ES|QL  ]  Common Lookup Join Fields Are Not Listed First (elastic#246582)
  Add missing `dynamic: false` (elastic#246685)
  [Metrics in Discover] Unskip metrics api test (elastic#246593)
  [ES|QL] Show next actions after simple field assignment in RERANK ON Clause (elastic#246676)
  ...
KodeRad pushed a commit to KodeRad/kibana that referenced this pull request Dec 17, 2025
@sbelastic @kibanamachine @KodeRad
[APM] Migrate the Transaction Overview tests to Scout/Playwright/Comp…
a2d9dd4 
…onent/API tests (elastic#245972)

Closes elastic#238515

## Summary

Migrating transactions overview tests from Cypress to Scout

### Running tests e2e

Run server (first terminal):

`node scripts/scout.js start-server --stateful`

Run tests (second terminal):

`
npx playwright test --project local --ui --config
x-pack/solutions/observability/plugins/apm/test/scout/ui/parallel.playwright.config.ts
`


### Running tests api

Run server (first terminal):

`node scripts/functional_tests_server --config
x-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts`

Run tests (second terminal):

`node scripts/functional_test_runner --config
x-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts
--include=x-pack/solutions/observability/test/api_integration_deployment_agnostic/apis/apm/transactions/transactions_groups_order.spec.ts`

### New tests result output

<img width="1919" height="1122" alt="image"
src="https://github.com/user-attachments/assets/7167375c-879d-410a-912a-ab6581011fdf"
/>

### Checklist

Check the PR satisfies following conditions. 

Reviewers should verify this PR satisfies this list as well.


- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
sbelastic added a commit to sbelastic/kibana that referenced this pull request Feb 10, 2026
@sbelastic @kibanamachine
[APM] Migrate the Transaction Overview tests to Scout/Playwright/Comp…
7fc487a 
…onent/API tests (elastic#245972)

Closes elastic#238515

Migrating transactions overview tests from Cypress to Scout

Run server (first terminal):

`node scripts/scout.js start-server --stateful`

Run tests (second terminal):

`
npx playwright test --project local --ui --config
x-pack/solutions/observability/plugins/apm/test/scout/ui/parallel.playwright.config.ts
`

Run server (first terminal):

`node scripts/functional_tests_server --config
x-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts`

Run tests (second terminal):

`node scripts/functional_test_runner --config
x-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts
--include=x-pack/solutions/observability/test/api_integration_deployment_agnostic/apis/apm/transactions/transactions_groups_order.spec.ts`

<img width="1919" height="1122" alt="image"
src="https://github.com/user-attachments/assets/7167375c-879d-410a-912a-ab6581011fdf"
/>

Check the PR satisfies following conditions.

Reviewers should verify this PR satisfies this list as well.

- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
(cherry picked from commit 23c0e3c)
@sbelastic sbelastic mentioned this pull request Feb 10, 2026
Merged
@sbelastic
Copy link
Copy Markdown
Contributor Author

sbelastic commented Feb 10, 2026

💚 All backports created successfully

Status Branch Result
✅ 9.2

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

sbelastic added a commit that referenced this pull request Feb 10, 2026
@sbelastic @kibanamachine
[9.2] [APM] Migrate the Transaction Overview tests to Scout/Playwrigh…
530d85a 
…t/Component/API tests (#245972) (#252497)

# Backport

This will backport the following commits from `main` to `9.2`:
- [[APM] Migrate the Transaction Overview tests to
Scout/Playwright/Component/API tests
(#245972)](#245972)

<!--- Backport version: 10.2.0 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Samuel
Brito","email":"samuel.brito@elastic.co"},"sourceCommit":{"committedDate":"2025-12-17T14:38:47Z","message":"[APM]
Migrate the Transaction Overview tests to Scout/Playwright/Component/API
tests (#245972)\n\nCloses
https://github.com/elastic/kibana/issues/238515\n\n##
Summary\n\nMigrating transactions overview tests from Cypress to
Scout\n\n### Running tests e2e\n\nRun server (first terminal):\n\n`node
scripts/scout.js start-server --stateful`\n\nRun tests (second
terminal):\n\n`\nnpx playwright test --project local --ui
--config\nx-pack/solutions/observability/plugins/apm/test/scout/ui/parallel.playwright.config.ts\n`\n\n\n###
Running tests api\n\nRun server (first terminal):\n\n`node
scripts/functional_tests_server
--config\nx-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts`\n\nRun
tests (second terminal):\n\n`node scripts/functional_test_runner
--config\nx-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts\n--include=x-pack/solutions/observability/test/api_integration_deployment_agnostic/apis/apm/transactions/transactions_groups_order.spec.ts`\n\n###
New tests result output\n\n<img width=\"1919\" height=\"1122\"
alt=\"image\"\nsrc=\"https://github.com/user-attachments/assets/7167375c-879d-410a-912a-ab6581011fdf\"\n/>\n\n###
Checklist\n\nCheck the PR satisfies following conditions. \n\nReviewers
should verify this PR satisfies this list as well.\n\n\n- [x] [Flaky
Test\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\nused on any tests changed\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"23c0e3c05ca2cc666a95d8a89756e8307fd2886e","branchLabelMapping":{"^v9.3.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:skip","v9.3.0","Team:obs-presentation"],"title":"[APM]
Migrate the Transaction Overview tests to Scout/Playwright/Component/API
tests","number":245972,"url":"https://github.com/elastic/kibana/pull/245972","mergeCommit":{"message":"[APM]
Migrate the Transaction Overview tests to Scout/Playwright/Component/API
tests (#245972)\n\nCloses
https://github.com/elastic/kibana/issues/238515\n\n##
Summary\n\nMigrating transactions overview tests from Cypress to
Scout\n\n### Running tests e2e\n\nRun server (first terminal):\n\n`node
scripts/scout.js start-server --stateful`\n\nRun tests (second
terminal):\n\n`\nnpx playwright test --project local --ui
--config\nx-pack/solutions/observability/plugins/apm/test/scout/ui/parallel.playwright.config.ts\n`\n\n\n###
Running tests api\n\nRun server (first terminal):\n\n`node
scripts/functional_tests_server
--config\nx-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts`\n\nRun
tests (second terminal):\n\n`node scripts/functional_test_runner
--config\nx-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts\n--include=x-pack/solutions/observability/test/api_integration_deployment_agnostic/apis/apm/transactions/transactions_groups_order.spec.ts`\n\n###
New tests result output\n\n<img width=\"1919\" height=\"1122\"
alt=\"image\"\nsrc=\"https://github.com/user-attachments/assets/7167375c-879d-410a-912a-ab6581011fdf\"\n/>\n\n###
Checklist\n\nCheck the PR satisfies following conditions. \n\nReviewers
should verify this PR satisfies this list as well.\n\n\n- [x] [Flaky
Test\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\nused on any tests changed\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"23c0e3c05ca2cc666a95d8a89756e8307fd2886e"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.3.0","branchLabelMappingKey":"^v9.3.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/245972","number":245972,"mergeCommit":{"message":"[APM]
Migrate the Transaction Overview tests to Scout/Playwright/Component/API
tests (#245972)\n\nCloses
https://github.com/elastic/kibana/issues/238515\n\n##
Summary\n\nMigrating transactions overview tests from Cypress to
Scout\n\n### Running tests e2e\n\nRun server (first terminal):\n\n`node
scripts/scout.js start-server --stateful`\n\nRun tests (second
terminal):\n\n`\nnpx playwright test --project local --ui
--config\nx-pack/solutions/observability/plugins/apm/test/scout/ui/parallel.playwright.config.ts\n`\n\n\n###
Running tests api\n\nRun server (first terminal):\n\n`node
scripts/functional_tests_server
--config\nx-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts`\n\nRun
tests (second terminal):\n\n`node scripts/functional_test_runner
--config\nx-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts\n--include=x-pack/solutions/observability/test/api_integration_deployment_agnostic/apis/apm/transactions/transactions_groups_order.spec.ts`\n\n###
New tests result output\n\n<img width=\"1919\" height=\"1122\"
alt=\"image\"\nsrc=\"https://github.com/user-attachments/assets/7167375c-879d-410a-912a-ab6581011fdf\"\n/>\n\n###
Checklist\n\nCheck the PR satisfies following conditions. \n\nReviewers
should verify this PR satisfies this list as well.\n\n\n- [x] [Flaky
Test\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\nused on any tests changed\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"23c0e3c05ca2cc666a95d8a89756e8307fd2886e"}}]}]
BACKPORT-->

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@dmlemeshko dmlemeshko dmlemeshko left review comments

@jennypavlova jennypavlova jennypavlova approved these changes

Assignees

@sbelastic sbelastic

Labels

backport:skip This PR does not require backporting release_note:skip Skip the PR/issue when compiling release notes Team:obs-presentation Focus: APM UI, Infra UI, Hosts UI, Universal Profiling, Obs Overview and left Navigation v9.2.6 v9.3.0

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[APM] Migrate the Transaction Overview tests to Scout/Playwright/Component/API tests

5 participants

@sbelastic @elasticmachine @kibanamachine @dmlemeshko @jennypavlova