[Scout] Move GlobalSearch FTR tests to Scout by kowalczyk-krzysztof · Pull Request #252201 · elastic/kibana

kowalczyk-krzysztof · 2026-02-07T13:48:17Z

Summary

This PR migrates global search FTR tests to Scout and removes x-pack/platform/test/plugin_functional directory and all mentions of it, since the global search suite was the only thing left in that directory.

Closes: https://github.com/elastic/kibana-team/issues/2812

kibanamachine · 2026-02-08T12:21:54Z

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#10698

[❌] x-pack/platform/plugins/shared/global_search/test/scout/ui/playwright.config.ts: 0/25 tests passed.

see run history

kowalczyk-krzysztof · 2026-02-09T08:56:51Z

@elastic/appex-qa
The CI run for this migrated test suite was green.

However when I ran flaky test runner, something weird happened:

x-pack/platform/plugins/shared/global_search/test/scout/ui/playwright.config.ts (--stateful)

The stateful run passed, but those failed:

Failed modes:
	  --serverless=es ❌
	  --serverless=oblt ❌
	  --serverless=security ❌

The test suites have tag: tags.ESS_ONLY - as the original FTR suite didn't have serverless specific tests. So what do I do here? Is this just flaky test runner behaving weird by trying to run all modes? Should I make it work on all modes as the functionality being tested works the same everywhere? This is my first time migrating FTR to Scout so I'm not sure if I'm doing it correctly.

elasticmachine · 2026-02-09T09:14:47Z

Pinging @elastic/appex-sharedux (Team:SharedUX)

dmlemeshko · 2026-02-09T10:37:23Z

-    kbnTestServer: {
-      ...xpackFunctionalConfig.get('kbnTestServer'),
-      serverArgs: [
-        ...xpackFunctionalConfig.get('kbnTestServer.serverArgs'),
-        `--plugin-path=${resolve(
-          KIBANA_ROOT,
-          'src/platform/test/plugin_functional/plugins/core_provider_plugin'
-        )}`,
-        ...findTestPluginPaths(resolve(__dirname, 'plugins')),
-      ],
-    },


Scout server configuration is targeting Cloud testing by default, meaning local servers setup is matching CECH/MKI setup.

Since your tests depend on some custom plugins, it won't work unless you create a custom server configs override (see this PR for instructions #244306)

When you create custom server configuration, you decide where it can be run (e.g. having only stateful one won't allow to run tests against serverless project)

Looks like this is some legacy thing and src/platform/test/plugin_functional/plugins/core_provider_plugin is not needed as Scout provides everything it did.

As discussed on Slack, I'm keeping the classic tests only.

dmlemeshko · 2026-02-09T10:41:53Z

@elastic/appex-qa The CI run for this migrated test suite was green.

However when I ran flaky test runner, something weird happened:
x-pack/platform/plugins/shared/global_search/test/scout/ui/playwright.config.ts (--stateful)
The stateful run passed, but those failed:
Failed modes:
	  --serverless=es ❌
	  --serverless=oblt ❌
	  --serverless=security ❌
The test suites have tag: tags.ESS_ONLY - as the original FTR suite didn't have serverless specific tests. So what do I do here? Is this just flaky test runner behaving weird by trying to run all modes? Should I make it work on all modes as the functionality being tested works the same everywhere? This is my first time migrating FTR to Scout so I'm not sure if I'm doing it correctly.

This is a bug 🐛 Please check my comment about custom server definition, it won't work without it

elasticmachine · 2026-02-09T15:13:56Z

💛 Build succeeded, but was flaky

Buildkite Build
Commit: 6f0811a

Failed CI Steps

FTR Configs #3

Test Failures

[job] [logs] FTR Configs #3 / "before all" hook in "{root}"

Metrics [docs]

Unknown metric groups

ESLint disabled line counts

id	before	after	diff
`@kbn/test-suites-xpack-platform`	146	145	-1

Total ESLint disabled count

id	before	after	diff
`@kbn/test-suites-xpack-platform`	151	150	-1

History

💛 Build #391673 was flaky 2554213
💔 Build #391629 failed 1a796b8
💔 Build #391599 failed 6ce3893
💔 Build #391357 failed c08a02e

cc @kowalczyk-krzysztof

dmlemeshko

LGTM

bhavyarm

LGTM. Had kept an eye on this. Awesome work!

* commit '7dcc1fe3c205d2de0c3ca3f65804f21de09013c3': (285 commits) Enrich kbn-check-saved-objects-cli README with CI and manual usage docs (elastic#252557) [Discover] Add feature flag to make ESQL the default query mode (elastic#252268) Add maskProps.headerZindexLocation above to inspect component flyout (elastic#252543) [Security Solution][Atack/Alerts] Flyout header: Assignees (elastic#252190) Upgrade EUI to v112.3.0 (elastic#252315) [Fleet] Make save_knowledge_base async in streaming state machine (elastic#252328) Upgrade @smithy/config-resolver 4.3.0 → 4.4.6 (elastic#252457) [Lens as API] Add colorMapping support for XY charts (ES|QL data layers) (elastic#252051) [WorkplaceAI] Add Google Drive data source and connector (elastic#250677) [Scout] Move GlobalSearch FTR tests to Scout (elastic#252201) [EDR Workflows] Fix osquery pack results display when agent clock is skewed (elastic#251417) [Observability Onboarding] Apply integrations limit after dedup in parseIntegrationsTSV (elastic#252486) [Entity Analytics] Update `host.ip` aggregation to remove painless script (elastic#252426) Address `@elastic/eui/require-table-caption` lint violations across `@elastic/obs-presentation-team` files (elastic#251050) Consolidate JSON stringify dependencies (elastic#251890) [index mgmt] Use esql instead of query dsl to get the index count (elastic#252422) Add Usage API Plugin (elastic#252434) Cases All Templates page (elastic#250372) [Agent Builder] Default value for optional params in ESQL tools (elastic#238472) [Fleet] Add upgrade_details.metadata.reason to AgentResponseSchema (elastic#252485) ...

[Scout] Move GlobalSearch FTR tests to Scout

c08a02e

kowalczyk-krzysztof self-assigned this Feb 7, 2026

kowalczyk-krzysztof added release_note:skip Skip the PR/issue when compiling release notes backport:skip This PR does not require backporting labels Feb 7, 2026

kibanamachine and others added 4 commits February 7, 2026 13:58

Changes from node scripts/lint_ts_projects --fix

1ebab85

Changes from node scripts/generate codeowners

905e4a2

Changes from node scripts/regenerate_moon_projects.js --update

040928c

Move navigate to before each

fa79093

kowalczyk-krzysztof marked this pull request as ready for review February 9, 2026 08:56

kowalczyk-krzysztof requested review from a team as code owners February 9, 2026 08:56

kowalczyk-krzysztof added the Team:SharedUX Platform AppEx-SharedUX (formerly Global Experience) t// label Feb 9, 2026

kowalczyk-krzysztof and others added 3 commits February 9, 2026 10:14

Merge branch 'main' into scout/global-search

6ce3893

Changes from node scripts/eslint_all_files --no-cache --fix

1a796b8

Fix some weird hallucinated re-export

2554213

dmlemeshko reviewed Feb 9, 2026

View reviewed changes

Add comments

6f0811a

kowalczyk-krzysztof requested a review from dmlemeshko February 9, 2026 20:20

dmlemeshko approved these changes Feb 10, 2026

View reviewed changes

bhavyarm self-requested a review February 10, 2026 09:32

bhavyarm approved these changes Feb 10, 2026

View reviewed changes

kowalczyk-krzysztof enabled auto-merge (squash) February 10, 2026 09:33

jbudz approved these changes Feb 10, 2026

View reviewed changes

kowalczyk-krzysztof merged commit 8b34cc9 into elastic:main Feb 10, 2026
18 checks passed

kibanamachine added the v9.4.0 label Feb 10, 2026

kowalczyk-krzysztof deleted the scout/global-search branch February 10, 2026 15:20

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Scout] Move GlobalSearch FTR tests to Scout#252201

[Scout] Move GlobalSearch FTR tests to Scout#252201
kowalczyk-krzysztof merged 9 commits intoelastic:mainfrom
kowalczyk-krzysztof:scout/global-search

kowalczyk-krzysztof commented Feb 7, 2026 •

edited

Loading

Uh oh!

kibanamachine commented Feb 8, 2026

Uh oh!

kowalczyk-krzysztof commented Feb 9, 2026

Uh oh!

elasticmachine commented Feb 9, 2026

Uh oh!

dmlemeshko Feb 9, 2026

Uh oh!

kowalczyk-krzysztof Feb 9, 2026

Uh oh!

kowalczyk-krzysztof Feb 9, 2026

Uh oh!

dmlemeshko commented Feb 9, 2026

Uh oh!

elasticmachine commented Feb 9, 2026

ESLint disabled line counts

Total ESLint disabled count

Uh oh!

dmlemeshko left a comment

Uh oh!

bhavyarm left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

Conversation

kowalczyk-krzysztof commented Feb 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Uh oh!

kibanamachine commented Feb 8, 2026

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#10698

Uh oh!

kowalczyk-krzysztof commented Feb 9, 2026

Uh oh!

elasticmachine commented Feb 9, 2026

Uh oh!

dmlemeshko Feb 9, 2026

Choose a reason for hiding this comment

Uh oh!

kowalczyk-krzysztof Feb 9, 2026

Choose a reason for hiding this comment

Uh oh!

kowalczyk-krzysztof Feb 9, 2026

Choose a reason for hiding this comment

Uh oh!

dmlemeshko commented Feb 9, 2026

Uh oh!

elasticmachine commented Feb 9, 2026

💛 Build succeeded, but was flaky

Failed CI Steps

Test Failures

Metrics [docs]

ESLint disabled line counts

Total ESLint disabled count

History

Uh oh!

dmlemeshko left a comment

Choose a reason for hiding this comment

Uh oh!

bhavyarm left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

kowalczyk-krzysztof commented Feb 7, 2026 •

edited

Loading