Skip to content

Attempt to fix flaky Infra test#261465

Merged
miloszmarcinkowski merged 2 commits intoelastic:mainfrom
miloszmarcinkowski:258194-failing-test-x-pack-observability-functional-ui-testsx-packsolutionsobservabilitytestfunctionalappsinfrahosts_viewts
Apr 8, 2026
Merged

Attempt to fix flaky Infra test#261465
miloszmarcinkowski merged 2 commits intoelastic:mainfrom
miloszmarcinkowski:258194-failing-test-x-pack-observability-functional-ui-testsx-packsolutionsobservabilitytestfunctionalappsinfrahosts_viewts

Conversation

@miloszmarcinkowski
Copy link
Copy Markdown
Contributor

@miloszmarcinkowski miloszmarcinkowski commented Apr 7, 2026

Closes #258194

Summary

An attempt to fix flaky Infrastructure test by verifying if Host view flyout is opened before proceeding further with other steps. There wasn't reliable way to replicate the flakiness on the local. Follow up on #257997

How to test locally

node scripts/functional_tests_server --config x-pack/solutions/observability/test/functional/apps/infra/config.ts
for i in $(seq 1 10); do
  echo "=== Run $i ==="
  node scripts/functional_test_runner \
    --config x-pack/solutions/observability/test/functional/apps/infra/config.ts \
    --grep "Dashboards Tab" \
    || echo "FAILED on run $i"
done

…yout was opened in the test before proceeding further

- Added a `data-test-subj` attribute to the `EuiFlyout` in the Flyout component for improved testing capabilities.
- Updated the InfraHostsView functional tests to check for the existence of the new `infraAssetDetailsFlyout` test subject, enhancing test coverage for the flyout functionality.
@miloszmarcinkowski miloszmarcinkowski added the release_note:skip Skip the PR/issue when compiling release notes label Apr 7, 2026
@miloszmarcinkowski miloszmarcinkowski requested a review from a team as a code owner April 7, 2026 07:53
@miloszmarcinkowski miloszmarcinkowski added the backport:all-open Backport to all branches that could still receive a release label Apr 7, 2026
…ctional-ui-testsx-packsolutionsobservabilitytestfunctionalappsinfrahosts_viewts
@elasticmachine
Copy link
Copy Markdown
Contributor

💛 Build succeeded, but was flaky

Failed CI Steps

Test Failures

  • [job] [logs] Scout: [ platform / alerting_v2 ] plugin / local-serverless-observability_complete - Discover Alerts menu with alerting v2 - should show Alerts menu with v2 ES|QL rule row and New badge
  • [job] [logs] Scout: [ platform / alerting_v2 ] plugin / local-serverless-security_complete - Discover Alerts menu with alerting v2 - should show Alerts menu with v2 ES|QL rule row and New badge

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
infra 1.3MB 1.3MB +43.0B

@kibanamachine
Copy link
Copy Markdown
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#11406

[✅] x-pack/solutions/observability/test/functional/apps/infra/config.ts: 100/100 tests passed.

see run history

@miloszmarcinkowski miloszmarcinkowski added the Team:obs-presentation Focus: APM UI, Infra UI, Hosts UI, Universal Profiling, Obs Overview and left Navigation label Apr 7, 2026
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/obs-presentation-team (Team:obs-presentation)

@macroscopeapp
Copy link
Copy Markdown
Contributor

macroscopeapp bot commented Apr 7, 2026

Approvability

Verdict: Would Approve

This PR adds a test subject attribute to a flyout component and waits for it in a functional test to fix flakiness. The changes are test infrastructure only with no runtime behavior impact.

Macroscope would have approved this PR. A repo admin can enable approvability here.

@miloszmarcinkowski miloszmarcinkowski merged commit fb8461f into elastic:main Apr 8, 2026
23 checks passed
@kibanamachine
Copy link
Copy Markdown
Contributor

Starting backport for target branches: 8.19, 9.2, 9.3

https://github.com/elastic/kibana/actions/runs/24140115139

kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Apr 8, 2026
Closes elastic#258194

## Summary

An attempt to fix flaky Infrastructure test by verifying if Host view
flyout is opened before proceeding further with other steps. There
wasn't reliable way to replicate the flakiness on the local. Follow up
on elastic#257997

### How to test locally
```
node scripts/functional_tests_server --config x-pack/solutions/observability/test/functional/apps/infra/config.ts
```

```
for i in $(seq 1 10); do
  echo "=== Run $i ==="
  node scripts/functional_test_runner \
    --config x-pack/solutions/observability/test/functional/apps/infra/config.ts \
    --grep "Dashboards Tab" \
    || echo "FAILED on run $i"
done
```

(cherry picked from commit fb8461f)
@kibanamachine
Copy link
Copy Markdown
Contributor

💔 Some backports could not be created

Status Branch Result
8.19 Backport failed because of merge conflicts

You might need to backport the following PRs to 8.19:
- [Infra] Fix hosts view tests (#257997)
9.2 Backport failed because of merge conflicts

You might need to backport the following PRs to 9.2:
- [Infra] Fix hosts view tests (#257997)
9.3

Note: Successful backport PRs will be merged automatically after passing CI.

Manual backport

To create the backport manually run:

node scripts/backport --pr 261465

Questions ?

Please refer to the Backport tool documentation

@miloszmarcinkowski miloszmarcinkowski added backport:version Backport to applied version labels v9.3.3 9.3 candidate and removed backport:all-open Backport to all branches that could still receive a release v9.3.3 labels Apr 8, 2026
@kibanamachine kibanamachine added the backport missing Added to PRs automatically when the are determined to be missing a backport. label Apr 9, 2026
@kibanamachine
Copy link
Copy Markdown
Contributor

Looks like this PR has a backport PR but it still hasn't been merged. Please merge it ASAP to keep the branches relatively in sync.
cc: @miloszmarcinkowski

kibanamachine added a commit that referenced this pull request Apr 10, 2026
# Backport

This will backport the following commits from `main` to `9.3`:
- [Attempt to fix flaky Infra test
(#261465)](#261465)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Miłosz
Marcinkowski","email":"38698566+miloszmarcinkowski@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-04-08T14:14:15Z","message":"Attempt
to fix flaky Infra test (#261465)\n\nCloses #258194\n\n## Summary\n\nAn
attempt to fix flaky Infrastructure test by verifying if Host
view\nflyout is opened before proceeding further with other steps.
There\nwasn't reliable way to replicate the flakiness on the local.
Follow up\non #257997\n\n### How to test locally\n```\nnode
scripts/functional_tests_server --config
x-pack/solutions/observability/test/functional/apps/infra/config.ts\n```\n\n```\nfor
i in $(seq 1 10); do\n echo \"=== Run $i ===\"\n node
scripts/functional_test_runner \\\n --config
x-pack/solutions/observability/test/functional/apps/infra/config.ts \\\n
--grep \"Dashboards Tab\" \\\n || echo \"FAILED on run
$i\"\ndone\n```","sha":"fb8461fdcbf6f9bfdb63eb8d4e9c814a65c62b5e","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:all-open","v9.4.0","Team:obs-presentation"],"title":"Attempt
to fix flaky Infra
test","number":261465,"url":"https://github.com/elastic/kibana/pull/261465","mergeCommit":{"message":"Attempt
to fix flaky Infra test (#261465)\n\nCloses #258194\n\n## Summary\n\nAn
attempt to fix flaky Infrastructure test by verifying if Host
view\nflyout is opened before proceeding further with other steps.
There\nwasn't reliable way to replicate the flakiness on the local.
Follow up\non #257997\n\n### How to test locally\n```\nnode
scripts/functional_tests_server --config
x-pack/solutions/observability/test/functional/apps/infra/config.ts\n```\n\n```\nfor
i in $(seq 1 10); do\n echo \"=== Run $i ===\"\n node
scripts/functional_test_runner \\\n --config
x-pack/solutions/observability/test/functional/apps/infra/config.ts \\\n
--grep \"Dashboards Tab\" \\\n || echo \"FAILED on run
$i\"\ndone\n```","sha":"fb8461fdcbf6f9bfdb63eb8d4e9c814a65c62b5e"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/261465","number":261465,"mergeCommit":{"message":"Attempt
to fix flaky Infra test (#261465)\n\nCloses #258194\n\n## Summary\n\nAn
attempt to fix flaky Infrastructure test by verifying if Host
view\nflyout is opened before proceeding further with other steps.
There\nwasn't reliable way to replicate the flakiness on the local.
Follow up\non #257997\n\n### How to test locally\n```\nnode
scripts/functional_tests_server --config
x-pack/solutions/observability/test/functional/apps/infra/config.ts\n```\n\n```\nfor
i in $(seq 1 10); do\n echo \"=== Run $i ===\"\n node
scripts/functional_test_runner \\\n --config
x-pack/solutions/observability/test/functional/apps/infra/config.ts \\\n
--grep \"Dashboards Tab\" \\\n || echo \"FAILED on run
$i\"\ndone\n```","sha":"fb8461fdcbf6f9bfdb63eb8d4e9c814a65c62b5e"}}]}]
BACKPORT-->

Co-authored-by: Miłosz Marcinkowski <38698566+miloszmarcinkowski@users.noreply.github.com>
@kibanamachine kibanamachine added v9.3.4 and removed backport missing Added to PRs automatically when the are determined to be missing a backport. labels Apr 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

9.3 candidate backport:version Backport to applied version labels release_note:skip Skip the PR/issue when compiling release notes Team:obs-presentation Focus: APM UI, Infra UI, Hosts UI, Universal Profiling, Obs Overview and left Navigation v9.3.4 v9.4.0

Projects

None yet

4 participants