Skip to content

[Security Solution] Skipped tests: flaky Suricata tests#231473

Merged
agusruidiazgd merged 20 commits intoelastic:mainfrom
agusruidiazgd:fix/row_renderer-issue-126894
Jan 23, 2026
Merged

[Security Solution] Skipped tests: flaky Suricata tests#231473
agusruidiazgd merged 20 commits intoelastic:mainfrom
agusruidiazgd:fix/row_renderer-issue-126894

Conversation

@agusruidiazgd
Copy link
Copy Markdown
Contributor

@agusruidiazgd agusruidiazgd commented Aug 12, 2025

Summary

Closes #126894

Checklist

Check the PR satisfies following conditions.

Reviewers should verify this PR satisfies this list as well.

@agusruidiazgd agusruidiazgd self-assigned this Aug 12, 2025
@agusruidiazgd agusruidiazgd added release_note:skip Skip the PR/issue when compiling release notes backport:skip This PR does not require backporting Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Team:Threat Hunting:Investigations Security Solution Threat Hunting Investigations Team ci:cloud-deploy Create or update a Cloud deployment labels Aug 12, 2025
@agusruidiazgd agusruidiazgd marked this pull request as ready for review August 12, 2025 15:56
@agusruidiazgd agusruidiazgd requested a review from a team as a code owner August 12, 2025 15:56
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/security-solution (Team: SecuritySolution)

@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/security-threat-hunting-investigations (Team:Threat Hunting:Investigations)

export const TIMELINE_ROW_RENDERERS_SURICATA_SIGNATURE = `${TIMELINE_ROW_RENDERERS_MODAL} [data-test-subj="render-content-suricata.eve.alert.signature"]`;

export const TIMELINE_ROW_RENDERERS_SURICATA_LINK_TOOLTIP = `[data-test-subj="externalLinkTooltip"]`;
export const TIMELINE_ROW_RENDERERS_SURICATA_LINK_TOOLTIP = `[data-test-subj="externalLink"]`;
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

used only in one test

Comment on lines +138 to +139
cy.get(TIMELINE_ROW_RENDERERS_SEARCHBOX).should('exist');
cy.get(TIMELINE_ROW_RENDERERS_SEARCHBOX).type('suricata');
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

check that Suricata item is on the screen

@PhilippeOberti
Copy link
Copy Markdown
Contributor

Let's run theFlaky Test Runner for this one as well... Take a look at this commit to hack your way around and run the Flaky Test Runner only for that one file, it'll save you a ton of time!

The link to the Flaky Test Runner is at the top of this documentation. I have ran mine 25 times for Security Solution Investigations - Cypress and 25 times for [Serverless] Security Solution Investigations.

Just make sure that you undo the change to the package.json file after the Flaky Test Runner is done and before merging the PR!

@agusruidiazgd agusruidiazgd requested a review from a team as a code owner August 18, 2025 08:16
@kibanamachine
Copy link
Copy Markdown
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#9167

[❌] Security Solution Investigations - Cypress: 0/25 tests passed.
[❌] [Serverless] Security Solution Investigations - Cypress: 0/25 tests passed.

see run history

@kibanamachine
Copy link
Copy Markdown
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#9183

[❌] Security Solution Investigations - Cypress: 0/25 tests passed.
[❌] [Serverless] Security Solution Investigations - Cypress: 0/25 tests passed.

see run history

@kibanamachine
Copy link
Copy Markdown
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#9208

[✅] Security Solution Investigations - Cypress: 25/25 tests passed.
[✅] [Serverless] Security Solution Investigations - Cypress: 25/25 tests passed.

see run history

@agusruidiazgd
Copy link
Copy Markdown
Contributor Author

@elasticmachine merge upstream

@agusruidiazgd agusruidiazgd enabled auto-merge (squash) August 25, 2025 13:32
Copy link
Copy Markdown
Contributor

@NicholasPeretti NicholasPeretti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for taking care of this! ☺️

@agusruidiazgd
Copy link
Copy Markdown
Contributor Author

@elasticmachine merge upstream

@agusruidiazgd
Copy link
Copy Markdown
Contributor Author

@elasticmachine merge upstream

@agusruidiazgd
Copy link
Copy Markdown
Contributor Author

@elasticmachine merge upstream

@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Nov 25, 2025

});

it('Signature tooltips do not overlap', () => {
// Hover the signature to show the tooltips
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Instead of adding a comment, the block of code that performs the hover should be extracted into a task.

it('Signature tooltips do not overlap', () => {
// Hover the signature to show the tooltips
cy.get(TIMELINE_SHOW_ROW_RENDERERS_GEAR).realClick();
cy.get(TIMELINE_ROW_RENDERERS_SEARCHBOX).should('exist');
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cypress automatically waits for the element to exist and be visible before .type(), so should('exist') is redundant.

Moreover should('exist') might be flaky, since the element might exist in the DOM and not be visible, so in case of wanting to check something is more robust to check the visibility.

@MadameSheema
Copy link
Copy Markdown
Contributor

Has this test been exercised recently using the flaky test runner?

@agusruidiazgd agusruidiazgd merged commit b66c54a into elastic:main Jan 23, 2026
10 of 12 checks passed
Ikuni17 added a commit that referenced this pull request Jan 24, 2026
Ikuni17 added a commit that referenced this pull request Jan 24, 2026
…0296)

Reverts #231473. This PR was allowed to auto-merged
accidently
@Ikuni17
Copy link
Copy Markdown
Contributor

Ikuni17 commented Jan 24, 2026

Sorry for the trouble, this PR was able to accidently get through auto-merge and has been reverted

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:skip This PR does not require backporting ci:cloud-deploy Create or update a Cloud deployment release_note:skip Skip the PR/issue when compiling release notes reverted Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Team:Threat Hunting:Investigations Security Solution Threat Hunting Investigations Team v9.4.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[SecuritySolution] Investigate flaky Suricata tests

7 participants