[Security Solution] Split prebuilt rule Cypress tests #231150
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Moves Cypress end-to-end tests for prebuilt rules into more specific subdirectories based on their functionality, such as installation, customization, upgrade, and management. This improves the structure and maintainability of the test suite.
nikitaindik
added
Team:Detections and Resp
Contributor
|
Pinging @elastic/security-detections-response (Team:Detections and Resp) |
Contributor
|
Pinging @elastic/security-solution (Team: SecuritySolution) |
Contributor
|
Pinging @elastic/security-detection-rule-management (Team:Detection Rule Management) |
73 tasks
banderror
approved these changes
Aug 11, 2025
Contributor
banderror
left a comment
banderror
left a comment
There was a problem hiding this comment.
Great work @nikitaindik, thank you for all the attention to detail 👍
All the changes LGTM. Just left a nit regarding formatting markdown tables. Can be done in a separate PR.
All the new groups of tests seem to succeed in CI. I also triggered a Flaky Test Runner job, just in case.
x-pack/solutions/security/test/security_solution_cypress/cypress/README.md
Outdated
Show resolved
Hide resolved
Contributor
💛 Build succeeded, but was flaky
Failed CI StepsMetrics [docs]
History
cc @nikitaindik |
Contributor
Flaky Test Runner Stats🎉 All tests passed! - kibana-flaky-test-suite-runner#9081[✅] Security Solution Rule Management - Prebuilt Rules Customization - Cypress: 2/2 tests passed. |
Contributor
Author
Files by Code Ownerelastic/kibana-operations
elastic/security-detection-rule-management
elastic/security-engineering-productivity
|
nikitaindik
added a commit
to nikitaindik/kibana
that referenced
this pull request
Aug 12, 2025
**Part of epic: elastic#229688 ## Summary We have recently observed that some prebuilt detection rules in Cypress tests run for over 60 minutes in CI pipelines. This leads to pipeline timeouts. As a temporary measure `parallelism` was increased to 2 [recently](elastic#230969). This PR divides the Cypress tests for prebuilt detection rules into four separate groups to avoid hitting the 60m limit. ## Changes - Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs: - `installation` - `upgrade` - `customization` - `management` (enabling/disabling, deletion, import and export of rules) - Added `yarn` commands and `bash` scripts to run tests from each subdirectory - Registered new groups in BuildKite pipelines (with `parallelism: 1`): - `pull_request/security_solution/rule_management.yml` - `on_merge.yml` - `chrome_forward_testing.yml` - `pointer_compression.yml` - `verify_es_serverless_image.yml` (Serverless tests only) - Registered the new scripts in the Flaky Test Runner ## Running times in pull request pipeline Link to this PR's run in pull request pipeline: https://buildkite.com/elastic/kibana-pull-request/builds/327944 **Non-Serverless groups:** - 13 min: Rule Management - Prebuilt Rules Customization - Security Solution Cypress Tests - 13 min: Rule Management - Prebuilt Rules Installation - Security Solution Cypress Tests - 10 min: Rule Management - Prebuilt Rules Management - Security Solution Cypress Tests - 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution Cypress Tests **Serverless groups:** - 17 min: Serverless Rule Management - Prebuilt Rules Customization - Security Solution Cypress Tests - 16 min: Serverless Rule Management - Prebuilt Rules Installation - Security Solution Cypress Tests - 11 min: Serverless Rule Management - Prebuilt Rules Management - Security Solution Cypress Tests - 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security Solution Cypress Tests Each group's running time is significantly below the 60-minute limit. (cherry picked from commit 40b7b42) # Conflicts: # .buildkite/pipelines/chrome_forward_testing.yml # .buildkite/pipelines/es_serverless/verify_es_serverless_image.yml # .buildkite/pipelines/on_merge.yml # .buildkite/pipelines/pointer_compression.yml # .buildkite/pipelines/pull_request/security_solution/rule_management.yml # x-pack/solutions/security/test/security_solution_cypress/cypress/README.md # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/customization/revert_prebuilt_rule.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/customization/rule_customization.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/export_prebuilt_rule.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/import_prebuilt_rule.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_error_handling.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_notifications.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_update_authorization.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_via_fleet.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_with_preview.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_workflow.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/installation/install_error_handling.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/installation/install_notifications.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/installation/install_update_authorization.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/installation/install_via_fleet.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/installation/install_with_preview.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/installation/install_workflow.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/management.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/management/export_prebuilt_rule.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/management/import_prebuilt_rule.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/management/management.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/rule_customization.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade/upgrade_error_handling.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade/upgrade_notifications.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade/upgrade_with_preview.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade/upgrade_with_preview_basic_license.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade/upgrade_without_preview.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade/upgrade_without_preview_basic_license.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_error_handling.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_notifications.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_with_preview.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_with_preview_basic_license.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_without_preview.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_without_preview_basic_license.cy.ts # x-pack/solutions/security/test/security_solution_cypress/package.json # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/export_prebuilt_rule.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/import_prebuilt_rule.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_error_handling.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_notifications.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_update_authorization.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_via_fleet.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_with_preview.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_workflow.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/management.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/rule_customization.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_error_handling.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_notifications.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_with_preview.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_with_preview_basic_license.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_without_preview.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_without_preview_basic_license.cy.ts
Contributor
Author
💚 All backports created successfully
Note: Successful backport PRs will be merged automatically after passing CI. Questions ?Please refer to the Backport tool documentation |
nikitaindik
added a commit
that referenced
this pull request
Aug 12, 2025
…#231468) # Backport This will backport the following commits from `main` to `9.1`: - [[Security Solution] Split prebuilt rule Cypress tests (#231150)](#231150) <!--- Backport version: 10.0.1 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Nikita Indik","email":"nikita.indik@elastic.co"},"sourceCommit":{"committedDate":"2025-08-12T14:07:45Z","message":"[Security Solution] Split prebuilt rule Cypress tests (#231150)\n\n**Part of epic: https://github.com/elastic/kibana/issues/229688**\n\n## Summary \nWe have recently observed that some prebuilt detection rules in Cypress\ntests run for over 60 minutes in CI pipelines. This leads to pipeline\ntimeouts. As a temporary measure `parallelism` was increased to 2\n[recently](https://github.com/elastic/kibana/pull/230969).\n\nThis PR divides the Cypress tests for prebuilt detection rules into four\nseparate groups to avoid hitting the 60m limit.\n\n## Changes\n- Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs:\n - `installation`\n - `upgrade`\n - `customization`\n- `management` (enabling/disabling, deletion, import and export of\nrules)\n- Added `yarn` commands and `bash` scripts to run tests from each\nsubdirectory\n- Registered new groups in BuildKite pipelines (with `parallelism: 1`):\n - `pull_request/security_solution/rule_management.yml`\n - `on_merge.yml`\n - `chrome_forward_testing.yml`\n - `pointer_compression.yml`\n - `verify_es_serverless_image.yml` (Serverless tests only)\n- Registered the new scripts in the Flaky Test Runner\n\n## Running times in pull request pipeline\nLink to this PR's run in pull request pipeline:\nhttps://buildkite.com/elastic/kibana-pull-request/builds/327944\n\n**Non-Serverless groups:**\n- 13 min: Rule Management - Prebuilt Rules Customization - Security\nSolution Cypress Tests\n- 13 min: Rule Management - Prebuilt Rules Installation - Security\nSolution Cypress Tests\n- 10 min: Rule Management - Prebuilt Rules Management - Security\nSolution Cypress Tests\n- 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution\nCypress Tests\n\n**Serverless groups:**\n- 17 min: Serverless Rule Management - Prebuilt Rules Customization -\nSecurity Solution Cypress Tests\n- 16 min: Serverless Rule Management - Prebuilt Rules Installation -\nSecurity Solution Cypress Tests\n- 11 min: Serverless Rule Management - Prebuilt Rules Management -\nSecurity Solution Cypress Tests\n- 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security\nSolution Cypress Tests\n\nEach group's running time is significantly below the 60-minute limit.","sha":"40b7b42536a8262ede074813aa6de8677b5204e6","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","Team:Detections and Resp","Team: SecuritySolution","Team:Detection Rule Management","backport:version","v9.2.0","v9.0.5","v8.18.5","v9.1.2","v8.19.2"],"title":"[Security Solution] Split prebuilt rule Cypress tests","number":231150,"url":"https://github.com/elastic/kibana/pull/231150","mergeCommit":{"message":"[Security Solution] Split prebuilt rule Cypress tests (#231150)\n\n**Part of epic: https://github.com/elastic/kibana/issues/229688**\n\n## Summary \nWe have recently observed that some prebuilt detection rules in Cypress\ntests run for over 60 minutes in CI pipelines. This leads to pipeline\ntimeouts. As a temporary measure `parallelism` was increased to 2\n[recently](https://github.com/elastic/kibana/pull/230969).\n\nThis PR divides the Cypress tests for prebuilt detection rules into four\nseparate groups to avoid hitting the 60m limit.\n\n## Changes\n- Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs:\n - `installation`\n - `upgrade`\n - `customization`\n- `management` (enabling/disabling, deletion, import and export of\nrules)\n- Added `yarn` commands and `bash` scripts to run tests from each\nsubdirectory\n- Registered new groups in BuildKite pipelines (with `parallelism: 1`):\n - `pull_request/security_solution/rule_management.yml`\n - `on_merge.yml`\n - `chrome_forward_testing.yml`\n - `pointer_compression.yml`\n - `verify_es_serverless_image.yml` (Serverless tests only)\n- Registered the new scripts in the Flaky Test Runner\n\n## Running times in pull request pipeline\nLink to this PR's run in pull request pipeline:\nhttps://buildkite.com/elastic/kibana-pull-request/builds/327944\n\n**Non-Serverless groups:**\n- 13 min: Rule Management - Prebuilt Rules Customization - Security\nSolution Cypress Tests\n- 13 min: Rule Management - Prebuilt Rules Installation - Security\nSolution Cypress Tests\n- 10 min: Rule Management - Prebuilt Rules Management - Security\nSolution Cypress Tests\n- 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution\nCypress Tests\n\n**Serverless groups:**\n- 17 min: Serverless Rule Management - Prebuilt Rules Customization -\nSecurity Solution Cypress Tests\n- 16 min: Serverless Rule Management - Prebuilt Rules Installation -\nSecurity Solution Cypress Tests\n- 11 min: Serverless Rule Management - Prebuilt Rules Management -\nSecurity Solution Cypress Tests\n- 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security\nSolution Cypress Tests\n\nEach group's running time is significantly below the 60-minute limit.","sha":"40b7b42536a8262ede074813aa6de8677b5204e6"}},"sourceBranch":"main","suggestedTargetBranches":["9.0","8.18","9.1","8.19"],"targetPullRequestStates":[{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/231150","number":231150,"mergeCommit":{"message":"[Security Solution] Split prebuilt rule Cypress tests (#231150)\n\n**Part of epic: https://github.com/elastic/kibana/issues/229688**\n\n## Summary \nWe have recently observed that some prebuilt detection rules in Cypress\ntests run for over 60 minutes in CI pipelines. This leads to pipeline\ntimeouts. As a temporary measure `parallelism` was increased to 2\n[recently](https://github.com/elastic/kibana/pull/230969).\n\nThis PR divides the Cypress tests for prebuilt detection rules into four\nseparate groups to avoid hitting the 60m limit.\n\n## Changes\n- Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs:\n - `installation`\n - `upgrade`\n - `customization`\n- `management` (enabling/disabling, deletion, import and export of\nrules)\n- Added `yarn` commands and `bash` scripts to run tests from each\nsubdirectory\n- Registered new groups in BuildKite pipelines (with `parallelism: 1`):\n - `pull_request/security_solution/rule_management.yml`\n - `on_merge.yml`\n - `chrome_forward_testing.yml`\n - `pointer_compression.yml`\n - `verify_es_serverless_image.yml` (Serverless tests only)\n- Registered the new scripts in the Flaky Test Runner\n\n## Running times in pull request pipeline\nLink to this PR's run in pull request pipeline:\nhttps://buildkite.com/elastic/kibana-pull-request/builds/327944\n\n**Non-Serverless groups:**\n- 13 min: Rule Management - Prebuilt Rules Customization - Security\nSolution Cypress Tests\n- 13 min: Rule Management - Prebuilt Rules Installation - Security\nSolution Cypress Tests\n- 10 min: Rule Management - Prebuilt Rules Management - Security\nSolution Cypress Tests\n- 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution\nCypress Tests\n\n**Serverless groups:**\n- 17 min: Serverless Rule Management - Prebuilt Rules Customization -\nSecurity Solution Cypress Tests\n- 16 min: Serverless Rule Management - Prebuilt Rules Installation -\nSecurity Solution Cypress Tests\n- 11 min: Serverless Rule Management - Prebuilt Rules Management -\nSecurity Solution Cypress Tests\n- 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security\nSolution Cypress Tests\n\nEach group's running time is significantly below the 60-minute limit.","sha":"40b7b42536a8262ede074813aa6de8677b5204e6"}},{"branch":"9.0","label":"v9.0.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.18","label":"v8.18.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.1","label":"v9.1.2","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.2","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT-->
nikitaindik
added a commit
to nikitaindik/kibana
that referenced
this pull request
Aug 12, 2025
**Part of epic: elastic#229688 ## Summary We have recently observed that some prebuilt detection rules in Cypress tests run for over 60 minutes in CI pipelines. This leads to pipeline timeouts. As a temporary measure `parallelism` was increased to 2 [recently](elastic#230969). This PR divides the Cypress tests for prebuilt detection rules into four separate groups to avoid hitting the 60m limit. ## Changes - Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs: - `installation` - `upgrade` - `customization` - `management` (enabling/disabling, deletion, import and export of rules) - Added `yarn` commands and `bash` scripts to run tests from each subdirectory - Registered new groups in BuildKite pipelines (with `parallelism: 1`): - `pull_request/security_solution/rule_management.yml` - `on_merge.yml` - `chrome_forward_testing.yml` - `pointer_compression.yml` - `verify_es_serverless_image.yml` (Serverless tests only) - Registered the new scripts in the Flaky Test Runner ## Running times in pull request pipeline Link to this PR's run in pull request pipeline: https://buildkite.com/elastic/kibana-pull-request/builds/327944 **Non-Serverless groups:** - 13 min: Rule Management - Prebuilt Rules Customization - Security Solution Cypress Tests - 13 min: Rule Management - Prebuilt Rules Installation - Security Solution Cypress Tests - 10 min: Rule Management - Prebuilt Rules Management - Security Solution Cypress Tests - 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution Cypress Tests **Serverless groups:** - 17 min: Serverless Rule Management - Prebuilt Rules Customization - Security Solution Cypress Tests - 16 min: Serverless Rule Management - Prebuilt Rules Installation - Security Solution Cypress Tests - 11 min: Serverless Rule Management - Prebuilt Rules Management - Security Solution Cypress Tests - 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security Solution Cypress Tests Each group's running time is significantly below the 60-minute limit. (cherry picked from commit 40b7b42) # Conflicts: # .buildkite/pipelines/chrome_forward_testing.yml # .buildkite/pipelines/es_serverless/verify_es_serverless_image.yml # .buildkite/pipelines/on_merge.yml # .buildkite/pipelines/pointer_compression.yml # .buildkite/pipelines/pull_request/security_solution/rule_management.yml # x-pack/solutions/security/test/security_solution_cypress/cypress/README.md # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/customization/revert_prebuilt_rule.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/customization/rule_customization.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/export_prebuilt_rule.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/import_prebuilt_rule.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_error_handling.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_notifications.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_update_authorization.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_via_fleet.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_with_preview.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_workflow.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/installation/install_error_handling.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/installation/install_notifications.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/installation/install_update_authorization.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/installation/install_via_fleet.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/installation/install_with_preview.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/installation/install_workflow.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/management.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/management/export_prebuilt_rule.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/management/import_prebuilt_rule.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/management/management.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/rule_customization.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade/upgrade_error_handling.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade/upgrade_notifications.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade/upgrade_with_preview.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade/upgrade_with_preview_basic_license.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade/upgrade_without_preview.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade/upgrade_without_preview_basic_license.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_error_handling.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_notifications.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_with_preview.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_with_preview_basic_license.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_without_preview.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_without_preview_basic_license.cy.ts # x-pack/solutions/security/test/security_solution_cypress/package.json # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/export_prebuilt_rule.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/import_prebuilt_rule.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_error_handling.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_notifications.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_update_authorization.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_via_fleet.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_with_preview.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/install_workflow.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/management.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/rule_customization.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_error_handling.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_notifications.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_with_preview.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_with_preview_basic_license.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_without_preview.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/upgrade_without_preview_basic_license.cy.ts
nikitaindik
added a commit
that referenced
this pull request
Aug 13, 2025
…#231490) # Backport This will backport the following commits from `main` to `9.0`: - [[Security Solution] Split prebuilt rule Cypress tests (#231150)](#231150) <!--- Backport version: 10.0.1 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Nikita Indik","email":"nikita.indik@elastic.co"},"sourceCommit":{"committedDate":"2025-08-12T14:07:45Z","message":"[Security Solution] Split prebuilt rule Cypress tests (#231150)\n\n**Part of epic: https://github.com/elastic/kibana/issues/229688**\n\n## Summary \nWe have recently observed that some prebuilt detection rules in Cypress\ntests run for over 60 minutes in CI pipelines. This leads to pipeline\ntimeouts. As a temporary measure `parallelism` was increased to 2\n[recently](https://github.com/elastic/kibana/pull/230969).\n\nThis PR divides the Cypress tests for prebuilt detection rules into four\nseparate groups to avoid hitting the 60m limit.\n\n## Changes\n- Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs:\n - `installation`\n - `upgrade`\n - `customization`\n- `management` (enabling/disabling, deletion, import and export of\nrules)\n- Added `yarn` commands and `bash` scripts to run tests from each\nsubdirectory\n- Registered new groups in BuildKite pipelines (with `parallelism: 1`):\n - `pull_request/security_solution/rule_management.yml`\n - `on_merge.yml`\n - `chrome_forward_testing.yml`\n - `pointer_compression.yml`\n - `verify_es_serverless_image.yml` (Serverless tests only)\n- Registered the new scripts in the Flaky Test Runner\n\n## Running times in pull request pipeline\nLink to this PR's run in pull request pipeline:\nhttps://buildkite.com/elastic/kibana-pull-request/builds/327944\n\n**Non-Serverless groups:**\n- 13 min: Rule Management - Prebuilt Rules Customization - Security\nSolution Cypress Tests\n- 13 min: Rule Management - Prebuilt Rules Installation - Security\nSolution Cypress Tests\n- 10 min: Rule Management - Prebuilt Rules Management - Security\nSolution Cypress Tests\n- 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution\nCypress Tests\n\n**Serverless groups:**\n- 17 min: Serverless Rule Management - Prebuilt Rules Customization -\nSecurity Solution Cypress Tests\n- 16 min: Serverless Rule Management - Prebuilt Rules Installation -\nSecurity Solution Cypress Tests\n- 11 min: Serverless Rule Management - Prebuilt Rules Management -\nSecurity Solution Cypress Tests\n- 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security\nSolution Cypress Tests\n\nEach group's running time is significantly below the 60-minute limit.","sha":"40b7b42536a8262ede074813aa6de8677b5204e6","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","Team:Detections and Resp","Team: SecuritySolution","Team:Detection Rule Management","backport:version","v9.2.0","v9.0.5","v8.18.5","v9.1.2","v8.19.2"],"title":"[Security Solution] Split prebuilt rule Cypress tests","number":231150,"url":"https://github.com/elastic/kibana/pull/231150","mergeCommit":{"message":"[Security Solution] Split prebuilt rule Cypress tests (#231150)\n\n**Part of epic: https://github.com/elastic/kibana/issues/229688**\n\n## Summary \nWe have recently observed that some prebuilt detection rules in Cypress\ntests run for over 60 minutes in CI pipelines. This leads to pipeline\ntimeouts. As a temporary measure `parallelism` was increased to 2\n[recently](https://github.com/elastic/kibana/pull/230969).\n\nThis PR divides the Cypress tests for prebuilt detection rules into four\nseparate groups to avoid hitting the 60m limit.\n\n## Changes\n- Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs:\n - `installation`\n - `upgrade`\n - `customization`\n- `management` (enabling/disabling, deletion, import and export of\nrules)\n- Added `yarn` commands and `bash` scripts to run tests from each\nsubdirectory\n- Registered new groups in BuildKite pipelines (with `parallelism: 1`):\n - `pull_request/security_solution/rule_management.yml`\n - `on_merge.yml`\n - `chrome_forward_testing.yml`\n - `pointer_compression.yml`\n - `verify_es_serverless_image.yml` (Serverless tests only)\n- Registered the new scripts in the Flaky Test Runner\n\n## Running times in pull request pipeline\nLink to this PR's run in pull request pipeline:\nhttps://buildkite.com/elastic/kibana-pull-request/builds/327944\n\n**Non-Serverless groups:**\n- 13 min: Rule Management - Prebuilt Rules Customization - Security\nSolution Cypress Tests\n- 13 min: Rule Management - Prebuilt Rules Installation - Security\nSolution Cypress Tests\n- 10 min: Rule Management - Prebuilt Rules Management - Security\nSolution Cypress Tests\n- 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution\nCypress Tests\n\n**Serverless groups:**\n- 17 min: Serverless Rule Management - Prebuilt Rules Customization -\nSecurity Solution Cypress Tests\n- 16 min: Serverless Rule Management - Prebuilt Rules Installation -\nSecurity Solution Cypress Tests\n- 11 min: Serverless Rule Management - Prebuilt Rules Management -\nSecurity Solution Cypress Tests\n- 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security\nSolution Cypress Tests\n\nEach group's running time is significantly below the 60-minute limit.","sha":"40b7b42536a8262ede074813aa6de8677b5204e6"}},"sourceBranch":"main","suggestedTargetBranches":["9.0","8.18","9.1","8.19"],"targetPullRequestStates":[{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/231150","number":231150,"mergeCommit":{"message":"[Security Solution] Split prebuilt rule Cypress tests (#231150)\n\n**Part of epic: https://github.com/elastic/kibana/issues/229688**\n\n## Summary \nWe have recently observed that some prebuilt detection rules in Cypress\ntests run for over 60 minutes in CI pipelines. This leads to pipeline\ntimeouts. As a temporary measure `parallelism` was increased to 2\n[recently](https://github.com/elastic/kibana/pull/230969).\n\nThis PR divides the Cypress tests for prebuilt detection rules into four\nseparate groups to avoid hitting the 60m limit.\n\n## Changes\n- Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs:\n - `installation`\n - `upgrade`\n - `customization`\n- `management` (enabling/disabling, deletion, import and export of\nrules)\n- Added `yarn` commands and `bash` scripts to run tests from each\nsubdirectory\n- Registered new groups in BuildKite pipelines (with `parallelism: 1`):\n - `pull_request/security_solution/rule_management.yml`\n - `on_merge.yml`\n - `chrome_forward_testing.yml`\n - `pointer_compression.yml`\n - `verify_es_serverless_image.yml` (Serverless tests only)\n- Registered the new scripts in the Flaky Test Runner\n\n## Running times in pull request pipeline\nLink to this PR's run in pull request pipeline:\nhttps://buildkite.com/elastic/kibana-pull-request/builds/327944\n\n**Non-Serverless groups:**\n- 13 min: Rule Management - Prebuilt Rules Customization - Security\nSolution Cypress Tests\n- 13 min: Rule Management - Prebuilt Rules Installation - Security\nSolution Cypress Tests\n- 10 min: Rule Management - Prebuilt Rules Management - Security\nSolution Cypress Tests\n- 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution\nCypress Tests\n\n**Serverless groups:**\n- 17 min: Serverless Rule Management - Prebuilt Rules Customization -\nSecurity Solution Cypress Tests\n- 16 min: Serverless Rule Management - Prebuilt Rules Installation -\nSecurity Solution Cypress Tests\n- 11 min: Serverless Rule Management - Prebuilt Rules Management -\nSecurity Solution Cypress Tests\n- 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security\nSolution Cypress Tests\n\nEach group's running time is significantly below the 60-minute limit.","sha":"40b7b42536a8262ede074813aa6de8677b5204e6"}},{"branch":"9.0","label":"v9.0.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.18","label":"v8.18.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.1","label":"v9.1.2","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.2","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT-->
nikitaindik
added a commit
that referenced
this pull request
Aug 13, 2025
#231504) # Backport This will backport the following commits from `main` to `8.19`: - [[Security Solution] Split prebuilt rule Cypress tests (#231150)](#231150) <!--- Backport version: 10.0.1 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Nikita Indik","email":"nikita.indik@elastic.co"},"sourceCommit":{"committedDate":"2025-08-12T14:07:45Z","message":"[Security Solution] Split prebuilt rule Cypress tests (#231150)\n\n**Part of epic: https://github.com/elastic/kibana/issues/229688**\n\n## Summary \nWe have recently observed that some prebuilt detection rules in Cypress\ntests run for over 60 minutes in CI pipelines. This leads to pipeline\ntimeouts. As a temporary measure `parallelism` was increased to 2\n[recently](https://github.com/elastic/kibana/pull/230969).\n\nThis PR divides the Cypress tests for prebuilt detection rules into four\nseparate groups to avoid hitting the 60m limit.\n\n## Changes\n- Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs:\n - `installation`\n - `upgrade`\n - `customization`\n- `management` (enabling/disabling, deletion, import and export of\nrules)\n- Added `yarn` commands and `bash` scripts to run tests from each\nsubdirectory\n- Registered new groups in BuildKite pipelines (with `parallelism: 1`):\n - `pull_request/security_solution/rule_management.yml`\n - `on_merge.yml`\n - `chrome_forward_testing.yml`\n - `pointer_compression.yml`\n - `verify_es_serverless_image.yml` (Serverless tests only)\n- Registered the new scripts in the Flaky Test Runner\n\n## Running times in pull request pipeline\nLink to this PR's run in pull request pipeline:\nhttps://buildkite.com/elastic/kibana-pull-request/builds/327944\n\n**Non-Serverless groups:**\n- 13 min: Rule Management - Prebuilt Rules Customization - Security\nSolution Cypress Tests\n- 13 min: Rule Management - Prebuilt Rules Installation - Security\nSolution Cypress Tests\n- 10 min: Rule Management - Prebuilt Rules Management - Security\nSolution Cypress Tests\n- 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution\nCypress Tests\n\n**Serverless groups:**\n- 17 min: Serverless Rule Management - Prebuilt Rules Customization -\nSecurity Solution Cypress Tests\n- 16 min: Serverless Rule Management - Prebuilt Rules Installation -\nSecurity Solution Cypress Tests\n- 11 min: Serverless Rule Management - Prebuilt Rules Management -\nSecurity Solution Cypress Tests\n- 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security\nSolution Cypress Tests\n\nEach group's running time is significantly below the 60-minute limit.","sha":"40b7b42536a8262ede074813aa6de8677b5204e6","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","Team:Detections and Resp","Team: SecuritySolution","Team:Detection Rule Management","backport:version","v9.2.0","v9.0.5","v8.18.5","v9.1.2","v8.19.2"],"title":"[Security Solution] Split prebuilt rule Cypress tests","number":231150,"url":"https://github.com/elastic/kibana/pull/231150","mergeCommit":{"message":"[Security Solution] Split prebuilt rule Cypress tests (#231150)\n\n**Part of epic: https://github.com/elastic/kibana/issues/229688**\n\n## Summary \nWe have recently observed that some prebuilt detection rules in Cypress\ntests run for over 60 minutes in CI pipelines. This leads to pipeline\ntimeouts. As a temporary measure `parallelism` was increased to 2\n[recently](https://github.com/elastic/kibana/pull/230969).\n\nThis PR divides the Cypress tests for prebuilt detection rules into four\nseparate groups to avoid hitting the 60m limit.\n\n## Changes\n- Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs:\n - `installation`\n - `upgrade`\n - `customization`\n- `management` (enabling/disabling, deletion, import and export of\nrules)\n- Added `yarn` commands and `bash` scripts to run tests from each\nsubdirectory\n- Registered new groups in BuildKite pipelines (with `parallelism: 1`):\n - `pull_request/security_solution/rule_management.yml`\n - `on_merge.yml`\n - `chrome_forward_testing.yml`\n - `pointer_compression.yml`\n - `verify_es_serverless_image.yml` (Serverless tests only)\n- Registered the new scripts in the Flaky Test Runner\n\n## Running times in pull request pipeline\nLink to this PR's run in pull request pipeline:\nhttps://buildkite.com/elastic/kibana-pull-request/builds/327944\n\n**Non-Serverless groups:**\n- 13 min: Rule Management - Prebuilt Rules Customization - Security\nSolution Cypress Tests\n- 13 min: Rule Management - Prebuilt Rules Installation - Security\nSolution Cypress Tests\n- 10 min: Rule Management - Prebuilt Rules Management - Security\nSolution Cypress Tests\n- 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution\nCypress Tests\n\n**Serverless groups:**\n- 17 min: Serverless Rule Management - Prebuilt Rules Customization -\nSecurity Solution Cypress Tests\n- 16 min: Serverless Rule Management - Prebuilt Rules Installation -\nSecurity Solution Cypress Tests\n- 11 min: Serverless Rule Management - Prebuilt Rules Management -\nSecurity Solution Cypress Tests\n- 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security\nSolution Cypress Tests\n\nEach group's running time is significantly below the 60-minute limit.","sha":"40b7b42536a8262ede074813aa6de8677b5204e6"}},"sourceBranch":"main","suggestedTargetBranches":["9.0","8.18","9.1","8.19"],"targetPullRequestStates":[{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/231150","number":231150,"mergeCommit":{"message":"[Security Solution] Split prebuilt rule Cypress tests (#231150)\n\n**Part of epic: https://github.com/elastic/kibana/issues/229688**\n\n## Summary \nWe have recently observed that some prebuilt detection rules in Cypress\ntests run for over 60 minutes in CI pipelines. This leads to pipeline\ntimeouts. As a temporary measure `parallelism` was increased to 2\n[recently](https://github.com/elastic/kibana/pull/230969).\n\nThis PR divides the Cypress tests for prebuilt detection rules into four\nseparate groups to avoid hitting the 60m limit.\n\n## Changes\n- Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs:\n - `installation`\n - `upgrade`\n - `customization`\n- `management` (enabling/disabling, deletion, import and export of\nrules)\n- Added `yarn` commands and `bash` scripts to run tests from each\nsubdirectory\n- Registered new groups in BuildKite pipelines (with `parallelism: 1`):\n - `pull_request/security_solution/rule_management.yml`\n - `on_merge.yml`\n - `chrome_forward_testing.yml`\n - `pointer_compression.yml`\n - `verify_es_serverless_image.yml` (Serverless tests only)\n- Registered the new scripts in the Flaky Test Runner\n\n## Running times in pull request pipeline\nLink to this PR's run in pull request pipeline:\nhttps://buildkite.com/elastic/kibana-pull-request/builds/327944\n\n**Non-Serverless groups:**\n- 13 min: Rule Management - Prebuilt Rules Customization - Security\nSolution Cypress Tests\n- 13 min: Rule Management - Prebuilt Rules Installation - Security\nSolution Cypress Tests\n- 10 min: Rule Management - Prebuilt Rules Management - Security\nSolution Cypress Tests\n- 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution\nCypress Tests\n\n**Serverless groups:**\n- 17 min: Serverless Rule Management - Prebuilt Rules Customization -\nSecurity Solution Cypress Tests\n- 16 min: Serverless Rule Management - Prebuilt Rules Installation -\nSecurity Solution Cypress Tests\n- 11 min: Serverless Rule Management - Prebuilt Rules Management -\nSecurity Solution Cypress Tests\n- 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security\nSolution Cypress Tests\n\nEach group's running time is significantly below the 60-minute limit.","sha":"40b7b42536a8262ede074813aa6de8677b5204e6"}},{"branch":"9.0","label":"v9.0.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.18","label":"v8.18.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.1","label":"v9.1.2","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.2","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT-->
nikitaindik
added a commit
that referenced
this pull request
Aug 13, 2025
#231507) # Backport This will backport the following commits from `main` to `8.18`: - [[Security Solution] Split prebuilt rule Cypress tests (#231150)](#231150) <!--- Backport version: 10.0.1 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Nikita Indik","email":"nikita.indik@elastic.co"},"sourceCommit":{"committedDate":"2025-08-12T14:07:45Z","message":"[Security Solution] Split prebuilt rule Cypress tests (#231150)\n\n**Part of epic: https://github.com/elastic/kibana/issues/229688**\n\n## Summary \nWe have recently observed that some prebuilt detection rules in Cypress\ntests run for over 60 minutes in CI pipelines. This leads to pipeline\ntimeouts. As a temporary measure `parallelism` was increased to 2\n[recently](https://github.com/elastic/kibana/pull/230969).\n\nThis PR divides the Cypress tests for prebuilt detection rules into four\nseparate groups to avoid hitting the 60m limit.\n\n## Changes\n- Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs:\n - `installation`\n - `upgrade`\n - `customization`\n- `management` (enabling/disabling, deletion, import and export of\nrules)\n- Added `yarn` commands and `bash` scripts to run tests from each\nsubdirectory\n- Registered new groups in BuildKite pipelines (with `parallelism: 1`):\n - `pull_request/security_solution/rule_management.yml`\n - `on_merge.yml`\n - `chrome_forward_testing.yml`\n - `pointer_compression.yml`\n - `verify_es_serverless_image.yml` (Serverless tests only)\n- Registered the new scripts in the Flaky Test Runner\n\n## Running times in pull request pipeline\nLink to this PR's run in pull request pipeline:\nhttps://buildkite.com/elastic/kibana-pull-request/builds/327944\n\n**Non-Serverless groups:**\n- 13 min: Rule Management - Prebuilt Rules Customization - Security\nSolution Cypress Tests\n- 13 min: Rule Management - Prebuilt Rules Installation - Security\nSolution Cypress Tests\n- 10 min: Rule Management - Prebuilt Rules Management - Security\nSolution Cypress Tests\n- 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution\nCypress Tests\n\n**Serverless groups:**\n- 17 min: Serverless Rule Management - Prebuilt Rules Customization -\nSecurity Solution Cypress Tests\n- 16 min: Serverless Rule Management - Prebuilt Rules Installation -\nSecurity Solution Cypress Tests\n- 11 min: Serverless Rule Management - Prebuilt Rules Management -\nSecurity Solution Cypress Tests\n- 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security\nSolution Cypress Tests\n\nEach group's running time is significantly below the 60-minute limit.","sha":"40b7b42536a8262ede074813aa6de8677b5204e6","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","Team:Detections and Resp","Team: SecuritySolution","Team:Detection Rule Management","backport:version","v9.2.0","v9.0.5","v8.18.5","v9.1.2","v8.19.2"],"title":"[Security Solution] Split prebuilt rule Cypress tests","number":231150,"url":"https://github.com/elastic/kibana/pull/231150","mergeCommit":{"message":"[Security Solution] Split prebuilt rule Cypress tests (#231150)\n\n**Part of epic: https://github.com/elastic/kibana/issues/229688**\n\n## Summary \nWe have recently observed that some prebuilt detection rules in Cypress\ntests run for over 60 minutes in CI pipelines. This leads to pipeline\ntimeouts. As a temporary measure `parallelism` was increased to 2\n[recently](https://github.com/elastic/kibana/pull/230969).\n\nThis PR divides the Cypress tests for prebuilt detection rules into four\nseparate groups to avoid hitting the 60m limit.\n\n## Changes\n- Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs:\n - `installation`\n - `upgrade`\n - `customization`\n- `management` (enabling/disabling, deletion, import and export of\nrules)\n- Added `yarn` commands and `bash` scripts to run tests from each\nsubdirectory\n- Registered new groups in BuildKite pipelines (with `parallelism: 1`):\n - `pull_request/security_solution/rule_management.yml`\n - `on_merge.yml`\n - `chrome_forward_testing.yml`\n - `pointer_compression.yml`\n - `verify_es_serverless_image.yml` (Serverless tests only)\n- Registered the new scripts in the Flaky Test Runner\n\n## Running times in pull request pipeline\nLink to this PR's run in pull request pipeline:\nhttps://buildkite.com/elastic/kibana-pull-request/builds/327944\n\n**Non-Serverless groups:**\n- 13 min: Rule Management - Prebuilt Rules Customization - Security\nSolution Cypress Tests\n- 13 min: Rule Management - Prebuilt Rules Installation - Security\nSolution Cypress Tests\n- 10 min: Rule Management - Prebuilt Rules Management - Security\nSolution Cypress Tests\n- 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution\nCypress Tests\n\n**Serverless groups:**\n- 17 min: Serverless Rule Management - Prebuilt Rules Customization -\nSecurity Solution Cypress Tests\n- 16 min: Serverless Rule Management - Prebuilt Rules Installation -\nSecurity Solution Cypress Tests\n- 11 min: Serverless Rule Management - Prebuilt Rules Management -\nSecurity Solution Cypress Tests\n- 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security\nSolution Cypress Tests\n\nEach group's running time is significantly below the 60-minute limit.","sha":"40b7b42536a8262ede074813aa6de8677b5204e6"}},"sourceBranch":"main","suggestedTargetBranches":["9.0","8.18","9.1","8.19"],"targetPullRequestStates":[{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/231150","number":231150,"mergeCommit":{"message":"[Security Solution] Split prebuilt rule Cypress tests (#231150)\n\n**Part of epic: https://github.com/elastic/kibana/issues/229688**\n\n## Summary \nWe have recently observed that some prebuilt detection rules in Cypress\ntests run for over 60 minutes in CI pipelines. This leads to pipeline\ntimeouts. As a temporary measure `parallelism` was increased to 2\n[recently](https://github.com/elastic/kibana/pull/230969).\n\nThis PR divides the Cypress tests for prebuilt detection rules into four\nseparate groups to avoid hitting the 60m limit.\n\n## Changes\n- Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs:\n - `installation`\n - `upgrade`\n - `customization`\n- `management` (enabling/disabling, deletion, import and export of\nrules)\n- Added `yarn` commands and `bash` scripts to run tests from each\nsubdirectory\n- Registered new groups in BuildKite pipelines (with `parallelism: 1`):\n - `pull_request/security_solution/rule_management.yml`\n - `on_merge.yml`\n - `chrome_forward_testing.yml`\n - `pointer_compression.yml`\n - `verify_es_serverless_image.yml` (Serverless tests only)\n- Registered the new scripts in the Flaky Test Runner\n\n## Running times in pull request pipeline\nLink to this PR's run in pull request pipeline:\nhttps://buildkite.com/elastic/kibana-pull-request/builds/327944\n\n**Non-Serverless groups:**\n- 13 min: Rule Management - Prebuilt Rules Customization - Security\nSolution Cypress Tests\n- 13 min: Rule Management - Prebuilt Rules Installation - Security\nSolution Cypress Tests\n- 10 min: Rule Management - Prebuilt Rules Management - Security\nSolution Cypress Tests\n- 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution\nCypress Tests\n\n**Serverless groups:**\n- 17 min: Serverless Rule Management - Prebuilt Rules Customization -\nSecurity Solution Cypress Tests\n- 16 min: Serverless Rule Management - Prebuilt Rules Installation -\nSecurity Solution Cypress Tests\n- 11 min: Serverless Rule Management - Prebuilt Rules Management -\nSecurity Solution Cypress Tests\n- 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security\nSolution Cypress Tests\n\nEach group's running time is significantly below the 60-minute limit.","sha":"40b7b42536a8262ede074813aa6de8677b5204e6"}},{"branch":"9.0","label":"v9.0.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.18","label":"v8.18.5","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.1","label":"v9.1.2","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.2","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT-->
delanni
added a commit
that referenced
this pull request
Aug 14, 2025
## Summary Small correction after #231150
fkanout
pushed a commit
to fkanout/kibana
that referenced
this pull request
Aug 14, 2025
**Part of epic: elastic#229688 ## Summary We have recently observed that some prebuilt detection rules in Cypress tests run for over 60 minutes in CI pipelines. This leads to pipeline timeouts. As a temporary measure `parallelism` was increased to 2 [recently](elastic#230969). This PR divides the Cypress tests for prebuilt detection rules into four separate groups to avoid hitting the 60m limit. ## Changes - Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs: - `installation` - `upgrade` - `customization` - `management` (enabling/disabling, deletion, import and export of rules) - Added `yarn` commands and `bash` scripts to run tests from each subdirectory - Registered new groups in BuildKite pipelines (with `parallelism: 1`): - `pull_request/security_solution/rule_management.yml` - `on_merge.yml` - `chrome_forward_testing.yml` - `pointer_compression.yml` - `verify_es_serverless_image.yml` (Serverless tests only) - Registered the new scripts in the Flaky Test Runner ## Running times in pull request pipeline Link to this PR's run in pull request pipeline: https://buildkite.com/elastic/kibana-pull-request/builds/327944 **Non-Serverless groups:** - 13 min: Rule Management - Prebuilt Rules Customization - Security Solution Cypress Tests - 13 min: Rule Management - Prebuilt Rules Installation - Security Solution Cypress Tests - 10 min: Rule Management - Prebuilt Rules Management - Security Solution Cypress Tests - 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution Cypress Tests **Serverless groups:** - 17 min: Serverless Rule Management - Prebuilt Rules Customization - Security Solution Cypress Tests - 16 min: Serverless Rule Management - Prebuilt Rules Installation - Security Solution Cypress Tests - 11 min: Serverless Rule Management - Prebuilt Rules Management - Security Solution Cypress Tests - 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security Solution Cypress Tests Each group's running time is significantly below the 60-minute limit.
fkanout
pushed a commit
to fkanout/kibana
that referenced
this pull request
Aug 14, 2025
## Summary Small correction after elastic#231150
NicholasPeretti
pushed a commit
to NicholasPeretti/kibana
that referenced
this pull request
Aug 18, 2025
**Part of epic: elastic#229688 ## Summary We have recently observed that some prebuilt detection rules in Cypress tests run for over 60 minutes in CI pipelines. This leads to pipeline timeouts. As a temporary measure `parallelism` was increased to 2 [recently](elastic#230969). This PR divides the Cypress tests for prebuilt detection rules into four separate groups to avoid hitting the 60m limit. ## Changes - Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs: - `installation` - `upgrade` - `customization` - `management` (enabling/disabling, deletion, import and export of rules) - Added `yarn` commands and `bash` scripts to run tests from each subdirectory - Registered new groups in BuildKite pipelines (with `parallelism: 1`): - `pull_request/security_solution/rule_management.yml` - `on_merge.yml` - `chrome_forward_testing.yml` - `pointer_compression.yml` - `verify_es_serverless_image.yml` (Serverless tests only) - Registered the new scripts in the Flaky Test Runner ## Running times in pull request pipeline Link to this PR's run in pull request pipeline: https://buildkite.com/elastic/kibana-pull-request/builds/327944 **Non-Serverless groups:** - 13 min: Rule Management - Prebuilt Rules Customization - Security Solution Cypress Tests - 13 min: Rule Management - Prebuilt Rules Installation - Security Solution Cypress Tests - 10 min: Rule Management - Prebuilt Rules Management - Security Solution Cypress Tests - 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution Cypress Tests **Serverless groups:** - 17 min: Serverless Rule Management - Prebuilt Rules Customization - Security Solution Cypress Tests - 16 min: Serverless Rule Management - Prebuilt Rules Installation - Security Solution Cypress Tests - 11 min: Serverless Rule Management - Prebuilt Rules Management - Security Solution Cypress Tests - 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security Solution Cypress Tests Each group's running time is significantly below the 60-minute limit.
NicholasPeretti
pushed a commit
to NicholasPeretti/kibana
that referenced
this pull request
Aug 18, 2025
## Summary Small correction after elastic#231150
qn895
pushed a commit
to qn895/kibana
that referenced
this pull request
Aug 26, 2025
**Part of epic: elastic#229688 ## Summary We have recently observed that some prebuilt detection rules in Cypress tests run for over 60 minutes in CI pipelines. This leads to pipeline timeouts. As a temporary measure `parallelism` was increased to 2 [recently](elastic#230969). This PR divides the Cypress tests for prebuilt detection rules into four separate groups to avoid hitting the 60m limit. ## Changes - Divided prebuilt rules directory `prebuilt_rules` into 4 subdirs: - `installation` - `upgrade` - `customization` - `management` (enabling/disabling, deletion, import and export of rules) - Added `yarn` commands and `bash` scripts to run tests from each subdirectory - Registered new groups in BuildKite pipelines (with `parallelism: 1`): - `pull_request/security_solution/rule_management.yml` - `on_merge.yml` - `chrome_forward_testing.yml` - `pointer_compression.yml` - `verify_es_serverless_image.yml` (Serverless tests only) - Registered the new scripts in the Flaky Test Runner ## Running times in pull request pipeline Link to this PR's run in pull request pipeline: https://buildkite.com/elastic/kibana-pull-request/builds/327944 **Non-Serverless groups:** - 13 min: Rule Management - Prebuilt Rules Customization - Security Solution Cypress Tests - 13 min: Rule Management - Prebuilt Rules Installation - Security Solution Cypress Tests - 10 min: Rule Management - Prebuilt Rules Management - Security Solution Cypress Tests - 31 min: Rule Management - Prebuilt Rules Upgrade - Security Solution Cypress Tests **Serverless groups:** - 17 min: Serverless Rule Management - Prebuilt Rules Customization - Security Solution Cypress Tests - 16 min: Serverless Rule Management - Prebuilt Rules Installation - Security Solution Cypress Tests - 11 min: Serverless Rule Management - Prebuilt Rules Management - Security Solution Cypress Tests - 27 min: Serverless Rule Management - Prebuilt Rules Upgrade - Security Solution Cypress Tests Each group's running time is significantly below the 60-minute limit.
qn895
pushed a commit
to qn895/kibana
that referenced
this pull request
Aug 26, 2025
## Summary Small correction after elastic#231150
43 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
7 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Part of epic: #229688
Summary
We have recently observed that some prebuilt detection rules in Cypress tests run for over 60 minutes in CI pipelines. This leads to pipeline timeouts. As a temporary measure
parallelismwas increased to 2 recently.This PR divides the Cypress tests for prebuilt detection rules into four separate groups to avoid hitting the 60m limit.
Changes
prebuilt_rulesinto 4 subdirs:installationupgradecustomizationmanagement(enabling/disabling, deletion, import and export of rules)yarncommands andbashscripts to run tests from each subdirectoryparallelism: 1):pull_request/security_solution/rule_management.ymlon_merge.ymlchrome_forward_testing.ymlpointer_compression.ymlverify_es_serverless_image.yml(Serverless tests only)Running times in pull request pipeline
Link to this PR's run in pull request pipeline: https://buildkite.com/elastic/kibana-pull-request/builds/327944
Non-Serverless groups:
Serverless groups:
Each group's running time is significantly below the 60-minute limit.