[Security Solution] Include only @serverlessQA Cypress tests to the 2nd quality gate#182600
Conversation
|
Pinging @elastic/security-solution (Team: SecuritySolution) |
💚 Build Succeeded
Metrics [docs]
To update your PR or re-run it, just comment with: cc @banderror |
|
@banderror To minimize the number of Cypress configuration and scripts, inside the parallel script, we are overriding the tag configuration when the tests are triggered by the second quality gate. I understand that the names used on buildkite when the periodic pipeline is triggered might be misleading if you are not familiar with the whole process. We'll work on that to improve it. |
|
Closing due to #182600 (comment). It's not a bug and there's nothing to fix, only to improve the naming of config files, scripts, pipelines, steps, etc. Thank you @MadameSheema! |
Summary
Fixes a bug introduced in #181371 that included all Cypress tests tagged as
@serverlessto the 2nd quality gate (the QA stage in the release pipeline).Current behavior: all tests tagged as
@serverlessrun in the 2nd quality gate as part of the Kibana Serverless release process. Many of them are not ready for this and are not supposed to run there.Correct behavior: include only those that were explicitly tagged as
@serverlessQA.Context
Tests that run in the 2nd quality gate can be found in https://buildkite.com/elastic?filter=security%20solution
For example, in this build we have a script:
that runs
yarn cypress:qa:serverlesswhich in turn uses thex-pack/test/security_solution_cypress/cypress/cypress_ci_serverless_qa.config.tsconfig which used incorrect tags to select Cypress tests.