[Backport] Parallel test jobs for CI (#2861)#2936
Merged
peternied merged 6 commits intoopensearch-project:2.xfrom Jul 10, 2023
Merged
[Backport] Parallel test jobs for CI (#2861)#2936peternied merged 6 commits intoopensearch-project:2.xfrom
peternied merged 6 commits intoopensearch-project:2.xfrom
Conversation
* Split multiple tests into separate gradle tasks.
* Tasks are configured in "splitTestConfig" map in build.gradle file.
Map allows to use all patterns from TestFilter like:
includeTestsMatching, excludeTestsMatching, includeTest etc.
* Tasks are automatically generated from "splitTestConfig" map.
* Two new Gradle tasks: listTasksAsJSON and listTasksAsParam to
output task names to console. First one outputs them as a JSON
and second - in gradlew "-x <TASK>" format to use in CLI.
* Patterns included in tasks are automatically excluded from main
"test" task but at the same time generated tasks are dependencies
for "test". Running "gradlew test" will run whole suite at once.
* CI pipeline has been configured to accomodate all changes.
* New 'master' task to generate list of jobs to run in parallel.
* Updated matrix strategy to include task name to start.
Signed-off-by: Pawel Gudel <pawel.gudel@eliatra.com>
(cherry picked from commit e4f4817)
Signed-off-by: Pawel Gudel <pawel.gudel@eliatra.com>
pawel-gudel-eliatra
requested review from
DarshitChanpura,
RyanL1997,
cliu123,
cwperks,
davidlago,
peternied,
reta,
stephen-crawford and
willyborankin
as code owners
Codecov Report
@@ Coverage Diff @@
## 2.x #2936 +/- ##
============================================
- Coverage 62.11% 58.71% -3.40%
+ Complexity 3371 3057 -314
============================================
Files 264 264
Lines 19460 19460
Branches 3319 3319
============================================
- Hits 12087 11426 -661
- Misses 5772 6385 +613
- Partials 1601 1649 +48 |
stephen-crawford
previously approved these changes
Jul 7, 2023
peternied
previously approved these changes
Jul 10, 2023
…ion to any version (opensearch-project#2253) * Generalize Backwards Compatibility tests so we can test from any version to any version With an issue reported indicating that there are serialization issue between 1.3 and 2.X, making sure that we can reproduce the errors. This new workflow(s) will make sure that we aren't breaking BWC with changes we are adding to 2.X and will give us the flexibility to test certain migration workflows. Fixing an issue where the BWC tests were not actually building or executing causing the clusters to spin up and then immediately spin down. We will need to invest more energy into running multiple kinds of security plugin specific scenarios through the test system. Signed-off-by: Peter Nied <petern@amazon.com>
peternied
dismissed stale reviews from stephen-crawford and themself
via
6e3042d
Signed-off-by: Peter Nied <petern@amazon.com>
Signed-off-by: Peter Nied <petern@amazon.com>
Signed-off-by: Peter Nied <petern@amazon.com>
cwperks
approved these changes
Jul 10, 2023
peternied
approved these changes
Jul 10, 2023
Member
peternied
left a comment
peternied
left a comment
There was a problem hiding this comment.
We were using the old BWC testing suite, pulled in the most recent version
Member
|
Interesting, codecov/project is out of date compared to the results generated from all the integration test runs, that is kinda silly
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Backport e4f4817 from #2861