-
Notifications
You must be signed in to change notification settings - Fork 25
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Publish the failing test's name and class along with the integration test results #536
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #536 +/- ##
=========================================
Coverage 84.72% 84.72%
Complexity 105 105
=========================================
Files 115 115
Lines 648 648
Branches 71 71
=========================================
Hits 549 549
Misses 29 29
Partials 70 70 ☔ View full report in Codecov by Sentry. |
ce7b797
to
670066f
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks!
vars/publishIntegTestResults.groovy
Outdated
fi | ||
fi | ||
if [ -s ${testFailuresFile} ]; then | ||
echo "File Exists, indexing results." |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit:
echo "File Exists, indexing results." | |
echo "File Exists, indexing failed tests." |
vars/publishIntegTestResults.groovy
Outdated
@@ -224,6 +397,34 @@ void indexFailedTestData(indexName, testRecordsFile) { | |||
} | |||
} | |||
|
|||
def generatefailedTestJson(componentName, componentRepo, componentRepoUrl, version, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit:
def generatefailedTestJson(componentName, componentRepo, componentRepoUrl, version, | |
def generateFailedTestJson(componentName, componentRepo, componentRepoUrl, version, |
Thanks @peterzhuamazon and @gaiksaya, I have updated the requested changes in my latest commit. |
def match = failedTest.split("#") | ||
if (match) { | ||
def testResultJsonContent = generateFailedTestJson(componentName, componentRepo, componentRepoUrl, version, integTestBuildNumber, | ||
integTestBuildUrl, distributionBuildNumber, distributionBuildUrl, buildStartTime, rc, rcNumber, | ||
platform, architecture, distribution, componentCategory, securityType, match[0].trim(), match[1].trim()) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Did not get this part. How are we splitting based on #?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ya this for splitting test_class#test_name
, I have added a small test for both OpenSearch and Dashboards.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks like some groovy tests are failing due to recent commit. Please fix before merging.
Thanks!
Signed-off-by: Prudhvi Godithi <[email protected]>
Ya I forgot to update the tests when changed to sentence |
Merging this as the Mend Base branch commit: 4e94ed7991c7192faa94996988c1deacb8b9ec98, coming from #531. @gaiksaya @peterzhuamazon |
…test results (#536) Signed-off-by: Prudhvi Godithi <[email protected]> (cherry picked from commit 52f6eac) Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Description
Publish the failing test's name and class along with the integration test results.
Issues Resolved
Part of opensearch-project/opensearch-metrics#68 and #535.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.