Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Publish the failing test's name and class along with the integration test results #536

Merged
merged 1 commit into from
Oct 18, 2024

Conversation

prudhvigodithi
Copy link
Member

@prudhvigodithi prudhvigodithi commented Oct 17, 2024

Description

Publish the failing test's name and class along with the integration test results.

Issues Resolved

Part of opensearch-project/opensearch-metrics#68 and #535.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Copy link

codecov bot commented Oct 17, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 84.72%. Comparing base (4e94ed7) to head (1e5f6d3).
Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff            @@
##               main     #536   +/-   ##
=========================================
  Coverage     84.72%   84.72%           
  Complexity      105      105           
=========================================
  Files           115      115           
  Lines           648      648           
  Branches         71       71           
=========================================
  Hits            549      549           
  Misses           29       29           
  Partials         70       70           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Member

@peterzhuamazon peterzhuamazon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

fi
fi
if [ -s ${testFailuresFile} ]; then
echo "File Exists, indexing results."
Copy link
Member

@gaiksaya gaiksaya Oct 18, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit:

Suggested change
echo "File Exists, indexing results."
echo "File Exists, indexing failed tests."

@@ -224,6 +397,34 @@ void indexFailedTestData(indexName, testRecordsFile) {
}
}

def generatefailedTestJson(componentName, componentRepo, componentRepoUrl, version,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit:

Suggested change
def generatefailedTestJson(componentName, componentRepo, componentRepoUrl, version,
def generateFailedTestJson(componentName, componentRepo, componentRepoUrl, version,

@prudhvigodithi
Copy link
Member Author

Thanks @peterzhuamazon and @gaiksaya, I have updated the requested changes in my latest commit.

Comment on lines +118 to +122
def match = failedTest.split("#")
if (match) {
def testResultJsonContent = generateFailedTestJson(componentName, componentRepo, componentRepoUrl, version, integTestBuildNumber,
integTestBuildUrl, distributionBuildNumber, distributionBuildUrl, buildStartTime, rc, rcNumber,
platform, architecture, distribution, componentCategory, securityType, match[0].trim(), match[1].trim())
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Did not get this part. How are we splitting based on #?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ya this for splitting test_class#test_name, I have added a small test for both OpenSearch and Dashboards.

Copy link
Member

@gaiksaya gaiksaya left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like some groovy tests are failing due to recent commit. Please fix before merging.
Thanks!

Signed-off-by: Prudhvi Godithi <[email protected]>
@prudhvigodithi
Copy link
Member Author

Looks like some groovy tests are failing due to recent commit. Please fix before merging.
Thanks!

Ya I forgot to update the tests when changed to sentence indexing failed tests, I'm testing the entire sh command and its output. Just pushed it in my latest commit.

@prudhvigodithi
Copy link
Member Author

Merging this as the Mend Base branch commit: 4e94ed7991c7192faa94996988c1deacb8b9ec98, coming from #531. @gaiksaya @peterzhuamazon

@prudhvigodithi prudhvigodithi merged commit 52f6eac into opensearch-project:main Oct 18, 2024
8 of 9 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Oct 18, 2024
…test results (#536)

Signed-off-by: Prudhvi Godithi <[email protected]>
(cherry picked from commit 52f6eac)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: ✅ Done
Development

Successfully merging this pull request may close these issues.

3 participants