-
Notifications
You must be signed in to change notification settings - Fork 274
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes for adding benchmark compare feature #4931
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #4931 +/- ##
=======================================
Coverage 92.41% 92.41%
=======================================
Files 197 197
Lines 6634 6634
=======================================
Hits 6131 6131
Misses 503 503 ☔ View full report in Codecov by Sentry. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- If someone triggers a benchmark in PR, seems like compare will auto trigger if success?
- benchmark has 24hr timeout while compare also have 24hr timeout, do we need this long period of time to run them?
// Trigger compare-benchmarks job | ||
build job: 'compare-benchmarks', | ||
parameters: [ | ||
string(name:'BASELINE_TEST_EXECUTION_ID', value: "${benchmarkTestIds.baseline}"), | ||
string(name:'BASELINE_TEST_EXECUTION_ID', value: "${benchmarkTestIds.contender}"), | ||
string(name:'PULL_REQUEST_NUMBER', value: "${pull_request_number}"), | ||
string(name:'REPOSITORY', value: "${repository}") | ||
], | ||
wait: false, | ||
propagate: false |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Spacing.
|
pullRequestNumber: "${pull_request_number}" | ||
) | ||
// Trigger compare-benchmarks job | ||
build job: 'compare-benchmarks', |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nit: Possible of changing this to benchmark-compare
to in sync with other benchmark workflow naming convention?
Thanks.
Signed-off-by: Rishabh Singh <[email protected]>
Description
This PR:
compare-benchmarks
to run benchmark comparison between baseline and target run.benchmark-pull-request
job to callcompare-benchmarks
job once it is successfully finished to also update the comparison results on the calling pull_request.Issues Resolved
opensearch-project/OpenSearch#14826.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.