Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: Criterion benchmark handlers #3223

Merged
merged 6 commits into from
Sep 20, 2022
Merged

Conversation

dougch
Copy link
Contributor

@dougch dougch commented Mar 8, 2022

Resolved issues:

part of #3130

Description of changes:

Changes to the Criterion benchmarks allow a criterion to call s2nc or s2nd.

part 4 of 5. This only affects integrationv2 tests when run with the integrationv2crit flag (once all are merged).

Call-outs:

  • This is one of four PRs.
  • These changes are only enabled when S2N_USECRITERION is set.
  • s2nc and s2nd must be in the path.

Testing:

How is this change tested (unit tests, fuzz tests, etc.)? ci

Is this a refactor change? not exactly

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@dougch dougch mentioned this pull request Mar 8, 2022
@dougch dougch marked this pull request as ready for review March 8, 2022 01:21
@dougch dougch requested review from camshaft and toidiu March 8, 2022 01:22
@dougch dougch added the s2n-core team label Mar 17, 2022
@dougch dougch force-pushed the criterion_s2ncd_handler branch 2 times, most recently from b115b59 to 1f142cd Compare May 20, 2022 23:38
let s2nc_env: &str = &env::var("S2NC_ARGS").unwrap();
let s2nc_args: utils::Arguments = s2nc_env.into();
dbg!("s2nc harness: {:?}", &s2nc_args);
let output = Command::new("/usr/local/bin/s2nc")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This hard coded path means that s2nd/c need to be installed globally. May make this an environment variable?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

in my initial attempts at this, PATH was getting modified by tox/pytest, and it was easier to install these, since the default CMAKE_INSTALLPREFIX was left untouched in the path

@dougch dougch marked this pull request as draft July 28, 2022 16:49
@dougch dougch force-pushed the criterion_s2ncd_handler branch 2 times, most recently from 75bf8cf to f294e54 Compare August 2, 2022 22:12
@dougch dougch force-pushed the criterion_s2ncd_handler branch from f294e54 to 668ac8c Compare August 8, 2022 23:00
@dougch dougch marked this pull request as ready for review August 8, 2022 23:09
@dougch dougch force-pushed the criterion_s2ncd_handler branch from 668ac8c to 89f1d34 Compare September 13, 2022 23:25
@dougch dougch requested a review from a team as a code owner September 13, 2022 23:25
@dougch dougch force-pushed the criterion_s2ncd_handler branch from 77dcafe to a24f115 Compare September 14, 2022 23:27
@dougch dougch requested a review from camshaft September 15, 2022 17:23
@dougch dougch enabled auto-merge (squash) September 20, 2022 16:41
@dougch dougch merged commit f298435 into aws:main Sep 20, 2022
@dougch dougch deleted the criterion_s2ncd_handler branch December 13, 2022 23:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants