Skip to content

chore: allow opting in to displaying benchmark comments#7399

Merged
TomAFrench merged 1 commit intomasterfrom
tf/allow-showing-bench-results-on-prs
Feb 14, 2025
Merged

chore: allow opting in to displaying benchmark comments#7399
TomAFrench merged 1 commit intomasterfrom
tf/allow-showing-bench-results-on-prs

Conversation

@TomAFrench
Copy link
Member

@TomAFrench TomAFrench commented Feb 14, 2025

Description

Problem*

Resolves

Summary*

See #7388 (comment)

This PR allows printing of the benchmarks into the PR comments if the bench-show label is set.

Additional Context

Documentation*

Check one:

  • No documentation needed.
  • Documentation included in this PR.
  • [For Experimental Features] Documentation to be submitted in a separate PR.

PR Checklist*

  • I have tested the changes locally.
  • I have formatted the changes with Prettier and/or cargo fmt on default settings.

@TomAFrench TomAFrench added the bench-show Display benchmark results on PR label Feb 14, 2025
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Execution Time

Details
Benchmark suite Current: d479f66 Previous: 30c4b2d Ratio
private-kernel-inner 0.069 s 0.068 s 1.01
private-kernel-reset 0.298 s 0.299 s 1.00
private-kernel-tail 0.017 s 0.017 s 1
rollup-base-private 0.462 s 0.462 s 1
rollup-base-public 0.185 s 0.186 s 0.99
rollup-block-merge 0.04 s 0.039 s 1.03
rollup-block-root 32.5 s 32.7 s 0.99
rollup-merge 0.006 s 0.006 s 1
rollup-root 0.039 s 0.04 s 0.97

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Compilation Time

Details
Benchmark suite Current: d479f66 Previous: 30c4b2d Ratio
sha256_regression 0.975 s 1.16 s 0.84
regression_4709 0.771 s 0.797 s 0.97
ram_blowup_regression 20.7 s 20.9 s 0.99
global_var_regression_entry_points 0.629 s 0.643 s 0.98
private-kernel-inner 1.994 s 1.908 s 1.05
private-kernel-reset 6.428 s 6.252 s 1.03
private-kernel-tail 0.945 s 0.958 s 0.99
rollup-base-private 8.922 s 8.822 s 1.01
rollup-base-public 5.14 s 5.23 s 0.98
rollup-block-merge 1.488 s 1.478 s 1.01
rollup-block-root-empty 0.981 s 0.948 s 1.03
rollup-block-root-single-tx 67.7 s 68.7 s 0.99
rollup-block-root 68.6 s 65.7 s 1.04
rollup-merge 0.922 s 0.89 s 1.04
rollup-root 1.454 s 1.636 s 0.89

This comment was automatically generated by workflow using github-action-benchmark.

@TomAFrench TomAFrench requested a review from asterite February 14, 2025 19:25
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Execution Memory

Details
Benchmark suite Current: d479f66 Previous: 30c4b2d Ratio
private-kernel-inner 211.79 MB 211.78 MB 1.00
private-kernel-reset 248.24 MB 248.24 MB 1
private-kernel-tail 183.41 MB 183.41 MB 1
rollup-base-private 468.76 MB 468.76 MB 1
rollup-base-public 407.5 MB 407.5 MB 1
rollup-block-merge 353.81 MB 353.81 MB 1
rollup-block-root 1040 MB 1040 MB 1
rollup-merge 346.4 MB 346.4 MB 1
rollup-root 353.79 MB 353.79 MB 1

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Compilation Memory

Details
Benchmark suite Current: d479f66 Previous: 30c4b2d Ratio
private-kernel-inner 270.58 MB 270.58 MB 1
private-kernel-reset 585.8 MB 585.8 MB 1
private-kernel-tail 197.88 MB 197.87 MB 1.00
rollup-base-private 987.99 MB 987.99 MB 1
rollup-base-public 853.53 MB 853.57 MB 1.00
rollup-block-merge 409.68 MB 409.67 MB 1.00
rollup-block-root-empty 363.57 MB 363.57 MB 1
rollup-block-root-single-tx 5130 MB 5130 MB 1
rollup-block-root 5130 MB 5130 MB 1
rollup-merge 361.99 MB 361.99 MB 1
rollup-root 409.65 MB 409.65 MB 1

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Test Suite Duration

Details
Benchmark suite Current: d479f66 Previous: 30c4b2d Ratio
AztecProtocol_aztec-packages_noir-projects_aztec-nr 41 s 40 s 1.02
AztecProtocol_aztec-packages_noir-projects_noir-contracts 66 s 64 s 1.03
AztecProtocol_aztec-packages_noir-projects_noir-protocol-circuits_crates_blob 50 s 48 s 1.04
AztecProtocol_aztec-packages_noir-projects_noir-protocol-circuits_crates_private-kernel-lib 153 s 153 s 1
AztecProtocol_aztec-packages_noir-projects_noir-protocol-circuits_crates_reset-kernel-lib 9 s 10 s 0.90
AztecProtocol_aztec-packages_noir-projects_noir-protocol-circuits_crates_rollup-lib 172 s 170 s 1.01
AztecProtocol_aztec-packages_noir-projects_noir-protocol-circuits_crates_types 48 s 50 s 0.96
noir-lang_noir-bignum_ 360 s 356 s 1.01
noir-lang_noir_bigcurve_ 262 s 265 s 0.99
noir-lang_noir_json_parser_ 12 s 12 s 1

This comment was automatically generated by workflow using github-action-benchmark.

@TomAFrench TomAFrench enabled auto-merge February 14, 2025 19:31
@TomAFrench TomAFrench added this pull request to the merge queue Feb 14, 2025
Merged via the queue into master with commit 5b509c5 Feb 14, 2025
105 checks passed
@TomAFrench TomAFrench deleted the tf/allow-showing-bench-results-on-prs branch February 14, 2025 19:43
TomAFrench added a commit that referenced this pull request Feb 14, 2025
…rom-brillig

* master:
  chore: allow opting in to displaying benchmark comments (#7399)
  chore: box `ExprValue` in `Value` enum (#7388)
  chore: pull out refactored methods from u128 branch (#7385)
  feat: require safety comments instead of safety doc comments (#7295)
  fix(ssa): Do not deduplicate division by a zero constant (#7393)
  chore: document traits required to be in scope (#7387)
  fix: field zero division in brillig (#7386)
  chore: box `ParserError`s in `InterpreterError` (#7373)
  chore: remove unnecessary dereferencing within brillig vm (#7375)
  fix: give "correct" error when trying to use AsTraitPath (#7360)
  chore: avoid u128s in brillig memory (#7363)
  chore: update docs about integer overflows (#7370)
  fix!: Only decrement the counter of an array if its address has not changed (#7297)
  fix: let LSP read `noirfmt.toml` for formatting files (#7355)
  chore: deprecate keccak256 (#7361)
  feat: `FunctionDefinition::as_typed_expr` (#7358)
  feat(performance): Check sub operations against induction variables (#7356)
  chore: avoid doing all brillig integer arithmetic on u128s (#7357)
TomAFrench added a commit that referenced this pull request Feb 14, 2025
* master:
  chore: allow opting in to displaying benchmark comments (#7399)
  chore: box `ExprValue` in `Value` enum (#7388)
  chore: pull out refactored methods from u128 branch (#7385)
  feat: require safety comments instead of safety doc comments (#7295)
  fix(ssa): Do not deduplicate division by a zero constant (#7393)
  chore: document traits required to be in scope (#7387)
  fix: field zero division in brillig (#7386)
  chore: box `ParserError`s in `InterpreterError` (#7373)
  chore: remove unnecessary dereferencing within brillig vm (#7375)
AztecBot pushed a commit to AztecProtocol/aztec-packages that referenced this pull request Feb 15, 2025
chore: box `Closure` in `comptime::Value` enum (noir-lang/noir#7400)
chore: allow opting in to displaying benchmark comments (noir-lang/noir#7399)
chore: box `ExprValue` in `Value` enum (noir-lang/noir#7388)
chore: pull out refactored methods from u128 branch (noir-lang/noir#7385)
feat: require safety comments instead of safety doc comments (noir-lang/noir#7295)
AztecBot pushed a commit to AztecProtocol/aztec-packages that referenced this pull request Feb 16, 2025
chore: box `Closure` in `comptime::Value` enum (noir-lang/noir#7400)
chore: allow opting in to displaying benchmark comments (noir-lang/noir#7399)
chore: box `ExprValue` in `Value` enum (noir-lang/noir#7388)
chore: pull out refactored methods from u128 branch (noir-lang/noir#7385)
feat: require safety comments instead of safety doc comments (noir-lang/noir#7295)
AztecBot pushed a commit to AztecProtocol/aztec-packages that referenced this pull request Feb 16, 2025
chore: box `Closure` in `comptime::Value` enum (noir-lang/noir#7400)
chore: allow opting in to displaying benchmark comments (noir-lang/noir#7399)
chore: box `ExprValue` in `Value` enum (noir-lang/noir#7388)
chore: pull out refactored methods from u128 branch (noir-lang/noir#7385)
feat: require safety comments instead of safety doc comments (noir-lang/noir#7295)
AztecBot pushed a commit to AztecProtocol/aztec-packages that referenced this pull request Feb 17, 2025
chore: box `Closure` in `comptime::Value` enum (noir-lang/noir#7400)
chore: allow opting in to displaying benchmark comments (noir-lang/noir#7399)
chore: box `ExprValue` in `Value` enum (noir-lang/noir#7388)
chore: pull out refactored methods from u128 branch (noir-lang/noir#7385)
feat: require safety comments instead of safety doc comments (noir-lang/noir#7295)
AztecBot pushed a commit to AztecProtocol/aztec-packages that referenced this pull request Feb 17, 2025
chore: box `Closure` in `comptime::Value` enum (noir-lang/noir#7400)
chore: allow opting in to displaying benchmark comments (noir-lang/noir#7399)
chore: box `ExprValue` in `Value` enum (noir-lang/noir#7388)
chore: pull out refactored methods from u128 branch (noir-lang/noir#7385)
feat: require safety comments instead of safety doc comments (noir-lang/noir#7295)
TomAFrench added a commit to AztecProtocol/aztec-packages that referenced this pull request Feb 17, 2025
Automated pull of development from the
[noir](https://github.com/noir-lang/noir) programming language, a
dependency of Aztec.
BEGIN_COMMIT_OVERRIDE
fix: format global attributes
(noir-lang/noir#7401)
chore: box `Closure` in `comptime::Value` enum
(noir-lang/noir#7400)
chore: allow opting in to displaying benchmark comments
(noir-lang/noir#7399)
chore: box `ExprValue` in `Value` enum
(noir-lang/noir#7388)
chore: pull out refactored methods from u128 branch
(noir-lang/noir#7385)
feat: require safety comments instead of safety doc comments
(noir-lang/noir#7295)
END_COMMIT_OVERRIDE

---------

Co-authored-by: Tom French <tom@tomfren.ch>
AztecBot added a commit to AztecProtocol/aztec-nr that referenced this pull request Feb 18, 2025
Automated pull of development from the
[noir](https://github.com/noir-lang/noir) programming language, a
dependency of Aztec.
BEGIN_COMMIT_OVERRIDE
fix: format global attributes
(noir-lang/noir#7401)
chore: box `Closure` in `comptime::Value` enum
(noir-lang/noir#7400)
chore: allow opting in to displaying benchmark comments
(noir-lang/noir#7399)
chore: box `ExprValue` in `Value` enum
(noir-lang/noir#7388)
chore: pull out refactored methods from u128 branch
(noir-lang/noir#7385)
feat: require safety comments instead of safety doc comments
(noir-lang/noir#7295)
END_COMMIT_OVERRIDE

---------

Co-authored-by: Tom French <tom@tomfren.ch>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bench-show Display benchmark results on PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants