Skip to content

Add benchmark CI job for fast checks#1300

Merged
lemunozm merged 2 commits into
mainfrom
ci-benchmark-checks
Apr 6, 2023
Merged

Add benchmark CI job for fast checks#1300
lemunozm merged 2 commits into
mainfrom
ci-benchmark-checks

Conversation

@lemunozm

@lemunozm lemunozm commented Apr 3, 2023

Copy link
Copy Markdown
Contributor

Description

This job does not generate weights, it only checks fastly for all runtimes if benchmarks work/compile.

You can test the script locally as follows for fast benchmark checks (it takes around 10-15s to check all runtime benchmarks once it's compiled):

./scripts/check_benchmarks.sh <runtime>

Being <runtime> the following possible values: development, altair, centrifuge

Fixes #1268

Changes and Descriptions

  • New script
  • New CI job

@lemunozm lemunozm added D0-ready Pull request can be merged without special precaution and notification. crcl-protocol Circle protocol related. labels Apr 3, 2023
@lemunozm lemunozm self-assigned this Apr 3, 2023
mustermeiszer
mustermeiszer previously approved these changes Apr 3, 2023

@mustermeiszer mustermeiszer left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me! But given we change CI I would also wait for @gpmayorga approval

NunoAlexandre
NunoAlexandre previously approved these changes Apr 3, 2023

@NunoAlexandre NunoAlexandre left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 🌞

@lemunozm

lemunozm commented Apr 3, 2023

Copy link
Copy Markdown
Contributor Author

This PR fails as expected due to the pool-registry benchmark issue solved in #1233

Once that PR is merged, this can be safety merged.

@lemunozm

lemunozm commented Apr 3, 2023

Copy link
Copy Markdown
Contributor Author

I think we can run better the three runtimes in the same job to save 1 hour per CI job

@lemunozm lemunozm force-pushed the ci-benchmark-checks branch from d8c213c to 887b0a7 Compare April 5, 2023 12:53
@lemunozm lemunozm enabled auto-merge (squash) April 6, 2023 12:08

@mustermeiszer mustermeiszer left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@lemunozm lemunozm merged commit 43c3676 into main Apr 6, 2023
@lemunozm lemunozm deleted the ci-benchmark-checks branch April 7, 2023 09:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

crcl-protocol Circle protocol related. D0-ready Pull request can be merged without special precaution and notification.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add CI job for benchmarks

3 participants