-
-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
flatten builds, use rattler-build #99
Conversation
minrk
commented
Jan 9, 2025
- switch to rattler-build
- flatten build matrix, so duplicate libdolfinx isn't built (fewer, longer jobs because the python matrix isn't parallelized anymore)
- windows still (temporarily) skipped
This comment was marked as outdated.
This comment was marked as outdated.
…nda-forge-pinning 2025.01.08.14.39.32
bug in rattler-build
file: test-dolfinx | ||
env: | ||
scalar: ${{ scalar }} | ||
target_platform: ${{ target_platform }} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
These shouldn't be required, but are for now to workaround prefix-dev/rattler-build#1317
…nda-forge-pinning 2025.01.09.11.45.06
With flatter builds, loads of time is saved because 80% of libdolfin builds are redundant (assuming a matrix of five Pythons). But the actual time-to-completion is still longer because of conda-forge's parallelism. But it does mean we are hogging a lot of resources, especially for the 40 arm/ppc builds, which take much longer than the rest, especially in the Python test phase. Some summary of times:
So if everything's going smoothly, a lot of resources are saved by flattening builds like this. But if/when things start failing (e.g. the frequent intermittent network issues we've been seeing over the last week or so), the flatter builds significantly impact the turnaround time and cost of restarted builds. Notably, the shortest merged builds are only slightly slower than the shortest single-python builds with conda-build, so maybe this isn't so bad. |
@conda-forge-admin please lint |
I'll merge this one once conda-smithy releases the lint fixes |
Hi! This is the friendly automated conda-forge-linting service. I just wanted to let you know that I linted all conda-recipes in your PR ( |