Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build default devShell in CI for linux/macos #1683

Merged
merged 1 commit into from
Oct 4, 2024
Merged

Conversation

ch1bo
Copy link
Collaborator

@ch1bo ch1bo commented Oct 4, 2024

Using the macos github runners and a big enough cachix cache, we can improve first contribution experience of users on macos arm64 machines.

Addresses #1427


  • CHANGELOG update not needed
  • Documentation update not needed
  • Haddocks update not needed
  • No new TODOs introduced

@ch1bo ch1bo self-assigned this Oct 4, 2024
@ch1bo ch1bo requested a review from a team October 4, 2024 12:35
@ch1bo ch1bo linked an issue Oct 4, 2024 that may be closed by this pull request
Copy link

github-actions bot commented Oct 4, 2024

Transaction costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at 2024-10-04 15:57:35.780101238 UTC
Max. memory units 14000000
Max. CPU units 10000000000
Max. tx size (kB) 16384

Script summary

Name Hash Size (Bytes)
νInitial 2fac819a1f4f14e29639d1414220d2a18b6abd6b8e444d88d0dda8ff 3799
νCommit 2043a9f1a685bcf491413a5f139ee42e335157c8c6bc8d9e4018669d 1743
νHead 04fa9fa7d6f2dac870291a1f2274a268b64401d91d92b4bf1423843b 10176
μHead 41936d9458823cb5b4e47aa843a2f438ff3697d10ef4227a33cbe15b* 4508
νDeposit e0091235d453844ca593223db7d93b67b27afff4aac13bda443e0e16 2791
  • The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per head.

Init transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 5096 5.61 2.21 0.44
2 5295 6.99 2.76 0.46
3 5499 8.73 3.46 0.49
5 5899 11.12 4.39 0.53
10 6907 18.02 7.12 0.65
57 16355 82.85 32.77 1.78

Commit transaction costs

This uses ada-only outputs for better comparability.

UTxO Tx size % max Mem % max CPU Min fee ₳
1 569 10.52 4.15 0.29
2 756 13.86 5.65 0.34
3 941 17.33 7.20 0.38
5 1320 24.65 10.44 0.48
10 2256 45.22 19.36 0.75
20 4112 95.99 40.76 1.40

CollectCom transaction costs

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 57 560 22.14 8.66 0.42
2 114 675 32.21 12.78 0.53
3 170 782 47.15 18.82 0.70
4 226 897 58.96 23.82 0.84
5 283 1004 79.41 32.14 1.07
6 336 1116 91.42 37.44 1.21

Cost of Decrement Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 642 17.70 7.83 0.38
2 816 20.03 9.50 0.42
3 858 19.23 9.93 0.42
5 1228 23.51 13.12 0.49
10 2164 36.08 21.88 0.69
48 7774 97.67 75.19 1.82

Close transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 684 20.11 9.10 0.41
2 829 22.03 10.88 0.44
3 873 22.63 11.63 0.46
5 1215 26.37 15.18 0.53
10 2008 34.63 23.22 0.69
50 8005 97.44 85.24 1.90

Contest transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 680 25.93 11.19 0.47
2 761 27.31 12.42 0.49
3 992 29.96 14.67 0.54
5 1204 32.97 17.39 0.60
10 1982 42.41 25.75 0.77
39 6594 98.60 75.34 1.78

Abort transaction costs

There is some variation due to the random mixture of initial and already committed outputs.

Parties Tx size % max Mem % max CPU Min fee ₳
1 4894 13.92 5.81 0.52
2 5049 27.49 11.97 0.68
3 5239 41.79 18.42 0.85
4 5344 56.84 25.14 1.03
5 5540 76.90 34.23 1.26
6 5642 97.25 43.32 1.50

FanOut transaction costs

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties UTxO UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
5 0 0 4934 7.51 3.18 0.45
5 1 57 4969 9.03 4.06 0.47
5 5 285 5104 12.97 6.65 0.53
5 10 569 5274 19.22 10.46 0.61
5 20 1139 5613 30.14 17.41 0.77
5 30 1707 5953 41.86 24.70 0.93
5 40 2278 6294 53.18 31.82 1.09
5 50 2848 6634 64.12 38.78 1.24
5 81 4612 7686 99.29 60.91 1.73

End-to-end benchmark results

This page is intended to collect the latest end-to-end benchmark results produced by Hydra's continuous integration (CI) system from the latest master code.

Please note that these results are approximate as they are currently produced from limited cloud VMs and not controlled hardware. Rather than focusing on the absolute results, the emphasis should be on relative results, such as how the timings for a scenario evolve as the code changes.

Generated at 2024-10-04 16:00:30.474799483 UTC

Baseline Scenario

Number of nodes 1
Number of txs 3000
Avg. Confirmation Time (ms) 4.764394005
P99 11.26314684ms
P95 5.531447199999999ms
P50 4.1547625ms
Number of Invalid txs 0

Three local nodes

Number of nodes 3
Number of txs 9000
Avg. Confirmation Time (ms) 24.128098680
P99 117.26379580000001ms
P95 31.227819899999997ms
P50 21.337835499999997ms
Number of Invalid txs 0

Using the macos github runners and a big enough cachix cache, we can
improve first contribution experience of users on macos arm64 machines.
Copy link

github-actions bot commented Oct 4, 2024

Test Results

518 tests  ±0   512 ✅ ±0   23m 56s ⏱️ +20s
163 suites ±0     6 💤 ±0 
  7 files   ±0     0 ❌ ±0 

Results for commit 1a74b59. ± Comparison against base commit 4d48208.

@ch1bo ch1bo added this pull request to the merge queue Oct 4, 2024
Merged via the queue into master with commit d3db623 Oct 4, 2024
28 checks passed
@ch1bo ch1bo deleted the build-devshells-in-ci branch October 4, 2024 16:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

MacOS rebuilds dev shells because no nix cache hits
2 participants