No binaries on PRs; to reduce PR CI times

[noonio]

It takes a while to build them, and I suspect no-one is really using them. After all, if you've been able to submit a PR, you can almost certainly build the binaries yourself!

[github-actions]

Test Results

490 tests  ±0   485 ✅ ±0   20m 23s ⏱️ -36s
155 suites ±0     5 💤 ±0 
  6 files   ±0     0 ❌ ±0 

Results for commit 0e687e7. ± Comparison against base commit 3101449.

♻️ This comment has been updated with latest results.

[github-actions]

Transaction costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at	2024-09-11 10:21:22.984600665 UTC
Max. memory units	14000000
Max. CPU units	10000000000
Max. tx size (kB)	16384

Script summary

Name	Hash	Size (Bytes)
νInitial	2fac819a1f4f14e29639d1414220d2a18b6abd6b8e444d88d0dda8ff	3799
νCommit	2043a9f1a685bcf491413a5f139ee42e335157c8c6bc8d9e4018669d	1743
νHead	2ee477c60839936be49a50030690865b5bed4db8cd2f05bf255ac680	10068
μHead	a1610f6e64843161f4a88229c0286176f5325de3e2f773eec2b1d818*	4508
νDeposit	c2117fd9ebdee3e96b81fd67ff7092d638926415c10f1f7e5a267ad0	2791

• The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per head.

Init transaction costs

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	5100	5.79	2.29	0.44
2	5297	7.18	2.84	0.46
3	5498	8.37	3.30	0.48
5	5902	11.17	4.41	0.53
10	6906	18.29	7.23	0.65
57	16359	82.91	32.79	1.78

Commit transaction costs

This uses ada-only outputs for better comparability.

UTxO	Tx size	% max Mem	% max CPU	Min fee ₳
1	569	10.52	4.15	0.29
2	756	13.86	5.65	0.34
3	943	17.33	7.20	0.38
5	1314	24.65	10.44	0.48
10	2257	45.22	19.36	0.75
20	4118	95.99	40.76	1.40

CollectCom transaction costs

Parties	UTxO (bytes)	Tx size	% max Mem	% max CPU	Min fee ₳
1	57	560	22.17	8.68	0.42
2	114	671	33.03	13.08	0.54
3	170	782	46.46	18.58	0.69
4	227	893	61.70	24.85	0.87
5	282	1004	78.44	31.80	1.06
6	339	1116	94.46	38.56	1.24

Cost of Decrement Transaction

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	628	17.95	7.88	0.38
2	803	20.16	9.46	0.42
3	916	19.90	10.04	0.42
5	1227	24.04	13.18	0.49
10	2056	35.35	21.17	0.68
50	8008	99.37	75.22	1.85

Close transaction costs

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	672	20.11	9.04	0.41
2	738	21.12	10.07	0.43
3	988	23.41	12.17	0.47
5	1237	26.37	14.98	0.53
10	2051	34.86	22.98	0.69
50	8198	99.93	84.81	1.93

Contest transaction costs

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	704	25.93	11.17	0.47
2	831	27.69	12.66	0.50
3	1009	29.83	14.50	0.54
5	1302	33.82	17.86	0.61
10	2020	42.74	25.54	0.77
39	6660	99.61	74.42	1.78

Abort transaction costs

There is some variation due to the random mixture of initial and already committed outputs.

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	4992	17.47	7.60	0.57
2	5093	28.50	12.49	0.69
3	5294	42.77	18.94	0.87
4	5378	53.73	23.73	0.99
5	5439	74.18	32.89	1.23
6	5624	95.22	42.40	1.47

FanOut transaction costs

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties	UTxO	UTxO (bytes)	Tx size	% max Mem	% max CPU	Min fee ₳
5	0	0	4934	7.50	3.17	0.45
5	1	57	4969	9.22	4.13	0.47
5	5	285	5104	13.15	6.73	0.53
5	10	569	5273	19.01	10.37	0.61
5	20	1141	5616	30.13	17.40	0.77
5	30	1707	5953	41.45	24.52	0.92
5	40	2277	6294	52.98	31.73	1.08
5	50	2848	6635	64.51	38.95	1.24
5	81	4609	7682	99.47	60.99	1.73

End-to-end benchmark results

This page is intended to collect the latest end-to-end benchmark results produced by Hydra's continuous integration (CI) system from the latest master code.

Please note that these results are approximate as they are currently produced from limited cloud VMs and not controlled hardware. Rather than focusing on the absolute results, the emphasis should be on relative results, such as how the timings for a scenario evolve as the code changes.

Generated at 2024-09-11 10:23:29.539447575 UTC

Baseline Scenario

Number of nodes	1
Number of txs	3000
Avg. Confirmation Time (ms)	4.900797362
P99	13.225787559999974ms
P95	5.615316749999995ms
P50	4.1718415ms
Number of Invalid txs	0

Three local nodes

Number of nodes	3
Number of txs	9000
Avg. Confirmation Time (ms)	23.288632713
P99	100.52233414000058ms
P95	31.94687864999999ms
P50	21.0930955ms
Number of Invalid txs	0