Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix demo for conway #1623

Closed
wants to merge 1 commit into from
Closed

Fix demo for conway #1623

wants to merge 1 commit into from

Conversation

locallycompact
Copy link
Contributor

No description provided.

Copy link

Transaction costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at 2024-09-11 14:00:12.966366381 UTC
Max. memory units 14000000
Max. CPU units 10000000000
Max. tx size (kB) 16384

Script summary

Name Hash Size (Bytes)
νInitial 2fac819a1f4f14e29639d1414220d2a18b6abd6b8e444d88d0dda8ff 3799
νCommit 2043a9f1a685bcf491413a5f139ee42e335157c8c6bc8d9e4018669d 1743
νHead 2ee477c60839936be49a50030690865b5bed4db8cd2f05bf255ac680 10068
μHead a1610f6e64843161f4a88229c0286176f5325de3e2f773eec2b1d818* 4508
νDeposit c2117fd9ebdee3e96b81fd67ff7092d638926415c10f1f7e5a267ad0 2791
  • The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per head.

Init transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 5097 5.69 2.25 0.44
2 5302 7.03 2.77 0.46
3 5499 8.59 3.40 0.49
5 5901 11.12 4.39 0.53
10 6906 18.11 7.16 0.65
57 16353 83.00 32.84 1.78

Commit transaction costs

This uses ada-only outputs for better comparability.

UTxO Tx size % max Mem % max CPU Min fee ₳
1 569 10.52 4.15 0.29
2 755 13.86 5.65 0.34
3 945 17.33 7.20 0.38
5 1320 24.65 10.44 0.48
10 2262 45.22 19.36 0.75
20 4125 95.99 40.76 1.40

CollectCom transaction costs

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 57 560 21.46 8.41 0.41
2 113 671 33.86 13.39 0.55
3 171 782 45.22 18.11 0.68
4 228 893 60.23 24.31 0.85
5 282 1004 72.17 29.45 0.99
6 340 1116 91.79 37.58 1.21

Cost of Decrement Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 655 17.70 7.80 0.38
2 864 20.36 9.54 0.42
3 966 21.37 10.67 0.44
5 1177 23.11 12.83 0.48
10 2129 35.09 21.06 0.68
50 8059 99.15 75.13 1.85

Close transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 652 20.07 9.01 0.41
2 813 21.49 10.42 0.43
3 979 23.26 12.11 0.47
5 1197 25.76 14.56 0.52
10 1907 33.60 21.96 0.66
50 8122 98.64 83.75 1.91

Contest transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 671 25.90 11.13 0.47
2 802 27.65 12.63 0.50
3 936 29.49 14.17 0.53
5 1408 34.61 18.53 0.63
10 2021 42.71 25.61 0.77
40 6642 99.87 74.66 1.79

Abort transaction costs

There is some variation due to the random mixture of initial and already committed outputs.

Parties Tx size % max Mem % max CPU Min fee ₳
1 4981 17.32 7.53 0.56
2 5157 29.35 12.95 0.71
3 5301 43.93 19.49 0.88
4 5413 58.25 25.83 1.05
5 5572 77.56 34.52 1.27
6 5622 91.62 40.73 1.43

FanOut transaction costs

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties UTxO UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
5 0 0 4934 7.89 3.34 0.46
5 1 57 4968 8.63 3.88 0.47
5 5 284 5104 13.55 6.89 0.53
5 10 570 5275 18.81 10.28 0.61
5 20 1136 5610 30.33 17.48 0.77
5 30 1709 5955 41.45 24.52 0.92
5 40 2279 6296 52.98 31.73 1.08
5 50 2845 6632 64.31 38.86 1.24
5 81 4609 7682 99.47 60.99 1.73

End-to-end benchmark results

This page is intended to collect the latest end-to-end benchmark results produced by Hydra's continuous integration (CI) system from the latest master code.

Please note that these results are approximate as they are currently produced from limited cloud VMs and not controlled hardware. Rather than focusing on the absolute results, the emphasis should be on relative results, such as how the timings for a scenario evolve as the code changes.

Generated at 2024-09-11 14:02:54.523787396 UTC

Baseline Scenario

Number of nodes 1
Number of txs 3000
Avg. Confirmation Time (ms) 4.813177883
P99 11.311939319999942ms
P95 6.843298149999991ms
P50 4.4491665000000005ms
Number of Invalid txs 0

Three local nodes

Number of nodes 3
Number of txs 9000
Avg. Confirmation Time (ms) 23.996603493
P99 67.35070573000056ms
P95 33.50133554999999ms
P50 21.659821ms
Number of Invalid txs 0

Copy link

Test Results

490 tests  ±0   485 ✅ ±0   20m 52s ⏱️ -29s
155 suites ±0     5 💤 ±0 
  6 files   ±0     0 ❌ ±0 

Results for commit f5ffe59. ± Comparison against base commit 6c30e32.

Copy link
Collaborator

@ch1bo ch1bo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing it and I would like to approve, but the location of export-tx-id-and-pparams.sh breaks the instructions from our website.

@@ -86,4 +86,4 @@ seedFaucet "alice-funds" 100000000 # 100 Ada to commit
seedFaucet "bob-funds" 50000000 # 50 Ada to commit
seedFaucet "carol-funds" 25000000 # 25 Ada to commit

./export-tx-id-and-pparams.sh
./demo/export-tx-id-and-pparams.sh $CCLI_CMD $HYDRA_NODE_CMD
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is not more correct than before and will fail if someone runs this script from within demo/, which is even what we instruct users to do here: https://hydra.family/head-protocol/docs/getting-started#preparation

If I follow the instructions of our user manual this fails with:

./seed-devnet.sh: line 89: ./demo/export-tx-id-and-pparams.sh: No such file or directory

Should: use the SCRIPT_DIR to robustly refer to other scripts

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Like

./$SCRIPT_DIR/export-tx-id-and-pparams.sh $CCLI_CMD $HYDRA_NODE_CMD

That doesn't work.

@@ -50,23 +50,23 @@ function seedFaucet() {
echo >&2 "Seeding a UTXO from faucet to ${ACTOR} with ${AMOUNT}Ł"

# Determine faucet address and just the **first** txin addressed to it
FAUCET_ADDR=$(ccli address build --payment-verification-key-file ${DEVNET_DIR}/credentials/faucet.vk)
FAUCET_TXIN=$(ccli query utxo --address ${FAUCET_ADDR} --out-file /dev/stdout | jq -r 'keys[0]')
FAUCET_ADDR=$(ccli conway address build --payment-verification-key-file ${DEVNET_DIR}/credentials/faucet.vk)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's a pity that we need this. The cardano-cli becomes harder to use by the day :(

@ch1bo ch1bo added this to the 0.19.0 milestone Sep 12, 2024
@noonio noonio removed this from the 0.19.0 milestone Sep 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants