Skip to content

Update spec test version to latest v1.3.0 - #5402

Merged
g11tech merged 1 commit into
unstablefrom
g11tech/spec-ver-1.3.0
Apr 22, 2023
Merged

Update spec test version to latest v1.3.0#5402
g11tech merged 1 commit into
unstablefrom
g11tech/spec-ver-1.3.0

Conversation

@g11tech

@g11tech g11tech commented Apr 22, 2023

Copy link
Copy Markdown
Contributor

Update spec test version to latest v1.3.0 for use in 4844 PR

@g11tech
g11tech requested a review from a team as a code owner April 22, 2023 13:27
@g11tech
g11tech enabled auto-merge (squash) April 22, 2023 13:27
@github-actions

Copy link
Copy Markdown
Contributor

Performance Report

鉁旓笍 no performance regression detected

Full benchmark results
Benchmark suite Current: 69cfc38 Previous: 99d4944 Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 804.38 us/op 738.15 us/op 1.09
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 45.396 us/op 45.981 us/op 0.99
BLS verify - blst-native 1.2031 ms/op 1.1973 ms/op 1.00
BLS verifyMultipleSignatures 3 - blst-native 2.4428 ms/op 2.4427 ms/op 1.00
BLS verifyMultipleSignatures 8 - blst-native 5.2468 ms/op 5.3459 ms/op 0.98
BLS verifyMultipleSignatures 32 - blst-native 19.035 ms/op 19.422 ms/op 0.98
BLS aggregatePubkeys 32 - blst-native 25.456 us/op 26.654 us/op 0.96
BLS aggregatePubkeys 128 - blst-native 99.225 us/op 102.73 us/op 0.97
getAttestationsForBlock 68.377 ms/op 57.232 ms/op 1.19
isKnown best case - 1 super set check 256.00 ns/op 261.00 ns/op 0.98
isKnown normal case - 2 super set checks 250.00 ns/op 256.00 ns/op 0.98
isKnown worse case - 16 super set checks 247.00 ns/op 256.00 ns/op 0.96
CheckpointStateCache - add get delete 4.8110 us/op 5.2570 us/op 0.92
validate gossip signedAggregateAndProof - struct 2.6931 ms/op 2.8352 ms/op 0.95
validate gossip attestation - struct 1.3131 ms/op 1.3531 ms/op 0.97
pickEth1Vote - no votes 1.2284 ms/op 1.3725 ms/op 0.90
pickEth1Vote - max votes 10.726 ms/op 12.690 ms/op 0.85
pickEth1Vote - Eth1Data hashTreeRoot value x2048 8.9885 ms/op 9.7723 ms/op 0.92
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 18.213 ms/op 15.520 ms/op 1.17
pickEth1Vote - Eth1Data fastSerialize value x2048 642.61 us/op 698.58 us/op 0.92
pickEth1Vote - Eth1Data fastSerialize tree x2048 8.4023 ms/op 7.5487 ms/op 1.11
bytes32 toHexString 491.00 ns/op 562.00 ns/op 0.87
bytes32 Buffer.toString(hex) 352.00 ns/op 410.00 ns/op 0.86
bytes32 Buffer.toString(hex) from Uint8Array 545.00 ns/op 571.00 ns/op 0.95
bytes32 Buffer.toString(hex) + 0x 347.00 ns/op 371.00 ns/op 0.94
Object access 1 prop 0.17200 ns/op 0.16900 ns/op 1.02
Map access 1 prop 0.16300 ns/op 0.16500 ns/op 0.99
Object get x1000 6.5090 ns/op 7.3280 ns/op 0.89
Map get x1000 0.61700 ns/op 0.63300 ns/op 0.97
Object set x1000 51.158 ns/op 56.034 ns/op 0.91
Map set x1000 42.875 ns/op 47.197 ns/op 0.91
Return object 10000 times 0.23400 ns/op 0.24540 ns/op 0.95
Throw Error 10000 times 4.1430 us/op 4.3266 us/op 0.96
fastMsgIdFn sha256 / 200 bytes 3.3990 us/op 3.5530 us/op 0.96
fastMsgIdFn h32 xxhash / 200 bytes 291.00 ns/op 300.00 ns/op 0.97
fastMsgIdFn h64 xxhash / 200 bytes 395.00 ns/op 401.00 ns/op 0.99
fastMsgIdFn sha256 / 1000 bytes 11.465 us/op 11.829 us/op 0.97
fastMsgIdFn h32 xxhash / 1000 bytes 417.00 ns/op 428.00 ns/op 0.97
fastMsgIdFn h64 xxhash / 1000 bytes 469.00 ns/op 511.00 ns/op 0.92
fastMsgIdFn sha256 / 10000 bytes 102.90 us/op 105.64 us/op 0.97
fastMsgIdFn h32 xxhash / 10000 bytes 1.8650 us/op 1.9460 us/op 0.96
fastMsgIdFn h64 xxhash / 10000 bytes 1.3240 us/op 1.3710 us/op 0.97
enrSubnets - fastDeserialize 64 bits 1.2590 us/op 1.3300 us/op 0.95
enrSubnets - ssz BitVector 64 bits 481.00 ns/op 499.00 ns/op 0.96
enrSubnets - fastDeserialize 4 bits 169.00 ns/op 181.00 ns/op 0.93
enrSubnets - ssz BitVector 4 bits 487.00 ns/op 557.00 ns/op 0.87
prioritizePeers score -10:0 att 32-0.1 sync 2-0 106.97 us/op 113.19 us/op 0.95
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 141.76 us/op 163.36 us/op 0.87
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 163.23 us/op 196.99 us/op 0.83
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 296.30 us/op 357.70 us/op 0.83
prioritizePeers score 0:0 att 64-1 sync 4-1 356.64 us/op 411.62 us/op 0.87
array of 16000 items push then shift 1.6252 us/op 1.6916 us/op 0.96
LinkedList of 16000 items push then shift 9.0150 ns/op 9.1110 ns/op 0.99
array of 16000 items push then pop 69.467 ns/op 111.09 ns/op 0.63
LinkedList of 16000 items push then pop 8.5240 ns/op 9.3100 ns/op 0.92
array of 24000 items push then shift 2.3995 us/op 2.4024 us/op 1.00
LinkedList of 24000 items push then shift 8.7430 ns/op 9.0900 ns/op 0.96
array of 24000 items push then pop 67.676 ns/op 83.101 ns/op 0.81
LinkedList of 24000 items push then pop 8.6410 ns/op 9.0130 ns/op 0.96
intersect bitArray bitLen 8 13.336 ns/op 13.682 ns/op 0.97
intersect array and set length 8 74.297 ns/op 86.889 ns/op 0.86
intersect bitArray bitLen 128 43.881 ns/op 44.447 ns/op 0.99
intersect array and set length 128 1.0276 us/op 1.2533 us/op 0.82
Buffer.concat 32 items 2.6450 us/op 2.8360 us/op 0.93
Uint8Array.set 32 items 3.2200 us/op 2.8410 us/op 1.13
pass gossip attestations to forkchoice per slot 2.5552 ms/op 3.5158 ms/op 0.73
computeDeltas 2.9062 ms/op 3.1484 ms/op 0.92
computeProposerBoostScoreFromBalances 1.7502 ms/op 1.8024 ms/op 0.97
altair processAttestation - 250000 vs - 7PWei normalcase 2.0258 ms/op 2.5485 ms/op 0.79
altair processAttestation - 250000 vs - 7PWei worstcase 3.3200 ms/op 4.4601 ms/op 0.74
altair processAttestation - setStatus - 1/6 committees join 138.15 us/op 145.22 us/op 0.95
altair processAttestation - setStatus - 1/3 committees join 277.14 us/op 284.43 us/op 0.97
altair processAttestation - setStatus - 1/2 committees join 373.40 us/op 380.41 us/op 0.98
altair processAttestation - setStatus - 2/3 committees join 466.59 us/op 481.23 us/op 0.97
altair processAttestation - setStatus - 4/5 committees join 647.70 us/op 681.25 us/op 0.95
altair processAttestation - setStatus - 100% committees join 771.00 us/op 807.67 us/op 0.95
altair processBlock - 250000 vs - 7PWei normalcase 17.079 ms/op 17.947 ms/op 0.95
altair processBlock - 250000 vs - 7PWei normalcase hashState 32.467 ms/op 27.513 ms/op 1.18
altair processBlock - 250000 vs - 7PWei worstcase 58.976 ms/op 50.886 ms/op 1.16
altair processBlock - 250000 vs - 7PWei worstcase hashState 73.024 ms/op 70.349 ms/op 1.04
phase0 processBlock - 250000 vs - 7PWei normalcase 2.0696 ms/op 2.3649 ms/op 0.88
phase0 processBlock - 250000 vs - 7PWei worstcase 27.884 ms/op 31.293 ms/op 0.89
altair processEth1Data - 250000 vs - 7PWei normalcase 469.69 us/op 562.95 us/op 0.83
vc - 250000 eb 1 eth1 1 we 0 wn 0 - smpl 15 6.9820 us/op 10.711 us/op 0.65
vc - 250000 eb 0.95 eth1 0.1 we 0.05 wn 0 - smpl 219 19.498 us/op 28.048 us/op 0.70
vc - 250000 eb 0.95 eth1 0.3 we 0.05 wn 0 - smpl 42 10.848 us/op 11.780 us/op 0.92
vc - 250000 eb 0.95 eth1 0.7 we 0.05 wn 0 - smpl 18 10.234 us/op 11.368 us/op 0.90
vc - 250000 eb 0.1 eth1 0.1 we 0 wn 0 - smpl 1020 79.729 us/op 115.90 us/op 0.69
vc - 250000 eb 0.03 eth1 0.03 we 0 wn 0 - smpl 11777 1.2226 ms/op 677.86 us/op 1.80
vc - 250000 eb 0.01 eth1 0.01 we 0 wn 0 - smpl 16384 1.6501 ms/op 946.42 us/op 1.74
vc - 250000 eb 0 eth1 0 we 0 wn 0 - smpl 16384 1.6108 ms/op 944.27 us/op 1.71
vc - 250000 eb 0 eth1 0 we 0 wn 0 nocache - smpl 16384 2.3016 ms/op 2.4432 ms/op 0.94
vc - 250000 eb 0 eth1 1 we 0 wn 0 - smpl 16384 2.2612 ms/op 1.6162 ms/op 1.40
vc - 250000 eb 0 eth1 1 we 0 wn 0 nocache - smpl 16384 3.7423 ms/op 4.1113 ms/op 0.91
Tree 40 250000 create 307.63 ms/op 365.66 ms/op 0.84
Tree 40 250000 get(125000) 182.62 ns/op 196.06 ns/op 0.93
Tree 40 250000 set(125000) 938.65 ns/op 1.0613 us/op 0.88
Tree 40 250000 toArray() 16.714 ms/op 23.667 ms/op 0.71
Tree 40 250000 iterate all - toArray() + loop 16.893 ms/op 23.862 ms/op 0.71
Tree 40 250000 iterate all - get(i) 66.925 ms/op 77.271 ms/op 0.87
MutableVector 250000 create 13.450 ms/op 11.574 ms/op 1.16
MutableVector 250000 get(125000) 6.3450 ns/op 6.5410 ns/op 0.97
MutableVector 250000 set(125000) 264.53 ns/op 294.67 ns/op 0.90
MutableVector 250000 toArray() 2.8795 ms/op 3.8719 ms/op 0.74
MutableVector 250000 iterate all - toArray() + loop 3.3730 ms/op 4.1638 ms/op 0.81
MutableVector 250000 iterate all - get(i) 1.5066 ms/op 1.5316 ms/op 0.98
Array 250000 create 2.5097 ms/op 3.3074 ms/op 0.76
Array 250000 clone - spread 1.1295 ms/op 1.1967 ms/op 0.94
Array 250000 get(125000) 0.55600 ns/op 0.55900 ns/op 0.99
Array 250000 set(125000) 0.62900 ns/op 0.63400 ns/op 0.99
Array 250000 iterate all - loop 81.746 us/op 95.937 us/op 0.85
effectiveBalanceIncrements clone Uint8Array 300000 25.290 us/op 37.430 us/op 0.68
effectiveBalanceIncrements clone MutableVector 300000 357.00 ns/op 348.00 ns/op 1.03
effectiveBalanceIncrements rw all Uint8Array 300000 167.10 us/op 175.44 us/op 0.95
effectiveBalanceIncrements rw all MutableVector 300000 77.764 ms/op 82.576 ms/op 0.94
phase0 afterProcessEpoch - 250000 vs - 7PWei 111.75 ms/op 116.54 ms/op 0.96
phase0 beforeProcessEpoch - 250000 vs - 7PWei 41.768 ms/op 39.446 ms/op 1.06
altair processEpoch - mainnet_e81889 348.26 ms/op 318.46 ms/op 1.09
mainnet_e81889 - altair beforeProcessEpoch 64.225 ms/op 65.735 ms/op 0.98
mainnet_e81889 - altair processJustificationAndFinalization 25.528 us/op 18.709 us/op 1.36
mainnet_e81889 - altair processInactivityUpdates 6.3312 ms/op 6.5831 ms/op 0.96
mainnet_e81889 - altair processRewardsAndPenalties 88.766 ms/op 70.068 ms/op 1.27
mainnet_e81889 - altair processRegistryUpdates 3.7380 us/op 4.3450 us/op 0.86
mainnet_e81889 - altair processSlashings 797.00 ns/op 1.4720 us/op 0.54
mainnet_e81889 - altair processEth1DataReset 830.00 ns/op 633.00 ns/op 1.31
mainnet_e81889 - altair processEffectiveBalanceUpdates 2.2835 ms/op 1.2618 ms/op 1.81
mainnet_e81889 - altair processSlashingsReset 6.1840 us/op 4.3090 us/op 1.44
mainnet_e81889 - altair processRandaoMixesReset 7.1780 us/op 7.3850 us/op 0.97
mainnet_e81889 - altair processHistoricalRootsUpdate 1.0120 us/op 720.00 ns/op 1.41
mainnet_e81889 - altair processParticipationFlagUpdates 3.0680 us/op 3.1120 us/op 0.99
mainnet_e81889 - altair processSyncCommitteeUpdates 840.00 ns/op 942.00 ns/op 0.89
mainnet_e81889 - altair afterProcessEpoch 119.12 ms/op 131.01 ms/op 0.91
phase0 processEpoch - mainnet_e58758 370.71 ms/op 370.77 ms/op 1.00
mainnet_e58758 - phase0 beforeProcessEpoch 155.05 ms/op 141.81 ms/op 1.09
mainnet_e58758 - phase0 processJustificationAndFinalization 24.298 us/op 16.524 us/op 1.47
mainnet_e58758 - phase0 processRewardsAndPenalties 73.458 ms/op 68.020 ms/op 1.08
mainnet_e58758 - phase0 processRegistryUpdates 12.022 us/op 7.7560 us/op 1.55
mainnet_e58758 - phase0 processSlashings 794.00 ns/op 514.00 ns/op 1.54
mainnet_e58758 - phase0 processEth1DataReset 854.00 ns/op 529.00 ns/op 1.61
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 1.8710 ms/op 1.3105 ms/op 1.43
mainnet_e58758 - phase0 processSlashingsReset 5.0580 us/op 4.6150 us/op 1.10
mainnet_e58758 - phase0 processRandaoMixesReset 7.2330 us/op 4.8120 us/op 1.50
mainnet_e58758 - phase0 processHistoricalRootsUpdate 1.0240 us/op 636.00 ns/op 1.61
mainnet_e58758 - phase0 processParticipationRecordUpdates 6.1340 us/op 4.1720 us/op 1.47
mainnet_e58758 - phase0 afterProcessEpoch 96.472 ms/op 102.54 ms/op 0.94
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.1554 ms/op 1.2953 ms/op 0.89
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 2.8070 ms/op 1.5921 ms/op 1.76
altair processInactivityUpdates - 250000 normalcase 30.564 ms/op 23.543 ms/op 1.30
altair processInactivityUpdates - 250000 worstcase 26.086 ms/op 29.189 ms/op 0.89
phase0 processRegistryUpdates - 250000 normalcase 6.2380 us/op 7.7110 us/op 0.81
phase0 processRegistryUpdates - 250000 badcase_full_deposits 484.40 us/op 282.49 us/op 1.71
phase0 processRegistryUpdates - 250000 worstcase 0.5 151.64 ms/op 130.07 ms/op 1.17
altair processRewardsAndPenalties - 250000 normalcase 65.526 ms/op 68.536 ms/op 0.96
altair processRewardsAndPenalties - 250000 worstcase 72.052 ms/op 68.911 ms/op 1.05
phase0 getAttestationDeltas - 250000 normalcase 6.5083 ms/op 6.6744 ms/op 0.98
phase0 getAttestationDeltas - 250000 worstcase 6.5475 ms/op 6.8047 ms/op 0.96
phase0 processSlashings - 250000 worstcase 3.5167 ms/op 3.3918 ms/op 1.04
altair processSyncCommitteeUpdates - 250000 182.47 ms/op 187.40 ms/op 0.97
BeaconState.hashTreeRoot - No change 262.00 ns/op 363.00 ns/op 0.72
BeaconState.hashTreeRoot - 1 full validator 55.515 us/op 52.948 us/op 1.05
BeaconState.hashTreeRoot - 32 full validator 698.03 us/op 565.37 us/op 1.23
BeaconState.hashTreeRoot - 512 full validator 6.1403 ms/op 5.3592 ms/op 1.15
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 62.458 us/op 65.084 us/op 0.96
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 866.90 us/op 929.00 us/op 0.93
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 12.044 ms/op 13.222 ms/op 0.91
BeaconState.hashTreeRoot - 1 balances 50.927 us/op 50.711 us/op 1.00
BeaconState.hashTreeRoot - 32 balances 621.15 us/op 481.68 us/op 1.29
BeaconState.hashTreeRoot - 512 balances 5.2460 ms/op 4.6453 ms/op 1.13
BeaconState.hashTreeRoot - 250000 balances 82.321 ms/op 73.030 ms/op 1.13
aggregationBits - 2048 els - zipIndexesInBitList 15.495 us/op 17.686 us/op 0.88
regular array get 100000 times 32.618 us/op 45.391 us/op 0.72
wrappedArray get 100000 times 32.658 us/op 33.833 us/op 0.97
arrayWithProxy get 100000 times 15.951 ms/op 15.732 ms/op 1.01
ssz.Root.equals 546.00 ns/op 560.00 ns/op 0.97
byteArrayEquals 535.00 ns/op 590.00 ns/op 0.91
shuffle list - 16384 els 6.7801 ms/op 7.0643 ms/op 0.96
shuffle list - 250000 els 99.702 ms/op 105.42 ms/op 0.95
processSlot - 1 slots 8.2500 us/op 8.9270 us/op 0.92
processSlot - 32 slots 1.3699 ms/op 1.4015 ms/op 0.98
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 40.657 ms/op 39.024 ms/op 1.04
getCommitteeAssignments - req 1 vs - 250000 vc 2.8992 ms/op 3.0540 ms/op 0.95
getCommitteeAssignments - req 100 vs - 250000 vc 4.1185 ms/op 4.4554 ms/op 0.92
getCommitteeAssignments - req 1000 vs - 250000 vc 4.4173 ms/op 4.8923 ms/op 0.90
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 4.7500 ns/op 5.4800 ns/op 0.87
state getBlockRootAtSlot - 250000 vs - 7PWei 794.43 ns/op 768.55 ns/op 1.03
computeProposers - vc 250000 11.109 ms/op 12.112 ms/op 0.92
computeEpochShuffling - vc 250000 101.92 ms/op 110.87 ms/op 0.92
getNextSyncCommittee - vc 250000 181.75 ms/op 196.98 ms/op 0.92
computeSigningRoot for AttestationData 13.518 us/op 15.549 us/op 0.87
hash AttestationData serialized data then Buffer.toString(base64) 2.4301 us/op 2.6036 us/op 0.93
toHexString serialized data 1.0797 us/op 1.1995 us/op 0.90
Buffer.toString(base64) 319.36 ns/op 359.90 ns/op 0.89

by benchmarkbot/action

@g11tech
g11tech merged commit f671360 into unstable Apr 22, 2023
@g11tech
g11tech deleted the g11tech/spec-ver-1.3.0 branch April 22, 2023 15:31
@wemeetagain

Copy link
Copy Markdown
Member

馃帀 This PR is included in v1.8.0 馃帀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants