Skip to content

Reintroduce typescript-docs-verifier - #4507

Merged
dapplion merged 2 commits into
unstablefrom
cayman/typescript-docs-verifier
Sep 3, 2022
Merged

Reintroduce typescript-docs-verifier#4507
dapplion merged 2 commits into
unstablefrom
cayman/typescript-docs-verifier

Conversation

@wemeetagain

@wemeetagain wemeetagain commented Sep 3, 2022

Copy link
Copy Markdown
Member

@wemeetagain
wemeetagain requested a review from a team as a code owner September 3, 2022 14:38
@github-actions

github-actions Bot commented Sep 3, 2022

Copy link
Copy Markdown
Contributor

Performance Report

鉁旓笍 no performance regression detected

Full benchmark results
Benchmark suite Current: 15fe587 Previous: aacec43 Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 1.9904 ms/op 2.1909 ms/op 0.91
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 70.897 us/op 79.598 us/op 0.89
BLS verify - blst-native 1.8560 ms/op 1.9737 ms/op 0.94
BLS verifyMultipleSignatures 3 - blst-native 3.8022 ms/op 4.0682 ms/op 0.93
BLS verifyMultipleSignatures 8 - blst-native 8.1905 ms/op 8.6342 ms/op 0.95
BLS verifyMultipleSignatures 32 - blst-native 29.646 ms/op 32.345 ms/op 0.92
BLS aggregatePubkeys 32 - blst-native 39.409 us/op 42.407 us/op 0.93
BLS aggregatePubkeys 128 - blst-native 152.80 us/op 160.19 us/op 0.95
getAttestationsForBlock 155.78 ms/op 180.76 ms/op 0.86
isKnown best case - 1 super set check 436.00 ns/op 496.00 ns/op 0.88
isKnown normal case - 2 super set checks 430.00 ns/op 468.00 ns/op 0.92
isKnown worse case - 16 super set checks 426.00 ns/op 455.00 ns/op 0.94
CheckpointStateCache - add get delete 8.5110 us/op 8.9800 us/op 0.95
validate gossip signedAggregateAndProof - struct 4.2588 ms/op 4.5504 ms/op 0.94
validate gossip attestation - struct 2.0326 ms/op 2.1957 ms/op 0.93
pickEth1Vote - no votes 2.1823 ms/op 2.3694 ms/op 0.92
pickEth1Vote - max votes 18.318 ms/op 20.168 ms/op 0.91
pickEth1Vote - Eth1Data hashTreeRoot value x2048 10.477 ms/op 12.135 ms/op 0.86
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 19.460 ms/op 24.349 ms/op 0.80
pickEth1Vote - Eth1Data fastSerialize value x2048 1.5776 ms/op 1.7781 ms/op 0.89
pickEth1Vote - Eth1Data fastSerialize tree x2048 11.734 ms/op 14.600 ms/op 0.80
bytes32 toHexString 1.0490 us/op 1.2440 us/op 0.84
bytes32 Buffer.toString(hex) 734.00 ns/op 798.00 ns/op 0.92
bytes32 Buffer.toString(hex) from Uint8Array 927.00 ns/op 997.00 ns/op 0.93
bytes32 Buffer.toString(hex) + 0x 731.00 ns/op 802.00 ns/op 0.91
Object access 1 prop 0.35400 ns/op 0.43600 ns/op 0.81
Map access 1 prop 0.29000 ns/op 0.33700 ns/op 0.86
Object get x1000 17.873 ns/op 20.941 ns/op 0.85
Map get x1000 1.0200 ns/op 1.1610 ns/op 0.88
Object set x1000 115.07 ns/op 139.13 ns/op 0.83
Map set x1000 67.385 ns/op 84.512 ns/op 0.80
Return object 10000 times 0.37140 ns/op 0.44390 ns/op 0.84
Throw Error 10000 times 5.8888 us/op 6.8871 us/op 0.86
enrSubnets - fastDeserialize 64 bits 2.6140 us/op 3.0360 us/op 0.86
enrSubnets - ssz BitVector 64 bits 760.00 ns/op 873.00 ns/op 0.87
enrSubnets - fastDeserialize 4 bits 357.00 ns/op 453.00 ns/op 0.79
enrSubnets - ssz BitVector 4 bits 753.00 ns/op 819.00 ns/op 0.92
prioritizePeers score -10:0 att 32-0.1 sync 2-0 90.569 us/op 97.626 us/op 0.93
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 124.04 us/op 131.68 us/op 0.94
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 204.37 us/op 229.21 us/op 0.89
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 459.79 us/op 492.08 us/op 0.93
prioritizePeers score 0:0 att 64-1 sync 4-1 464.50 us/op 485.51 us/op 0.96
RateTracker 1000000 limit, 1 obj count per request 181.54 ns/op 225.46 ns/op 0.81
RateTracker 1000000 limit, 2 obj count per request 136.52 ns/op 174.96 ns/op 0.78
RateTracker 1000000 limit, 4 obj count per request 113.93 ns/op 142.48 ns/op 0.80
RateTracker 1000000 limit, 8 obj count per request 103.42 ns/op 130.64 ns/op 0.79
RateTracker with prune 4.1160 us/op 4.4360 us/op 0.93
array of 16000 items push then shift 3.1931 us/op 3.3870 us/op 0.94
LinkedList of 16000 items push then shift 17.031 ns/op 19.106 ns/op 0.89
array of 16000 items push then pop 241.21 ns/op 255.83 ns/op 0.94
LinkedList of 16000 items push then pop 16.631 ns/op 18.903 ns/op 0.88
array of 24000 items push then shift 4.5532 us/op 5.0929 us/op 0.89
LinkedList of 24000 items push then shift 19.997 ns/op 21.464 ns/op 0.93
array of 24000 items push then pop 208.36 ns/op 228.49 ns/op 0.91
LinkedList of 24000 items push then pop 17.878 ns/op 19.552 ns/op 0.91
intersect bitArray bitLen 8 11.774 ns/op 12.882 ns/op 0.91
intersect array and set length 8 162.27 ns/op 183.01 ns/op 0.89
intersect bitArray bitLen 128 72.112 ns/op 69.287 ns/op 1.04
intersect array and set length 128 2.1824 us/op 2.4654 us/op 0.89
Buffer.concat 32 items 2.1440 ns/op 2.0320 ns/op 1.06
pass gossip attestations to forkchoice per slot 3.1527 ms/op 4.0896 ms/op 0.77
computeDeltas 3.3140 ms/op 3.4315 ms/op 0.97
computeProposerBoostScoreFromBalances 921.03 us/op 989.64 us/op 0.93
altair processAttestation - 250000 vs - 7PWei normalcase 3.5957 ms/op 3.8997 ms/op 0.92
altair processAttestation - 250000 vs - 7PWei worstcase 5.9474 ms/op 6.3619 ms/op 0.93
altair processAttestation - setStatus - 1/6 committees join 215.03 us/op 228.97 us/op 0.94
altair processAttestation - setStatus - 1/3 committees join 410.14 us/op 423.65 us/op 0.97
altair processAttestation - setStatus - 1/2 committees join 581.33 us/op 608.76 us/op 0.95
altair processAttestation - setStatus - 2/3 committees join 750.49 us/op 788.83 us/op 0.95
altair processAttestation - setStatus - 4/5 committees join 1.0295 ms/op 1.0696 ms/op 0.96
altair processAttestation - setStatus - 100% committees join 1.2339 ms/op 1.2664 ms/op 0.97
altair processBlock - 250000 vs - 7PWei normalcase 26.417 ms/op 29.534 ms/op 0.89
altair processBlock - 250000 vs - 7PWei normalcase hashState 41.418 ms/op 41.094 ms/op 1.01
altair processBlock - 250000 vs - 7PWei worstcase 79.875 ms/op 99.342 ms/op 0.80
altair processBlock - 250000 vs - 7PWei worstcase hashState 106.32 ms/op 108.36 ms/op 0.98
phase0 processBlock - 250000 vs - 7PWei normalcase 3.3031 ms/op 3.8672 ms/op 0.85
phase0 processBlock - 250000 vs - 7PWei worstcase 45.485 ms/op 49.595 ms/op 0.92
altair processEth1Data - 250000 vs - 7PWei normalcase 775.67 us/op 891.99 us/op 0.87
Tree 40 250000 create 765.16 ms/op 839.64 ms/op 0.91
Tree 40 250000 get(125000) 289.90 ns/op 312.20 ns/op 0.93
Tree 40 250000 set(125000) 2.3209 us/op 2.6924 us/op 0.86
Tree 40 250000 toArray() 31.176 ms/op 33.997 ms/op 0.92
Tree 40 250000 iterate all - toArray() + loop 30.947 ms/op 34.446 ms/op 0.90
Tree 40 250000 iterate all - get(i) 108.30 ms/op 115.34 ms/op 0.94
MutableVector 250000 create 14.548 ms/op 18.785 ms/op 0.77
MutableVector 250000 get(125000) 15.055 ns/op 14.503 ns/op 1.04
MutableVector 250000 set(125000) 593.36 ns/op 687.00 ns/op 0.86
MutableVector 250000 toArray() 6.8251 ms/op 8.4281 ms/op 0.81
MutableVector 250000 iterate all - toArray() + loop 7.0535 ms/op 8.5257 ms/op 0.83
MutableVector 250000 iterate all - get(i) 3.3351 ms/op 3.7366 ms/op 0.89
Array 250000 create 6.1650 ms/op 7.7746 ms/op 0.79
Array 250000 clone - spread 3.3952 ms/op 4.5275 ms/op 0.75
Array 250000 get(125000) 1.4630 ns/op 1.8550 ns/op 0.79
Array 250000 set(125000) 1.4790 ns/op 1.8020 ns/op 0.82
Array 250000 iterate all - loop 167.84 us/op 184.87 us/op 0.91
effectiveBalanceIncrements clone Uint8Array 300000 76.191 us/op 100.09 us/op 0.76
effectiveBalanceIncrements clone MutableVector 300000 1.0830 us/op 1.3550 us/op 0.80
effectiveBalanceIncrements rw all Uint8Array 300000 254.94 us/op 279.73 us/op 0.91
effectiveBalanceIncrements rw all MutableVector 300000 193.44 ms/op 228.58 ms/op 0.85
phase0 afterProcessEpoch - 250000 vs - 7PWei 182.51 ms/op 233.67 ms/op 0.78
phase0 beforeProcessEpoch - 250000 vs - 7PWei 97.219 ms/op 74.013 ms/op 1.31
altair processEpoch - mainnet_e81889 572.21 ms/op 626.06 ms/op 0.91
mainnet_e81889 - altair beforeProcessEpoch 153.07 ms/op 150.69 ms/op 1.02
mainnet_e81889 - altair processJustificationAndFinalization 39.554 us/op 37.704 us/op 1.05
mainnet_e81889 - altair processInactivityUpdates 10.735 ms/op 12.082 ms/op 0.89
mainnet_e81889 - altair processRewardsAndPenalties 89.805 ms/op 168.16 ms/op 0.53
mainnet_e81889 - altair processRegistryUpdates 5.7050 us/op 8.6040 us/op 0.66
mainnet_e81889 - altair processSlashings 1.3160 us/op 1.6770 us/op 0.78
mainnet_e81889 - altair processEth1DataReset 1.3760 us/op 2.1790 us/op 0.63
mainnet_e81889 - altair processEffectiveBalanceUpdates 2.5713 ms/op 2.6413 ms/op 0.97
mainnet_e81889 - altair processSlashingsReset 11.465 us/op 13.359 us/op 0.86
mainnet_e81889 - altair processRandaoMixesReset 10.092 us/op 15.255 us/op 0.66
mainnet_e81889 - altair processHistoricalRootsUpdate 1.4550 us/op 2.7020 us/op 0.54
mainnet_e81889 - altair processParticipationFlagUpdates 5.4320 us/op 9.1760 us/op 0.59
mainnet_e81889 - altair processSyncCommitteeUpdates 1.1650 us/op 1.6830 us/op 0.69
mainnet_e81889 - altair afterProcessEpoch 191.29 ms/op 213.43 ms/op 0.90
phase0 processEpoch - mainnet_e58758 515.93 ms/op 565.93 ms/op 0.91
mainnet_e58758 - phase0 beforeProcessEpoch 223.75 ms/op 247.04 ms/op 0.91
mainnet_e58758 - phase0 processJustificationAndFinalization 31.684 us/op 40.305 us/op 0.79
mainnet_e58758 - phase0 processRewardsAndPenalties 134.11 ms/op 149.87 ms/op 0.89
mainnet_e58758 - phase0 processRegistryUpdates 15.722 us/op 17.471 us/op 0.90
mainnet_e58758 - phase0 processSlashings 1.2900 us/op 1.7130 us/op 0.75
mainnet_e58758 - phase0 processEth1DataReset 1.2070 us/op 1.8410 us/op 0.66
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 2.3824 ms/op 2.6650 ms/op 0.89
mainnet_e58758 - phase0 processSlashingsReset 5.4930 us/op 11.451 us/op 0.48
mainnet_e58758 - phase0 processRandaoMixesReset 9.5860 us/op 14.854 us/op 0.65
mainnet_e58758 - phase0 processHistoricalRootsUpdate 859.00 ns/op 2.0150 us/op 0.43
mainnet_e58758 - phase0 processParticipationRecordUpdates 6.5650 us/op 11.283 us/op 0.58
mainnet_e58758 - phase0 afterProcessEpoch 157.23 ms/op 192.98 ms/op 0.81
phase0 processEffectiveBalanceUpdates - 250000 normalcase 2.6313 ms/op 2.9432 ms/op 0.89
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 3.4148 ms/op 3.9277 ms/op 0.87
altair processInactivityUpdates - 250000 normalcase 37.373 ms/op 44.418 ms/op 0.84
altair processInactivityUpdates - 250000 worstcase 47.609 ms/op 54.612 ms/op 0.87
phase0 processRegistryUpdates - 250000 normalcase 13.113 us/op 16.609 us/op 0.79
phase0 processRegistryUpdates - 250000 badcase_full_deposits 548.96 us/op 542.43 us/op 1.01
phase0 processRegistryUpdates - 250000 worstcase 0.5 205.85 ms/op 227.17 ms/op 0.91
altair processRewardsAndPenalties - 250000 normalcase 120.40 ms/op 144.64 ms/op 0.83
altair processRewardsAndPenalties - 250000 worstcase 86.805 ms/op 93.266 ms/op 0.93
phase0 getAttestationDeltas - 250000 normalcase 13.031 ms/op 14.042 ms/op 0.93
phase0 getAttestationDeltas - 250000 worstcase 13.327 ms/op 14.580 ms/op 0.91
phase0 processSlashings - 250000 worstcase 5.4936 ms/op 5.8012 ms/op 0.95
altair processSyncCommitteeUpdates - 250000 283.21 ms/op 302.24 ms/op 0.94
BeaconState.hashTreeRoot - No change 462.00 ns/op 520.00 ns/op 0.89
BeaconState.hashTreeRoot - 1 full validator 62.291 us/op 64.219 us/op 0.97
BeaconState.hashTreeRoot - 32 full validator 833.21 us/op 900.73 us/op 0.93
BeaconState.hashTreeRoot - 512 full validator 5.8093 ms/op 7.3981 ms/op 0.79
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 76.768 us/op 87.390 us/op 0.88
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 1.1319 ms/op 1.2382 ms/op 0.91
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 14.880 ms/op 16.191 ms/op 0.92
BeaconState.hashTreeRoot - 1 balances 56.760 us/op 67.235 us/op 0.84
BeaconState.hashTreeRoot - 32 balances 546.47 us/op 616.55 us/op 0.89
BeaconState.hashTreeRoot - 512 balances 5.5003 ms/op 6.1814 ms/op 0.89
BeaconState.hashTreeRoot - 250000 balances 85.407 ms/op 103.99 ms/op 0.82
aggregationBits - 2048 els - zipIndexesInBitList 31.392 us/op 31.872 us/op 0.98
regular array get 100000 times 67.401 us/op 74.872 us/op 0.90
wrappedArray get 100000 times 67.379 us/op 72.800 us/op 0.93
arrayWithProxy get 100000 times 31.478 ms/op 32.653 ms/op 0.96
ssz.Root.equals 445.00 ns/op 514.00 ns/op 0.87
byteArrayEquals 439.00 ns/op 517.00 ns/op 0.85
shuffle list - 16384 els 10.850 ms/op 12.651 ms/op 0.86
shuffle list - 250000 els 160.29 ms/op 190.16 ms/op 0.84
processSlot - 1 slots 11.010 us/op 13.917 us/op 0.79
processSlot - 32 slots 1.6824 ms/op 1.9998 ms/op 0.84
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 364.03 us/op 1.0951 ms/op 0.33
getCommitteeAssignments - req 1 vs - 250000 vc 5.2670 ms/op 5.9300 ms/op 0.89
getCommitteeAssignments - req 100 vs - 250000 vc 7.2740 ms/op 7.9674 ms/op 0.91
getCommitteeAssignments - req 1000 vs - 250000 vc 7.7578 ms/op 8.3844 ms/op 0.93
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 10.370 ns/op 10.450 ns/op 0.99
state getBlockRootAtSlot - 250000 vs - 7PWei 1.0276 us/op 1.1284 us/op 0.91
computeProposers - vc 250000 16.753 ms/op 18.228 ms/op 0.92
computeEpochShuffling - vc 250000 163.70 ms/op 181.11 ms/op 0.90
getNextSyncCommittee - vc 250000 279.62 ms/op 307.91 ms/op 0.91

by benchmarkbot/action

@dapplion
dapplion merged commit 8806ed2 into unstable Sep 3, 2022
@dapplion
dapplion deleted the cayman/typescript-docs-verifier branch September 3, 2022 15:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Re-enable check-readme disabled on #3978

2 participants