network: p2p traffic exchange for algorand node

[algorandskiy]

Summary

Functional p2p support for gossip network. Includes:

1. DHT advertisement and peers capabilities
   • p2p: Capabilities Advertisement for Archival/Catchpoints #5702
   • p2p dht: more tests and minor fixes #5827
   • p2p: fix dht-hybrid merge #5833
   • p2p: start p2p networking and DHT ops when starting services, not when instantiating them #5867
2. Hybrid networking when a node listens and communicates on both legacy websocket and libp2p networks
   • network: hybrid networking #5800
   • p2p: hybrid node net identity for connection deduplication #6035
3. HTTP over p2p support for catching up from p2p nodes
   • p2p: HTTP catchup over p2p network #5898
   • p2p: http catchpoints support #5924
4. p2p network cluster test scenarios
   • p2p: test scenarios support #5962
5. libp2p and DHT metrics and logging handling
   • p2p: add telemetry and DHT/libp2p metrics #5941

Contains PRs #5702, #5827, #5800, #5833, #5867, #5898, #5922, #5926, #5924, #5929, #5931, #5933, #5935, #5941, #5982, #5976, #5962, #6038

Test Plan

• unit tests for p2p, hybrid, dht
• p2p only cluster network performance tests - see p2p: test scenarios support #5962
• local net hybrid mode
• connection dedup tests in hybrid mode: fix is in p2p: hybrid node net identity for connection deduplication #6035
• cluster performance tests for hybrid mode
• connection/traffic limits are aggregated for both ws and p2p nets in hybrid mode

Test note

node_test re-enables some tests for local run as well as adds new tests resulting go test ./node takes 90s on this branch vs 30s on master

[codecov]

Codecov Report

Attention: Patch coverage is 54.79662% with 589 lines in your changes missing coverage. Please review.

Project coverage is 51.40%. Comparing base (63c0d5b) to head (4564473).

Files	Patch %	Lines
network/p2pNetwork.go	64.90%	101 Missing and 25 partials ⚠️
network/hybridNetwork.go	0.00%	111 Missing ⚠️
network/p2p/logger.go	0.00%	45 Missing ⚠️
network/p2p/p2p.go	47.67%	45 Missing ⚠️
network/p2p/streams.go	0.00%	41 Missing ⚠️
data/txHandler.go	56.62%	33 Missing and 3 partials ⚠️
network/p2p/http.go	0.00%	27 Missing ⚠️
network/p2p/peerstore/peerstore.go	39.47%	23 Missing ⚠️
network/wsNetwork.go	76.19%	19 Missing and 1 partial ⚠️
network/p2p/peerID.go	0.00%	18 Missing ⚠️
... and 20 more

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #5939      +/-   ##
==========================================
- Coverage   55.90%   51.40%   -4.50%     
==========================================
  Files         482      488       +6     
  Lines       68608    69532     +924     
==========================================
- Hits        38353    35746    -2607     
- Misses      27650    31061    +3411     
- Partials     2605     2725     +120     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[algorandskiy]

merged master to resolve conflicts