p2p: test scenarios support

[algorandskiy]

Summary

• add P2PBootstrap netdeploy's template option
• add p2p dnsadddr support to netdeploy
• fix DNSSecurityTXTEnforced use for DNS TXT queries instead of DNSSecuritySRVEnforced
• add scenario1s-p2p, hello-word-tiny-p2p, hello-world-small-p2p
• fix libp2p and DHT metrics exporters
• add missing gossipSubPeer.RoutingAddr implementation needed for TX handler when throttled with ERL
• add exponential backoff to p2p meshThread
• fix outgoing connection counting, and use conn direction rather than stream direction for incoming/outgoing peer tagging
• make libp2 logger to log into node.log by implementing zapcore.Core writing via logger.Logger
  Example log records

{
    "file": "github.com/libp2p/go-libp2p@v0.32.2/config/config.go",
    "function": "github.com/libp2p/go-libp2p/config.(*Config).NewNode",
    "level": "warning",
    "line": 304,
    "msg": "rcmgr limit conflicts with connmgr limit: conn manager high watermark limit: 192, exceeds the system connection limit of: 1",
    "name": "127.0.0.1:0",
    "libp2p": "p2p-config",
    "time": "2024-04-17T19:43:31.640497-04:00"
}
{
    "file": "github.com/libp2p/go-libp2p-pubsub@v0.10.0/pubsub.go",
    "function": "github.com/libp2p/go-libp2p-pubsub.(*PubSub).processLoop",
    "level": "info",
    "line": 671,
    "msg": "pubsub processloop shutting down",
    "name": "127.0.0.1:0",
    "libp2p": "pubsub",
    "time": "2024-04-17T19:43:36.354601-04:00"
}

Test Plan

• Ran scenarios, ensured progress
• Deployed networks, collected/analyzed regular performance metrics - 4-6k TPS on scenario1s-p2p

p2p net scenario	TPS	MEM
without pubsub
with pubsub (default)

[codecov]

Codecov Report

Attention: Patch coverage is 53.52113% with 66 lines in your changes are missing coverage. Please review.

Project coverage is 56.02%. Comparing base (411837f) to head (f1f03a7).

Files	Patch %	Lines
network/p2p/logger.go	0.00%	41 Missing ⚠️
network/p2p/mux.go	78.12%	11 Missing and 3 partials ⚠️
network/p2pNetwork.go	69.56%	7 Missing ⚠️
logging/log.go	0.00%	2 Missing ⚠️
network/p2p/http.go	0.00%	1 Missing ⚠️
network/p2p/streams.go	0.00%	1 Missing ⚠️

Additional details and impacted files

@@              Coverage Diff              @@
##           feature/p2p    #5962    +/-   ##
=============================================
  Coverage        56.01%   56.02%            
=============================================
  Files              495      497     +2     
  Lines            69009    69130   +121     
=============================================
+ Hits             38657    38731    +74     
- Misses           27730    27774    +44     
- Partials          2622     2625     +3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[algorandskiy]

the idea is to have it dependency-free so it can be run on a remote machine with logs

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 31.73077% with 71 lines in your changes missing coverage. Please review.

Project coverage is 56.12%. Comparing base (8f9ad90) to head (e59fd47).

Files	Patch %	Lines
network/p2p/logger.go	0.00%	41 Missing ⚠️
network/p2pNetwork.go	63.15%	10 Missing and 4 partials ⚠️
network/p2p/p2p.go	0.00%	6 Missing ⚠️
network/p2p/streams.go	0.00%	4 Missing ⚠️
config/localTemplate.go	0.00%	3 Missing ⚠️
logging/log.go	0.00%	2 Missing ⚠️
network/p2p/http.go	0.00%	1 Missing ⚠️

Additional details and impacted files

@@               Coverage Diff               @@
##           feature/p2p    #5962      +/-   ##
===============================================
- Coverage        56.13%   56.12%   -0.02%     
===============================================
  Files              487      488       +1     
  Lines            69327    69396      +69     
===============================================
+ Hits             38919    38946      +27     
- Misses           27760    27800      +40     
- Partials          2648     2650       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[cce]

I guess it is OK to ignore the field type because they all boil down to one of these three types?

[cce]

How often does this happen?

[algorandskiy]

not sure but it did happen few times - discovered when parsed node.log files for topology images.