Moving trielog to the rockdb blob part

[jframe]

Moving trielog to the rockdb blob part

• Can we delete the data stored in the rocksDB BlobDB as this is needed for pruning Moving trielog to the rockdb blob part #5866?
  • docs say yes, need to verify
• From Blobdb for static data #5475 BlobDB is a better choice since it reduces a lot the write amplification during compaction, with the result of faster initial sync and less wear out of the disk
• Verify if pruning has an impact on performance due to compaction Moving trielog to the rockdb blob part #5866
• Test that we can upgrade to a next Besu version
• Test that we can downgrade to a previous Besu version
• Should we have a feature flag for this or should it be enabled by default?

Notes:

• We can't move the trie branches only the trie logs
• https://github.com/facebook/rocksdb/wiki/BlobDB
• Introduce variables storage #5471
• Blobdb for static data #5475

[usmansaleem]

The trielog as blobdb nodes writes less bytes during compaction (on avg and on peeks) as compared to trielog without blobdb feature: