Code

Import export trie log#6363

Code

Merged

jframe merged 51 commits intohyperledger:mainhyperledger/besu:mainfrom gfukushima:import-export-trie-loggfukushima/besu:import-export-trie-logCopy head branch name to clipboardJan 22, 2024

+349-83

Commits

Commits on Dec 15, 2023

• Add x-trie-log subcommand for one-off backlog prune

  Show description for 16c0a49
  

  siladu

  authored and

  gfukushima

  committed
  16c0a49

• long -> int

  Show description for 7dd4928
  

  siladu

  authored and

  gfukushima

  committed
  7dd4928

• Removed banned method

  Show description for bf2b098
  gfukushima

  committed
  bf2b098

• Preload process stream in parallel

  Show description for e67ae51
  gfukushima

  committed
  e67ae51

• Drop unwanted trielogs and keep reatain layers only

  Show description for 9b4e0c9
  gfukushima

  committed
  9b4e0c9

• Add output to user and cleanup refactor

  Show description for 0b9fe83
  gfukushima

  committed
  0b9fe83

• small tweak to display cf that had reference dropped by RocksDbSegmentIdentifier.reset()

  Show description for 426848e
  gfukushima

  committed
  426848e

• spotless

  Show description for 7401b59
  gfukushima

  committed
  7401b59

• Fix classes that changed package

  Show description for 1b7fb72
  gfukushima

  committed
  1b7fb72

• spotless

  Show description for 11e6b05
  gfukushima

  committed
  11e6b05

• Code review

  Show description for f2d01e2
  gfukushima

  committed
  f2d01e2

• Only clear DB when we have the exact amount of trie logs we want in memory

  Show description for 04f1aaa
  gfukushima

  committed
  04f1aaa

Commits on Dec 18, 2023

• Trielogs stream to and from file to avoid possibly OOM

  Show description for 2f01c5a
  gfukushima

  committed
  2f01c5a

• Process trie logs in chunks to avoid OOM

  Show description for 56e4c8e
  gfukushima

  committed
  56e4c8e

Commits on Dec 19, 2023

• save and read in batches to handle edge cases

  Show description for 78561b0
  gfukushima

  committed
  78561b0

Commits on Dec 20, 2023

• save and read files to/from database dir

  Show description for 42c72cf
  gfukushima

  committed
  42c72cf

• Merge branch 'main' into x-trie-log-subcommand-2

  gfukushima

  committed
  9961fc2

Commits on Dec 21, 2023

• add unit tests and PR review fixes

  Show description for 9389540
  gfukushima

  committed
  9389540

• Merge branch 'main' into x-trie-log-subcommand-2

  gfukushima

  committed
  e3d4fbc

• spdx

  Show description for c7144fe
  gfukushima

  committed
  c7144fe

• Fix unit tests directory creation and deletion

  Show description for 20b0ba5
  gfukushima

  committed
  20b0ba5

Commits on Jan 4, 2024

• rename Xbonsai-trie-log-pruning-enabled to Xbonsai-limit-trie-logs-enabled

  Show description for 586ab25
  gfukushima

  committed
  586ab25

• Import and export trie log subcommands

  Show description for 67e6f3d
  gfukushima

  committed
  67e6f3d

• PR review

  Show description for b9640e5
  gfukushima

  committed
  b9640e5

• spotless

  Show description for 3bc1878
  gfukushima

  committed
  3bc1878

Commits on Jan 7, 2024

• fix path resolver and added unit tests

  Show description for d47ddf5
  gfukushima

  committed
  d47ddf5

Commits on Jan 8, 2024

• Merge branch 'main' into import-export-trie-log

  gfukushima

  authored
  999edb6

• fix unit test

  Show description for 1699fe4
  gfukushima

  committed
  1699fe4

• Merge remote-tracking branch 'origin/import-export-trie-log' into import-export-trie-log

  gfukushima

  committed
  e679cb3

• fix unit test

  Show description for 5d3b4f2
  gfukushima

  committed
  5d3b4f2

• Merge branch 'main' into import-export-trie-log

  gfukushima

  authored
  f839b75

• Add import and export to list of subcommands under --x-trie-log

  Show description for 0caa4cf
  gfukushima

  committed
  0caa4cf

• Merge remote-tracking branch 'origin/import-export-trie-log' into import-export-trie-log

  gfukushima

  committed
  2d5d31d

• Remove static from setup method

  Show description for 37df23e
  gfukushima

  committed
  37df23e

• change option name and fix descriptions

  Show description for 5ce1800
  gfukushima

  committed
  5ce1800

• Merge branch 'main' into import-export-trie-log

  Show description for 98423dc
  gfukushima

  committed
  98423dc

Commits on Jan 9, 2024

• Fix subcommands descriptions

  Show description for cf3a5e6
  gfukushima

  committed
  cf3a5e6

• Merge branch 'main' into import-export-trie-log

  gfukushima

  authored
  c759bba

Commits on Jan 12, 2024

• Remove old flag and move commands const into Unstable

  Show description for 5fb9413
  gfukushima

  committed
  5fb9413

• Allow list of block hashes to passed as well as a file to be generated or imported

  Show description for 087c54b
  gfukushima

  committed
  087c54b

• Merge remote-tracking branch 'origin/import-export-trie-log' into import-export-trie-log

  gfukushima

  committed
  4b033a3

• Allow list of block hashes to passed as well as a file to be generated or imported

  Show description for 3a89ac3
  gfukushima

  committed
  3a89ac3

• Fix broken test when replaced the old option

  Show description for 9be7d13
  gfukushima

  committed
  9be7d13

Commits on Jan 19, 2024

• import and export using rlp

  Show description for 75d1c3b
  jframe

  committed
  75d1c3b

• Merge branch 'main' into import-export-trie-log

  jframe

  authored
  5eb4cda

• tests for exporting and importing multiple trielogs

  Show description for 5425075
  jframe

  committed
  5425075

• Merge branch 'import-export-trie-log' of github.com:gfukushima/besu into import-export-trie-log

  jframe

  committed
  2de0b19

• Merge branch 'main' into import-export-trie-log

  jframe

  authored
  248a776

• fix build

  Show description for 55d653e
  jframe

  committed
  55d653e

• Merge branch 'main' into import-export-trie-log

  jframe

  authored
  c9d38f0

Commits on Jan 22, 2024

• Merge branch 'main' into import-export-trie-log

  jframe

  authored
  b9d7620