Unseal

[magik6k]

tldr

This PR adds an unseal pipeline along with a simple tagging system on sectors which allows SPs to specify the desired sector unseal state.

Sector target-unseal mark

Sectors now have a target_unseal_state marker which has 3 states:

• none (default) - don't do anything relating to the unsealed file. If it's there don't remove, if it's not there don't unseal
• false - mark for GC when it appears in storage (only removes after the GC mark is separately approved)
• true - currently, when the value flips from other state to true AND the unsealed file isn't present in storage an entry for the sector will be added to the unseal pipeline
  • Eventually there will be a separate mechanism monitoring storage for missing unsealed files that might be able to perform recovery, but for now to avoid triggering accidental unseals when some storage gets disconnected temporary from the cluster, unseals only get scheduled on target state change.

Unseal Pipeline

The unseal pipeline is vastly more robust than unseal requests in lotus-miner ever were, and at the same time much simpler. There are only two tasks:

• SDRKeyRegen - creates sector key on an SDR worker
  • This key is stored in scratch space
  • Only the key (last layer) is kept on-disk after the compute is done
• UnsealDecode - gets (potentially remote) streams of the sector key and sealed data, and outputs unsealed data straight to long-term-storage
  • This handles both snap and sdr unseal. Both decode processes appear to be fast enough to run even on quite under-powered storage machines
  • After this step is done the sector key is removed from scratch space

Tools

Some tools added in this PR:

• curio unseal info - outputs most relevant information about unsealed sector data
  

• curio unseal list-sectors - very basic aggregate output dumping the unseal pipeline state + target unseal states, output is not pretty but enough for visibility
  

• curio unseal set-target-state [spid] [sector] [true/false/none] - setting target unseal state for sectors

• curio unseal check [spid] [sector] - run a CommP on stored unsealed file to verify its integrity
  

todo

• Generate Key
• Decode
  • BONUS: Snap
• Pipeline
• CommK GC
• Wire into curio run
• Default build works
• Command to mark sectors for unseal
• Shared SDR max counter
• GC awareness for target-no-unsealed
• MetadataGC for Unseal pipeline
• Test run
• Command to verify unsealed sector data
• Change commp check config to mach market commp

[LexLuthr]

Looks good with some small nits.