Skip to content
This repository has been archived by the owner on Apr 18, 2024. It is now read-only.

Migrate data from IPFS Cluster #1

Closed
alanshaw opened this issue Jan 12, 2023 · 0 comments
Closed

Migrate data from IPFS Cluster #1

alanshaw opened this issue Jan 12, 2023 · 0 comments
Assignees
@alanshaw @francardoso93
Milestone
w3up phase 4

Comments

@alanshaw
Copy link
Member

We need to migrate data off of IPFS Cluster that is not already in buckets. Rough plan:

Determine list(s) of CIDs to migrate

  • Consider both upload.backup_urls as well as backup table when determining whether to backup
  • web3.storage also needs to consider psa_pin_request

Changes needed to this repo

  • Read an ndjson list of things to backup
  • Start from index (for restarts)
  • Replace updating DB with logging success failure
  • Output results
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@alanshaw alanshaw

@francardoso93 francardoso93

Labels
None yet
Projects
None yet
Milestone
w3up phase 4
Development

No branches or pull requests
3 participants
@alanshaw @heyjay44 @francardoso93