[META] Garbage Collection Enhancement/Rework

[gammazero]

Tracking for multiple GC related issues and enhancement proposals.

Currently Open Issues:

• GC strategy for public DSNlink gateways #7784 GC strategy for public DSNlink gateways
• No GC #4382 No GC
• GC basically useless for now #6381 GC basically useless for now
• Garbage Collection enhancements (prevent GC from locking repo) #6114 Garbage Collection enhancements (prevent GC from locking repo)
• better gc #3679 better gc
• More intelligent blockstore garbage collection #3092 More intelligent blockstore garbage collection

Historical Info; Closed Issues.

• IPFS Repo GC Is Unrealistic At Non-Trivial Scale: rm -rf + resync is faster #7213 IPFS Repo GC Is Unrealistic At Non-Trivial Scale
• ipfs repo gc very slow #6322 ipfs repo gc very slow

Comments about current GC implementation: #1420
Enhancement effort: #4149

Block cache issues that may be pulled into GC work if block cache is also used for GC:

• Block cache lock contention #6934 Block cache lock contention
• Optimize the has cache

[welcome]

Thank you for submitting your first issue to this repository! A maintainer will be here shortly to triage and review.
In the meantime, please double-check that you have provided all the necessary information to make this process easy! Any information that can help save additional round trips is useful! We currently aim to give initial feedback within two business days. If this does not happen, feel free to leave a comment.
Please keep an eye on how this issue will be labeled, as labels give an overview of priorities, assignments and additional actions requested by the maintainers:

• "Priority" labels will show how urgent this is for the team.
• "Status" labels will show if this is ready to be worked on, blocked, or in progress.
• "Need" labels will indicate if additional input or analysis is required.

Finally, remember to use https://discuss.ipfs.io if you just need general support.

[luanet]

GC is query all block cids from from datastore and then compare to pinned cids and remove the missing one by one. This is expensive and slow as if we have million cids on datastore.