Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Epic] Improving retrieval reliability #645

Open
jacobheun opened this issue Jul 7, 2022 · 4 comments
Open

[Epic] Improving retrieval reliability #645

jacobheun opened this issue Jul 7, 2022 · 4 comments
Labels
area/retrieval Area: Retrieval status/in-progress Status: In Progress

Comments

@jacobheun
Copy link
Contributor

jacobheun commented Jul 7, 2022

This is a parent tracking issue for issues related to retrieval reliability problems

Problem

Storage Providers and clients have been experiencing increasing trouble with retrievable reliability for various reasons (tracked below). This is critical functionality that is also currently slowing down the throughput of deal renewal programs, like Evergreen

These issues are spread out across Lotus, go-fil-markets, Boost, and Filecoin Slack. As such, this issue will be leveraged as a central hub for tracking retrieval reliability.

Latest Status

Updated: Aug 25th, 2022

  • Our highest priority is currently on resolving full piece retrieval needed for deal renewal.

Tracked Issues

Known Issues

Bug Fixes

Features

Shipped

  • Added an experimental http server, booster-http, to enable easy full piece/car retrieval.
  • Added support for inspecting piece and payload CID's to debug retrieval issues. Available in v1.2.0-rc1
@jacobheun jacobheun pinned this issue Jul 7, 2022
@jacobheun jacobheun added area/retrieval Area: Retrieval status/in-progress Status: In Progress labels Jul 7, 2022
@LexLuthr
Copy link
Collaborator

LexLuthr commented Jul 7, 2022

I think https://filecoinproject.slack.com/archives/C0377FJCG1L/p1657019175554179 would need to be prioritised as it is hitting Evergreen badly.

filecoin-project/lotus#8663

@jacobheun
Copy link
Contributor Author

@LexLuthr do we have an issue for that yet, I know the team is looking into it? I'd like to make sure we're tracking all issues here and getting them aggregated to this issue.

@dirkmc
Copy link
Contributor

dirkmc commented Jul 7, 2022

I believe HTTP retrieval of a piece should help with filecoin-project/lotus#8663

@LexLuthr
Copy link
Collaborator

LexLuthr commented Jul 7, 2022

Yes, I have noted that in my observation in the original issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/retrieval Area: Retrieval status/in-progress Status: In Progress
Projects
Status: In Progress
Development

No branches or pull requests

3 participants