Skip to content
This repository has been archived by the owner on Jul 18, 2024. It is now read-only.

[DataCap Application] <CAO> - <Sentinel-1 SLC dataset-02> #2197

Closed
2 tasks
caoxinhe0108 opened this issue Sep 8, 2023 · 37 comments
Closed
2 tasks

[DataCap Application] <CAO> - <Sentinel-1 SLC dataset-02> #2197

caoxinhe0108 opened this issue Sep 8, 2023 · 37 comments

Comments

@caoxinhe0108
Copy link

Data Owner Name

LiveEO

What is your role related to the dataset

Dataset Owner

Data Owner Country/Region

Afghanistan

Data Owner Industry

Life Science / Healthcare

Website

https://www.live-eo.com/

Social Media

Twitter---https://twitter.com/liveeo_space
Linkedin---https://www.linkedin.com/company/liveeo/

Total amount of DataCap being requested

10PiB

Expected size of single dataset (one copy)

64G

Number of replicas to store

5

Weekly allocation of DataCap requested

1PiB

On-chain address for first allocation

f1ynv3f5ne5k7xxr7z5q7coro7rqpls3ilhuz3ndy

Data Type of Application

Public, Open Dataset (Research/Non-Profit)

Custom multisig

  • Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

LiveEO was born from the idea that satellite data, a vast and almost untapped resource, has enormous potential to transform our lives, and the world around us, for the better. Sven and Daniel, two NewSpace enthusiasts with a keen interest in A.I., founded LiveEO in 2018 with a simple vision: to apply this incredible trove of data about our planet to improve the way we do business, and live our lives.

Is this project associated with other projects/ecosystem stakeholders?

Yes

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

LiveEO was born from the idea that satellite data, a vast and almost untapped resource, has enormous potential to transform our lives, and the world around us, for the better. Sven and Daniel, two NewSpace enthusiasts with a keen interest in A.I., founded LiveEO in 2018 with a simple vision: to apply this incredible trove of data about our planet to improve the way we do business, and live our lives.

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

No response

If you are a data preparer. What is your location (Country/Region)

None

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?

No response

If you are not preparing the data, who will prepare the data? (Provide name and business)

No response

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.

No response

Please share a sample of the data

aws s3 ls --no-sign-request s3://sentinel1-slc/	Total Objects: 5961934	
1.1 PiB

Confirm that this is a public dataset that can be retrieved by anyone on the Network

  • I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Yearly

For how long do you plan to keep this dataset stored on Filecoin

2 to 3 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America, South America

How will you be distributing your data to storage providers

Cloud storage (i.e. S3)

How do you plan to choose storage providers

Slack, Big Data Exchange

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

No response

How do you plan to make deals to your storage providers

Boost client, Lotus client

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

@large-datacap-requests
Copy link

Thanks for your request!
Everything looks good. 👌

A Governance Team member will review the information provided and contact you back pretty soon.

@herrehesse
Copy link

@caoxinhe0108

#2096

New issues need to go through PL for verification.

Per the filecoin-project/notary-governance#922 for Open, Public Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.
This information will be reviewed by Fil+ Governance team to confirm validity and then the application will be approved for notary review. Let us know if you have any questions.

@Filplus-govteam

@Sunnyiscoming
Copy link
Collaborator

  • Describe the data being stored onto Filecoin. What's the relationship between you and data?
  • Have you prepared enough token for sector pledge?
  • Are you a data preparer? What is your previous experience as a data-preparer? List previous applications and client IDs
  • How will the data be prepared? Please include tooling used and technical details
  • If you are not preparing the data, who will prepare the data? (Name and Business)
  • Has this dataset been stored on Filecoin before? If so, why are you choosing to store it again?
  • Best practice for storing large datasets includes ideally, storing it in 3 or more regions, with 4 or more storage provider operators or owners.You should list Miner ID, Business Entity, Location of sps you will cooperate with.

@caoxinhe0108
Copy link
Author

  • Describe the data being stored onto Filecoin. What's the relationship between you and data?
  • Have you prepared enough token for sector pledge?
  • Are you a data preparer? What is your previous experience as a data-preparer? List previous applications and client IDs
  • How will the data be prepared? Please include tooling used and technical details
  • If you are not preparing the data, who will prepare the data? (Name and Business)
  • Has this dataset been stored on Filecoin before? If so, why are you choosing to store it again?
  • Best practice for storing large datasets includes ideally, storing it in 3 or more regions, with 4 or more storage provider operators or owners.You should list Miner ID, Business Entity, Location of sps you will cooperate with.

1: The data is a public dataset
2: We have prepared approximately 60% of the tokens and are still seeking other collaborations
3: We have a collaborative data preparation team, and you can check the #1652 I previously applied for
4: We will download the data from AWS first,
Using the Singarate tool for packaging, it will automatically package the source data into a car file that does not exceed 64GB
The order frequency of Singarature will be controlled based on the packaging speed of each SP. In addition, all SPs need to use boost to import car files and turn on the retrieval function
5: I have checked the previously stored LDNs, and most of them have only been stored a little bit. Some have not even started yet. You can check the LDNs I previously applied for. Most of the previous ones have been completed, so I want to complete their storage
Thank you for your review
6:
f02050599, Thailand,Charlie
f02041085,Japan,TopValue
f02048990,Hong Kong,HS88
f02096851,Indonesia,EdgeIPC

@Sunnyiscoming
Copy link
Collaborator

Have you submitted the form, https://form.jotform.com/231862753015656?
Do these sps support data retrieval?

@caoxinhe0108
Copy link
Author

image Submitted Thank you

@Sunnyiscoming
Copy link
Collaborator

Please list the information of sps you will cooperate here.

@caoxinhe0108
Copy link
Author

Please list the information of sps you will cooperate here.

f02050599 Charlie Thailand
f02063409 wangkunpeg Singapore
f02041085 TopValue Japan
f02096851 EdgeIPC Indonesia
f02047843 John Japan

@Sunnyiscoming
Copy link
Collaborator

Datacap Request Trigger

Total DataCap requested

10PiB

Expected weekly DataCap usage rate

1PiB

Client address

f1ynv3f5ne5k7xxr7z5q7coro7rqpls3ilhuz3ndy

@caoxinhe0108
Copy link
Author

@Sunnyiscoming Unable to sign due to a bug, please help me fix it

@Sunnyiscoming
Copy link
Collaborator

It is still being processed.

@caoxinhe0108
Copy link
Author

@Sunnyiscoming I am in a hurry to start the project on my end. I see that the latest issues are all normal. I will open a new issue for you to issue the quota, and then close this one, Is this okay?

@caoxinhe0108
Copy link
Author

#2226

@Sunnyiscoming
Copy link
Collaborator

Datacap Request Trigger

Total DataCap requested

10PiB

Expected weekly DataCap usage rate

1PiB

Client address

f1ynv3f5ne5k7xxr7z5q7coro7rqpls3ilhuz3ndy

@large-datacap-requests
Copy link

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1ynv3f5ne5k7xxr7z5q7coro7rqpls3ilhuz3ndy

DataCap allocation requested

512TiB

Id

dbf401af-bfdc-4fbb-96f1-7b20cbc8f515

@1ane-1
Copy link

1ane-1 commented Oct 20, 2023

checker:manualTrigger

@filplus-checker-app
Copy link

DataCap and CID Checker Report1

No active deals found for this client.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

@1ane-1
Copy link

1ane-1 commented Oct 20, 2023

checker:manualTrigger

@filplus-checker-app
Copy link

DataCap and CID Checker Report1

No active deals found for this client.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

@caoxinhe0108
Copy link
Author

checker:manualTrigger

@filplus-checker-app
Copy link

DataCap and CID Checker Report Summary1

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients2

✔️ No CID sharing has been observed.

Full report

Click here to view the CID Checker report.
Click here to view the Retrieval Dashboard.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

@1ane-1
Copy link

1ane-1 commented Oct 21, 2023

Report looks good。

Copy link

1ane-1 commented Oct 21, 2023

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceaqkzrdazlbwh4eofeuq4o3d6hcbpu5xolgztnojblmmj4kolz24w

Address

f1ynv3f5ne5k7xxr7z5q7coro7rqpls3ilhuz3ndy

Datacap Allocated

512.00TiB

Signer Address

f1mdk7s2vntzm6hu35yuo6vjubtrpfnb2awhgvrri

Id

93430d2a-ff62-43d1-a727-adf36eeab4c5

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceaqkzrdazlbwh4eofeuq4o3d6hcbpu5xolgztnojblmmj4kolz24w

@BlockMakeronline
Copy link

The distribution of SP and retrieval ratio looks good. We'd like to support.

Copy link

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacea6hi4awc2yxtzw62tv7zaaoznb6wnpfivmzom3zlt7euhpjv46ci

Address

f1ynv3f5ne5k7xxr7z5q7coro7rqpls3ilhuz3ndy

Datacap Allocated

512.00TiB

Signer Address

f1o3twrcpwjtpcd4q36lpq4qmy2qfbgtyy5h6tsty

Id

93430d2a-ff62-43d1-a727-adf36eeab4c5

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea6hi4awc2yxtzw62tv7zaaoznb6wnpfivmzom3zlt7euhpjv46ci

@kevzak
Copy link
Collaborator

kevzak commented Oct 27, 2023

SPs provided upfront:
f02050599 Charlie Thailand
f02063409 wangkunpeg Singapore
f02041085 TopValue Japan
f02096851 EdgeIPC Indonesia
f02047843 John Japan

SPs taking deals:
f02812781 | Hanoi, Hanoi, VN365 Online technology joint stock company | 6.75 TiB | 11.53% | 6.75 TiB | 0.00%
f02811783 | London, England, GBHydra Communications Ltd | 6.94 TiB | 11.85% | 6.94 TiB | 0.00%
f02813403 | London, England, GBHydra Communications Ltd | 5.44 TiB | 9.28% | 5.44 TiB | 0.00%
f02828509new | Seoul, Seoul, KRKIDC Limited | 5.56 TiB | 9.50% | 5.56 TiB | 0.00%
f02824257new | Singapore, Singapore, SGOVH SAS | 7.31 TiB | 12.49% | 7.31 TiB | 0.00%
f02825197new | Manila, Metro Manila, PHZenlayer Inc | 19.81 TiB | 33.83% | 19.81 TiB | 0.00%
f02814393 | Los Angeles, California, USZenlayer Inc | 6.75 TiB | 11.53% | 6.75 TiB | 0.00%

No SPs match. closing

@kevzak kevzak closed this as completed Oct 27, 2023
@caoxinhe0108
Copy link
Author

checker:manualTrigger

@filplus-checker-app
Copy link

DataCap and CID Checker Report Summary1

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients2

✔️ No CID sharing has been observed.

Full report

Click here to view the CID Checker report.
Click here to view the Retrieval Dashboard.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

@filplus-checker-app
Copy link

DataCap and CID Checker Report Summary1

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients2

✔️ No CID sharing has been observed.

Full report

Click here to view the CID Checker report.
Click here to view the Retrieval Dashboard.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

@caoxinhe0108
Copy link
Author

SPs provided upfront: f02050599 Charlie Thailand f02063409 wangkunpeg Singapore f02041085 TopValue Japan f02096851 EdgeIPC Indonesia f02047843 John Japan

SPs taking deals: f02812781 | Hanoi, Hanoi, VN365 Online technology joint stock company | 6.75 TiB | 11.53% | 6.75 TiB | 0.00% f02811783 | London, England, GBHydra Communications Ltd | 6.94 TiB | 11.85% | 6.94 TiB | 0.00% f02813403 | London, England, GBHydra Communications Ltd | 5.44 TiB | 9.28% | 5.44 TiB | 0.00% f02828509new | Seoul, Seoul, KRKIDC Limited | 5.56 TiB | 9.50% | 5.56 TiB | 0.00% f02824257new | Singapore, Singapore, SGOVH SAS | 7.31 TiB | 12.49% | 7.31 TiB | 0.00% f02825197new | Manila, Metro Manila, PHZenlayer Inc | 19.81 TiB | 33.83% | 19.81 TiB | 0.00% f02814393 | Los Angeles, California, USZenlayer Inc | 6.75 TiB | 11.53% | 6.75 TiB | 0.00%

No SPs match. closing

@kevzak
Hello friend ! My project application was in early September. The capital had already prepared the coins and found the SP at that time. However, there was a bug in the application process and I could not sign until October 16th. We urgently contacted the SP but The communication nodes on the SP side have changed, so we replaced the new SP and started packaging around the 20th. I really didn’t know that the SP change would have such a big impact. Now that our project is running, this will suddenly suspend our project and the project will be greatly affected. I can file all SPs again and hope to restart them. If our project can continue, you can check the quality of the SP I am looking for. I strictly require them to provide retrieval and other services. I hope you can help me.

@caoxinhe0108
Copy link
Author

@kevzak

This is the current encapsulated node information. Please review it. Thank you

SP-Miner-IDs Contact-name SP-Business-Email SP-Organization-Name Region
f02813403 YuanBao [email protected] rimington Britain
f02811783 yuanbao [email protected] rimington Britain
f02814393 pythia [email protected] pythia California,USA
f02812781 TVfinance [email protected] TVfinance Vietnam
f02828509 jkkts12 [email protected] hs88 Korea
f02812304 saili [email protected] SY-Tech Singapore

@ghost
Copy link

ghost commented Nov 29, 2023

Hello -
yuanbao rimington does not exist, email bounces.
pythia never replied
will email the others now to confirm

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests