Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DataCap Application] LAMOST DR7 #41

Open
1 of 2 tasks
ssnks1 opened this issue Jul 9, 2024 · 111 comments
Open
1 of 2 tasks

[DataCap Application] LAMOST DR7 #41

ssnks1 opened this issue Jul 9, 2024 · 111 comments
Assignees

Comments

@ssnks1
Copy link

ssnks1 commented Jul 9, 2024

Version

1

DataCap Applicant

ssnks1

Project ID

1

Data Owner Name

LAMOST DR7

Data Owner Country/Region

United States

Data Owner Industry

Life Science / Healthcare

Website

http://www.lamost.org/dr7/v2.0/

Social Media Handle

http://www.lamost.org/dr7/v2.0/

Social Media Type

Slack

What is your role related to the dataset

Data Preparer

Total amount of DataCap being requested

8PiB

Expected size of single dataset (one copy)

1024TiB

Number of replicas to store

8

Weekly allocation of DataCap requested

512TiB

On-chain address for first allocation

f1jctjr7yb6exwheiizud2darc3xa427vbzrtxrai

Data Type of Application

Public, Open Dataset (Research/Non-Profit)

Custom multisig

  • Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

Dear allocator, Filecoin Foundation and PL, I am a Filecoin enthusiast and technology geek. I do not belong to any company, but I have been working on the Filecoin network for two years. We are familiar with Filecoin technical principles and technical architecture, and are familiar with data storage and maintenance. With various major processes and DC experience, we are already downloading the data of LAMOST DR7.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

Observed Plates:4,922 Total Spectra:10,431,197

Guoshoujing Telescope (the Large Sky Area Multi-Object Fiber Spectroscopic Telescope LAMOST) is a National Major Scientific Project built by the Chinese Academy of Sciences. Funding for the project has been provided by the National Development and Reform Commission. LAMOST is operated and managed by the National Astronomical Observatories, Chinese Academy of Sciences.

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

No response

If you are a data preparer. What is your location (Country/Region)

China

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?

No response

If you are not preparing the data, who will prepare the data? (Provide name and business)

No response

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.

No response

Please share a sample of the data

http://www.lamost.org/dr7/v2.0/

Confirm that this is a public dataset that can be retrieved by anyone on the Network

  • I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Yearly

For how long do you plan to keep this dataset stored on Filecoin

2 to 3 years

In which geographies do you plan on making storage deals

Greater China, North America, Europe

How will you be distributing your data to storage providers

Cloud storage (i.e. S3), Shipping hard drives, Lotus built-in data transfer

How did you find your storage providers

Slack, Partners

If you answered "Others" in the previous question, what is the tool or platform you used

No response

Please list the provider IDs and location of the storage providers you will be working with.

f03174685   Shanghai
f01926635	Sichuan
f0315790    Guangdong
f03068013  Hong Kong
f03035686  Guangdong
f03157910  Guangdong
f01999119  Sichuan 
f03162991	Hong Kong

How do you plan to make deals to your storage providers

Boost client, Lotus client, Bidbot

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

Copy link
Contributor

datacap-bot bot commented Jul 9, 2024

Application is waiting for allocator review

@nicelove666
Copy link
Owner

Thank you for your application, please fill in https://github.com/nicelove666/IPFSTT-Client-Due-Diligence-Form/issues/new/choose.

Our main focus is:

You need to provide comprehensive SP information, including SP, geographical location, and company name.
Why do you want to put the data on Filecoin? Do you have relevant data processing experience?
Can you confirm Spark retrievals for these miner IDs?

@nicelove666
Copy link
Owner

Any updates here?

@ssnks1
Copy link
Author

ssnks1 commented Jul 18, 2024

We have filled out https://github.com/nicelove666/IPFSTT-Client-Due-Diligence-Form/issues/new/choose.
This is the sp we cooperate with,
f03068013-HK
f03035686-GuangDong
f01926635-SiChuang
f01999119-SiChuang
We are already preparing to download this data.
We require SP to search based on Spark code matching and support Spark

Copy link
Contributor

datacap-bot bot commented Jul 21, 2024

Datacap Request Trigger

Total DataCap requested

10PiB

Expected weekly DataCap usage rate

512TiB

DataCap Amount - First Tranche

256TiB

Client address

f1jctjr7yb6exwheiizud2darc3xa427vbzrtxrai

Copy link
Contributor

datacap-bot bot commented Jul 21, 2024

DataCap Allocation requested

Multisig Notary address

Client address

f1jctjr7yb6exwheiizud2darc3xa427vbzrtxrai

DataCap allocation requested

256TiB

Id

33fa3777-1bca-45e3-ad6e-ea20210d1aff

Copy link
Contributor

datacap-bot bot commented Jul 21, 2024

Application is ready to sign

Copy link
Contributor

datacap-bot bot commented Jul 23, 2024

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceaptps3ipcjvaubuegwfkiy5sgyjyazpop3i5hoiigzyhc5k4oejm

Address

f1jctjr7yb6exwheiizud2darc3xa427vbzrtxrai

Datacap Allocated

256TiB

Signer Address

f16hmuu3w247dkkhsrbbcbeqbugmpjbxpkrpcdatq

Id

33fa3777-1bca-45e3-ad6e-ea20210d1aff

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceaptps3ipcjvaubuegwfkiy5sgyjyazpop3i5hoiigzyhc5k4oejm

Copy link
Contributor

datacap-bot bot commented Jul 23, 2024

Application is Granted

@nicelove666
Copy link
Owner

checker:manualTrigger

Copy link
Contributor

datacap-bot bot commented Jul 31, 2024

DataCap and CID Checker Report1

No active deals found for this client.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

@nicelove666
Copy link
Owner

Any updates here?

Copy link
Contributor

datacap-bot bot commented Jul 31, 2024

Client used 75% of the allocated DataCap. Consider allocating next tranche.

@nicelove666
Copy link
Owner

checker:manualTrigger

Copy link
Contributor

datacap-bot bot commented Aug 1, 2024

DataCap and CID Checker Report1

No active deals found for this client.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

@ssnks1
Copy link
Author

ssnks1 commented Aug 1, 2024

Sorry for the delayed response.

We have used up the 256T of DC that you provided in the first round, and we hope you can bring down the next round for us.

It's possible that the data delay caused us to miss the check on the data.

I noticed that other LDNs in the first round also did not check the data, but were still able to get approval.

So, can you help us with this?

Copy link
Contributor

datacap-bot bot commented Aug 1, 2024

Application is in Refill

@ssnks1
Copy link
Author

ssnks1 commented Nov 4, 2024

It would be great if we could continue to get support, we working on Filecoin for over three years and our data is all ready

@ssnks1
Copy link
Author

ssnks1 commented Nov 4, 2024

We've been waiting too long and we're actively looking for new datasets, but we hope you'll support us now. We have also applied on other allocators, but it seems that all of them have suspended support. What is the reason for this and is there anything I need to do?

@ssnks1
Copy link
Author

ssnks1 commented Nov 4, 2024

We use our own developed technology. As a versatile engineer, I developed the data download software and continually improve it. There is a strict monitoring and alarm system in place for issues like CID sharing, duplicate data, and unreasonable data backups.Additionally, many of our partner clients borrow FIL from Haven and ND, and they are bearing too much interest.we hope you can support us.We have really been waiting too long.

Copy link
Contributor

datacap-bot bot commented Nov 4, 2024

Application is in Refill

Copy link
Contributor

datacap-bot bot commented Nov 4, 2024

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebjovxszs7ctr3fnovgv77jmby5uemxjcfz45avicw4ehpkalnnla

Address

f1jctjr7yb6exwheiizud2darc3xa427vbzrtxrai

Datacap Allocated

760TiB

Signer Address

f16hmuu3w247dkkhsrbbcbeqbugmpjbxpkrpcdatq

Id

14b4721e-8ee7-46b5-99f8-78b4c6d55702

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebjovxszs7ctr3fnovgv77jmby5uemxjcfz45avicw4ehpkalnnla

@datacap-bot datacap-bot bot added granted and removed Refill labels Nov 4, 2024
Copy link
Contributor

datacap-bot bot commented Nov 4, 2024

Application is Granted

Copy link
Contributor

datacap-bot bot commented Nov 10, 2024

Client used 75% of the allocated DataCap. Consider allocating next tranche.

@ssnks1
Copy link
Author

ssnks1 commented Nov 15, 2024

checker:manualTrigger

Copy link
Contributor

datacap-bot bot commented Nov 15, 2024

DataCap and CID Checker Report Summary1

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

⚠️ 7.14% of Storage Providers have retrieval success rate equal to zero.

⚠️ 64.29% of Storage Providers have retrieval success rate less than 75%.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients2

✔️ No CID sharing has been observed.

Full report

Click here to view the CID Checker report.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

@ssnks1
Copy link
Author

ssnks1 commented Nov 15, 2024

Can we continue to receive support? We have found a new dataset. Do we need to reapply? there have been some changes about the SPs we cooperate with, we have added some new SPs. Thank you.

f03174685 Zhejiang
f0122215 Qingdao
f01926635 Chengdu
f03157905 Guangdong
f03157910 Guangdong
f03035686 Guangdong
f01999119 Chengdu
f03142258 Guangdong
f03162991 Hong Kong
f03231154 Hong Kong
f03220176 Hong Kong
f03228906 Beijing
f03068013 Hong Kong
f01025366 Qingdao

@ssnks1
Copy link
Author

ssnks1 commented Nov 15, 2024

We want to know how we can continue to receive support

Copy link
Contributor

datacap-bot bot commented Nov 21, 2024

Application is in Refill

Copy link
Contributor

datacap-bot bot commented Nov 21, 2024

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecfyz6tvmsspp6bqfqlidzxpontddlu7y7fl2rx7or7gu7gqj2lpg

Address

f1jctjr7yb6exwheiizud2darc3xa427vbzrtxrai

Datacap Allocated

1PiB

Signer Address

f16hmuu3w247dkkhsrbbcbeqbugmpjbxpkrpcdatq

Id

a8f6f43f-5c7b-45b3-b1de-6896a6c015f3

You can check the status here https://filfox.info/en/message/bafy2bzacecfyz6tvmsspp6bqfqlidzxpontddlu7y7fl2rx7or7gu7gqj2lpg

Copy link
Contributor

datacap-bot bot commented Nov 21, 2024

Application is Granted

@datacap-bot datacap-bot bot added granted and removed Refill labels Nov 21, 2024
@nicelove666
Copy link
Owner

Can we continue to receive support? We have found a new dataset. Do we need to reapply? there have been some changes about the SPs we cooperate with, we have added some new SPs. Thank you.

f03174685 Zhejiang f0122215 Qingdao f01926635 Chengdu f03157905 Guangdong f03157910 Guangdong f03035686 Guangdong f01999119 Chengdu f03142258 Guangdong f03162991 Hong Kong f03231154 Hong Kong f03220176 Hong Kong f03228906 Beijing f03068013 Hong Kong f01025366 Qingdao

Based on suggestion from the governance team, we will focus on supporting old cilents.
If you have the ability to find new data sets, please continue to apply.

Copy link
Contributor

datacap-bot bot commented Dec 20, 2024

Client used 75% of the allocated DataCap. Consider allocating next tranche.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants