-
Notifications
You must be signed in to change notification settings - Fork 18
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
GHCN Subset: Daily/all #333
Comments
I have a copy of this dataset hashes coming soon |
Slow download, stalls often. 11 GB in 18 hours. Will provide short term public mirror when done. |
http://[2a03:b0c0:2:d0::1dae:1001]/ftp.ncdc.noaa.gov-pub-data-ghcn-daily-all.tar.gz Compresses very well, so only offering in compressed form. 26 GB raw, 2.9 GB compressed. Will stay online until the 1 TB transfer limit is reached (this should allow for 75+ more full mirrors), or a month has passed, whichever comes first. |
@Juerd Do you have any hash and file size results for comparison? |
I have a complete copy as of this posting. md5: Individual md5 checksums: https://gist.github.com/x775/e5da487abd157032952a97835aa2b12e Size: 25.09811GB Compressed name: GHCN_Subset_Daily_all.7z |
Downloading this since last night, been going for over 12 hours and only done 4.5GB (100/40 connection). Working on a server to put all this stuff on, will keep you all posted. |
It did take a very long time to download for me as well. |
@x775 Good to know, thanks! out of interest what are you using to get such precise size measurements? I'm just using "du -sh" at the moment |
Got it finally Checksums: https://gateway.ipfs.io/ipfs/QmUbBhENtU4MAVftvK59FxnMv1L7S2HrvuPJKrXQKXEC7o |
This dataset is a part of a giant dataset of The Global Historical Climatology Network (GHCN) #331.
We needed to break that one up into parts.
Recommended command:
wget -N -m ftp://ftp.ncdc.noaa.gov/pub/data/ghcn/daily/all/*
Once you are done:
Recommended command:
hashdeep -erl
du -b --max-depth=1 --human-readable
orls -l
The text was updated successfully, but these errors were encountered: