Add Wilkes Subglacial Basin dataset #112
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Adding bed elevation pick data derived from airborne radar collected during the WIlkes basin/transantarctic mountains System Exploration, Ice-house Earth: Stability Or DYNamism? (WISE/ISODYN) project. Data is downloaded in a .zip format, and will be parsed/unzipped on the fly by pandas in data_prep.ipynb to read the delimited .XYZ inside later. A new na_values field is added to the json, specifically to parse the "*" NaN values inside the WISE_ISODYN_RadarByFlight.XYZ file.
Added 19 new raster tiles from the Wilkes Subglacial Basin, increasing our training dataset from 2480 to 2499. Most of the new tiles are restricted to a limited geographic area at Talos Dome (presumably the takeoff/landing of the flight mission) as that is where we have the most crossover data for generating a high resolution grid. Note that the data_prep.py script's ascii_to_xyz function now reads a custom 'na_values' field in our json, something mentioned in 9a8c8a5.
weiji14
added a commit
that referenced
this pull request
Feb 25, 2019
Closes #112 Add Wilkes Subglacial Basin dataset.
weiji14
added a commit
that referenced
this pull request
Feb 25, 2019
Closes #112 Add Wilkes Subglacial Basin dataset.
3 tasks
weiji14
added a commit
that referenced
this pull request
Jun 21, 2019
Creating new groundtruth NetCDF grids using GMT surface, replacing the ones last created in b90bd74 in #112. Besides having updated to the GMT 6.0.0rc1 tagged release, the main change here is with using nicely rounded bounds (to 250 units in EPSG:3031) instead of arbitrary decimal points. This will really help resolve some of the problems with points not being included in our RMSE_test calculations near the grid's edges (see #152), and integer coordinates are just nicer to debug won't you say? Specifically, the data_prep.get_region was refactored to use `gmt info -I xxx.csv` instead of pure pandas, returning an `xmin/xmax/ymin/ymax` string that has an extended region optimized for `gmt surface`. There is a "surface [WARNING]: Your grid dimensions are mutually prime. Convergence is very unlikely" which I'm just gonna ignore for now. Note that data_prep.ascii_to_xyz was one-line patched to drop NaNs as there were some points in the WISE_ISODYN_RadarByFlight.XYZ file with missing elevation (z) values (since #112...) that was messing up gmt.info in the refactored data_prep.get_region. Unit tests have been modified accordingly, and the grids in the integration tests are now downloaded/created in folder /tmp to avoid messing with the actual files in highres. Matplotlib plots of the grids in data_prep.ipynb have been updated, and the new grids will be released in v0.9.2.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add in bed elevation dataset from the WIlkes basin/transantarctic mountains System Exploration, Ice-house Earth: Stability Or DYNamism? (WISE/ISODYN) project collected by Italian and British teams.
References:
TODO: