Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
39 commits
Select commit Hold shift + click to select a range
220f3b7
:bento: Swap out old ice-velocity products for MEaSUREs phase-based one
weiji14 Aug 16, 2019
d905cb6
:card_file_box: Split ice flow magnitude into xy velocity components
weiji14 Aug 16, 2019
9d79983
:boom: Change groundtruth Y tile size from 8km to 9km
weiji14 Aug 16, 2019
56bd53a
:twisted_rightwards_arrows: Merge branch 'enh/revise_deepbedmap' into…
weiji14 Aug 16, 2019
7cd28af
:card_file_box: Create new 9km grids without padding anymore
weiji14 Aug 16, 2019
75b7493
:building_construction: Adjust Generator model to train on 9km tiles
weiji14 Aug 19, 2019
1b717a0
:twisted_rightwards_arrows: Merge branch 'misc/measuresphasevel' into…
weiji14 Aug 19, 2019
d599ee8
:sparkles: Add topographic loss to Generator Network's loss function
weiji14 Aug 20, 2019
cbe064f
:arrow_up: Bump optuna from 0.13.0 to 0.14.0
weiji14 Aug 24, 2019
1eed349
:alembic: Hyperparameter tuning with hyperopt TPE defaults
weiji14 Aug 25, 2019
6dc6c27
:ambulance: Tweak discriminator again to follow original ESRGAN
weiji14 Aug 26, 2019
690c365
:fire: Fully deprecate selective_tile_old and gapfill_raster
weiji14 Aug 29, 2019
e7936db
:recycle: Refactor selective tile to be more exact and efficient
weiji14 Aug 30, 2019
9ec9501
:globe_with_meridians: Homemade 100m filled REMA Ice Surface Elevation
weiji14 Aug 30, 2019
79bb80a
:zap::truck: Move save_array_to_grid to data_prep, enable compression
weiji14 Aug 31, 2019
50ddb5e
:rewind::package: Get back 1km padding and 500m MEaSUREs Ice Velocity
weiji14 Aug 31, 2019
9fd2686
:ambulance: Reupload correct new X_data onto quilt
weiji14 Aug 31, 2019
51b52a8
:checkered_flag: Resample surfaced grids to pixel node registration
weiji14 Sep 2, 2019
1e7f699
:building_construction: Redesign ESRGAN to use valid padding once more
weiji14 Sep 3, 2019
d84437d
:twisted_rightwards_arrows: Merge branch 'refactor/selective_tile' in…
weiji14 Sep 3, 2019
fba406e
:zap: Always use cached test tiles instead of tiling afresh
weiji14 Sep 3, 2019
66d958b
:alien: Save model architecture as DOT graph rather than ONNX
weiji14 Sep 5, 2019
ba87043
:chart_with_upwards_trend: Record RMSE and predicted image every epoch
weiji14 Sep 6, 2019
d68f2c7
:building_construction: Back to 3km Convolutional2D, use 9px RRDB blocks
weiji14 Sep 6, 2019
e4f2f14
:twisted_rightwards_arrows: Merge branch 'master' into 'enh/revise_de…
weiji14 Sep 7, 2019
f52be2d
:zap: Prune unpromising experimental trials early using MedianPruner
weiji14 Sep 7, 2019
9194072
:white_check_mark: Fix tests failing due to missing model/weights folder
weiji14 Sep 7, 2019
6f4a6e5
:alembic: Try using Deformable Convolution in input and output layers
weiji14 Sep 9, 2019
88a364c
:alembic: Deformable Convolution in pre and post residual block layers
weiji14 Sep 9, 2019
26d6452
:heavy_plus_sign: Add ssim-chainer
weiji14 Sep 10, 2019
8fe9e03
:sparkles: Introduce Structural Loss to Generator Network's loss func…
weiji14 Sep 10, 2019
d240945
:alembic: Weight Structural Loss at 5.25x of Content Loss
weiji14 Sep 10, 2019
c15af37
:twisted_rightwards_arrows: Merge branch 'metric/ssim' into model/def…
weiji14 Sep 10, 2019
59e0122
:alembic: Tweak Generator CATS loss weightings and retune
weiji14 Sep 13, 2019
12b8eef
:building_construction: Deformable Convolution only in last two layers
weiji14 Sep 14, 2019
05c7e7c
:twisted_rightwards_arrows: Merge branch 'model/deform_conv' into enh…
weiji14 Sep 14, 2019
5a6c6a6
:camera_flash: DeepBedMap DEM v0.9.4 release candidate
weiji14 Sep 16, 2019
db6568e
:ok_hand: DeepBedMap DEM v0.9.4 release candidate 2
weiji14 Sep 18, 2019
3983751
:rocket: DeepBedMap DEM v0.9.4 stable
weiji14 Sep 21, 2019
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion Pipfile
Original file line number Diff line number Diff line change
Expand Up @@ -19,14 +19,15 @@ matplotlib = "==3.1.1"
netcdf4 = "==1.4.1"
numpy = "==1.17.0rc2"
onnx_chainer = "==1.5.0"
optuna = "==0.13.0"
optuna = "==0.14.0"
pandas = "==0.25.0"
pygmt = {editable = true, ref = "0.0.1a0-43-g421e10d", git = "https://github.com/weiji14/pygmt.git"}
quilt = "==2.9.15"
rasterio = "==1.0.24"
rtree = "==0.8.3"
salem = "==0.2.4"
scikit-image = "==0.15.0"
ssim-chainer = {editable = true,git = "https://github.com/higumachan/ssim-chainer.git"}
tqdm = "==4.32.2"

[dev-packages]
Expand Down
11 changes: 8 additions & 3 deletions Pipfile.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ Also a convenient [flat file](https://en.wikipedia.org/wiki/Flat-file_database)
[![Github Actions Build Status](https://img.shields.io/endpoint.svg?url=https%3A%2F%2Factions-badge.atrox.dev%2Fweiji14%2Fdeepbedmap%2Fbadge&style=flat)](https://github.com/weiji14/deepbedmap/actions)
[![Dependabot Status](https://api.dependabot.com/badges/status?host=github&repo=weiji14/deepbedmap)](https://dependabot.com)

![DeepBedMap DEM over entire Antarctic continent, EPSG:3031 projection](https://user-images.githubusercontent.com/23487320/60510321-6e0cb280-9ccf-11e9-8096-d2a32eb28e6c.png)
![DeepBedMap DEM over entire Antarctic continent, EPSG:3031 projection](https://user-images.githubusercontent.com/23487320/65366151-56ace800-dc74-11e9-8071-412bccf07b51.png)

![DeepBedMap Pipeline](https://yuml.me/diagram/scruffy;dir:LR/class/[Data|Highres/Lowres/Misc]->[Preprocessing|data_prep.ipynb],[Preprocessing]->[Model-Training|srgan_train.ipynb],[Model-Training]->[Inference|deepbedmap.ipynb])

Expand Down
25 changes: 6 additions & 19 deletions data_list.yml
Original file line number Diff line number Diff line change
Expand Up @@ -29,18 +29,18 @@
url: "http://data.pgc.umn.edu/elev/dem/setsm/REMA/mosaic/v1.1/200m/REMA_200m_dem_filled.tif"
sha256: f750893861a1a268c8ffe0ba7db36c933223bbf5fcbb786ecef3f052b20f9b8a
-
citekey: Rignot2011MEASURES
citekey: Mouginot2019MEASURES
folder: misc
location: Antarctica
resolution: 450m
doi:
dataset: "https://doi.org/10.5067/D7GK8F5J8M8R"
literature: "https://doi.org/10.1126/science.1208336"
dataset: "https://doi.org/10.5067/PZ3NJ5RXRH10"
literature: "https://doi.org/10.1029/2019GL083826"
files:
-
filename: MEaSUREs_IceFlowSpeed_450m.tif
url: "http://data.pgc.umn.edu/gis/packages/quantarctica/Quantarctica3/Glaciology/MEaSUREs%20Ice%20Flow%20Velocity/MEaSUREs_IceFlowSpeed_450m.tif"
sha256: 4a4efc3a84204c3d67887e8d7fa1186467b51e696451f2832ebbea3ca491c8a8
filename: antarctic_ice_vel_phase_map_v01.nc
url: "ftp://ftp.nsidc.org/pub/DATASETS/nsidc0754_MEASURES_antarctic_ice_vel_phase_map_v01/antarctic_ice_vel_phase_map_v01.nc"
sha256: fa0957618b8bd98099f4a419d7dc0e3a2c562d89e9791b4d0ed55e6017f52416
-
citekey: King2016Rutford
folder: highres
Expand Down Expand Up @@ -173,19 +173,6 @@
filename: WISE_ISODYN_RadarByFlight_ASCII.zip
url: https://ramadda.data.bas.ac.uk/repository/entry/get/WISE_ISODYN_RadarByFlight_ASCII.zip?entryid=synth%3A59e5a6f5-e67d-4a05-99af-30f656569401%3AL1dJU0VfSVNPRFlOX1JhZGFyQnlGbGlnaHRfQVNDSUkuemlw
sha256: dfb20a4ff133f361f64b5730e7593a46cb3d599ae62b0dc874685794990c8d91
-
citekey: Fahnestock2019LISA
folder: misc
location: Antarctica
resolution: 750m
doi:
dataset: "https://doi.org/10.7265/nxpc-e997"
literature: "https://doi.org/10.1016/j.rse.2015.11.023"
files:
-
filename: lisa750_2013182_2017120_0000_0400_vv_v1.tif
url: ftp://ftp.nsidc.org/pub/DATASETS/nsidc0733_landsat_ice_speed_v01/LISA750/lisa750_2013182_2017120_0000_0400_v1.tgz
sha256: 99eb934702305e2d27afa20dfc211c1d45ed762727bda29e0f251976a1877a92
-
citekey: Arthern2006Accumulation
folder: misc
Expand Down
636 changes: 323 additions & 313 deletions data_prep.ipynb

Large diffs are not rendered by default.

Loading