Urban data demonstrator notebook

[svadams]

A PR for contributing an Urban UKV gridded model data demonstrator notebook to the Environmental AI book. The notebook demonstrates:

• Using Iris to load, visualise and regrid Met Office UKV NetCDF data
• Using Iris to extract the London region and save as a new NetCDF file

Notes:

• The data is freely available (link in notebook). For convenience, I have included a sample data daily data file as it is not too big.
• I have added Iris to the environment.yml file as it takes along time to install - I also think it is generally useful for many use-cases so if we can have it as a standard package it would be good :-)

See Iris docs here: https://scitools-iris.readthedocs.io/en/stable/installing.html

[acocac]

It's ok to fetch local data but where possible we should show how to fetch from remote URLs. I've tried the lines below but it returns a corrupted file.

base_path = "https://metdatasa.blob.core.windows.net/covid19-response-non-commercial/index.html#metoffice_ukv_daily--t1o5m_mean/"
url= base_path + "ukv_daily_t1o5m_mean_20150801.nc"
filename = url.split('/')[-1]

with fsspec.open(url) as f:

  with Path(filename).open('wb') as handle:

    handle.write(f.read())

Reply via ReviewNB

[svadams]

Sorry I don't have much experience with doing this kind of thing. Might be worth trying this link - https://metdatasa.blob.core.windows.net/covid19-response-non-commercial/metoffice_ukv_daily/t1o5m_mean/ukv_daily_t1o5m_mean_20150801.nc

[svadams]

I believe I have found a compromise by using urllib to retrieve the netcdf file into the sample_data directory, i.e:

filepath = 'https://metdatasa.blob.core.windows.net/covid19-response-non-commercial/metoffice_ukv_daily/t1o5m_mean/'
filename = 'ukv_daily_t1o5m_mean_20150801.nc'
urllib.request.urlretrieve(filepath+filename, '../sample_data/' + filename)

I think there are other ways of doing this (e.g. curl or wget), but does assume they are installed on the users system. At least using urllib we can specify it as a dependency in the environment.yml

[acocac]

excellent! urllib request is a nice one.

[acocac]

Awesome!

Reply via ReviewNB

[acocac]

@svadams Thanks for the contribution. I left some suggestions. Be free to explore them in ReviewNB.
ps. sorry for the late review but I was moving to the UK last week (now in a quarantine hotel).

[review-notebook-app]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB

[svadams]

@acocac - I made some improvements following your suggestions - can you please take another look when you have time :-)

[acocac]

@svadams, thanks for the improvements, LGTM!
Regarding the notes markdown, most of Jupyter Book’s functionality comes from Sphinx extensions. This means if you want to see this particular markdown for a given ipynb file, you'll need to install the Sphinx plugin in your python interpreter.