Skip to content

Conversation

@diegokam
Copy link
Contributor

@diegokam diegokam commented Sep 24, 2024

Description

This PR extends the capabilities of this branch by allowing to download and format daily and monthly ESA CCI Cloud data.
The ESA CCI Cloud website is: ESA CCI Cloud
- Daily Data can be found here.
- Monthly Data can be found here


Before you get started

Checklist

It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the 🛠 Technical or 🧪 Scientific review.

New or updated data reformatting script


To help with the number of pull requests:

@diegokam diegokam self-assigned this Sep 24, 2024
@diegokam diegokam changed the title Update ESACCI Cloud CMORizer (monthly data) Update ESACCI Cloud CMORizer (daILYmonthly data) Dec 13, 2024
@diegokam diegokam changed the title Update ESACCI Cloud CMORizer (daILYmonthly data) Update ESACCI Cloud CMORizer (daily and monthly data) Dec 13, 2024
@LisaBock LisaBock force-pushed the update_esacci_cloud_monthly branch from 9a8f59b to 7c8eed7 Compare December 17, 2024 16:08
@LisaBock
Copy link
Member

LisaBock commented Jul 8, 2025

@axel-lauer and @schlunma I hopefully addressed all your comments and tested it again. Works fine for me.

Could you have another check on it? Thanks.

@schlunma
Copy link
Contributor

schlunma commented Jul 8, 2025

Thanks for addressing my comments @LisaBock ! Looks great already, I only have a couple of minor comments left. I think this is almost ready 👍

@LisaBock
Copy link
Member

LisaBock commented Jul 8, 2025

Thanks for addressing my comments @LisaBock ! Looks great already, I only have a couple of minor comments left. I think this is almost ready 👍

Thanks again @schlunma ! I tried to address all new comments.

The only issue is the switch for downloading and cmorizing daily data. Is there another possibility for adding a switch for the download of daily data?The amount of daily data is so huge that I don't think we should have it as default.

Copy link
Contributor

@schlunma schlunma left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks so much Lisa! Approving this from a technical point of view 🚀 I have not run the CMORizer again.

The only issue is the switch for downloading and cmorizing daily data. Is there another possibility for adding a switch for the download of daily data?The amount of daily data is so huge that I don't think we should have it as default.

As I already mentioned in the comment above, there's currently no simple way to achieve this, so I guess it's fine like this.

Thanks!!

Copy link
Contributor

@axel-lauer axel-lauer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks very good and is almost ready to be merged. I suggest to also add the AM and PM datasets to recipe_check_obs.yml (please see suggested changes).
There seems to be, however, a problem with the monthly mean PM dataset. When using the dataset in a recipe (e.g. recipe_check_obs.yml), I get the following error message:

time: Frequency mon does not match input data

I suspect this might be caused by some month missing in the dataset and would need to be checked before merging the PR.

@LisaBock
Copy link
Member

Thanks @axel-lauer for reviewing!
I now updated the recipe_check_obs.yml file to be able to test all datasets (AM, PM and AMPM). Thanks for spotting!

I also added a function to the formatter for filling in missing months. I had that already, but it got lost somehow in the process. for me, the tests worked fine.

Copy link
Contributor

@axel-lauer axel-lauer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks all good now. Thank you @LisaBock

@schlunma schlunma merged commit 1514a1d into main Jul 18, 2025
7 of 8 checks passed
@schlunma schlunma deleted the update_esacci_cloud_monthly branch July 18, 2025 09:30
@axel-lauer axel-lauer mentioned this pull request Jul 25, 2025
11 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants