Skip to content

New GFS/FV3 model background files (C12) containing all hydrometeors and corresponding AMSU-A (n19) observation file#60

Merged
fmahebert merged 7 commits intodevelopfrom
feature/fix_effective_radii
Mar 7, 2023
Merged

New GFS/FV3 model background files (C12) containing all hydrometeors and corresponding AMSU-A (n19) observation file#60
fmahebert merged 7 commits intodevelopfrom
feature/fix_effective_radii

Conversation

@gthompsnJCSDA
Copy link
Contributor

Description

To provide for more thorough testing of code that calculates effective radii, we need GFS/FV3 background files with all hydrometeors (rain, snow, graupel, cloud water, and cloud ice) found in the "tracer" file. Also, we can use a AMSU-A (NOAA-19) observation file that has been stripped down to channels 1-5, 15 which are the most sensitive to the presence of cloud and precipitation. The new AMSU-A file contains only those 6 channels and was subsetted in Location dimension by striding every 35 points out of its original 81000 points, making the final vector length 2315.

Issue(s) addressed

See the related one in UFO
UFO 2631

Acceptance Criteria (Definition of Done)

Positive reviews

Dependencies

Coordinate together with fv3-jedi PR 764

Impact

None expected.

@gthompsnJCSDA gthompsnJCSDA added the OBS OBS processing, UFO label Feb 20, 2023
@climbfuji
Copy link
Contributor

climbfuji commented Feb 21, 2023

@cmgas I think those might files overlap with what I gave you. @gthompsnJCSDA are these warm start files (it looks like to me), and if yes, what is the cold start date and what are the physics options used?

Copy link
Collaborator

@danholdaway danholdaway left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good idea to reflect what is in these files in practice.

@gthompsnJCSDA
Copy link
Contributor Author

@cmgas I think those might files overlap with what I gave you. @gthompsnJCSDA are these warm start files (it looks like to me), and if yes, what is the cold start date and what are the physics options used?

@cmgas @climbfuji Yes I copied something from r2d2 archive on Orion and I am attempting to reduce it data volume from 81000(Location) x 15(Channel) down to 2315x6 so it occupies less space. I am having massive struggles with the decimated obs file working in my CI-tests for the corresponding PR in fv3-jedi due to issues with _FillValue. Hopefully I can fix that problem quickly.

@cmgas
Copy link
Collaborator

cmgas commented Feb 22, 2023

@gthompsnJCSDA how did you produce these gfs files?
Some of it overlaps yes, @climbfuji but these wouldn't be sufficient to run UFS.

@gthompsnJCSDA
Copy link
Contributor Author

@gthompsnJCSDA how did you produce these gfs files? Some of it overlaps yes, @climbfuji but these wouldn't be sufficient to run UFS.

They were in either your directory or the main r2d2 archive directory (on Orion) that Fabio sent to me. If you want, I can run FV3-GFS (prototype v16) simulation at C768L127 for you. I have run it multiple times myself.

Copy link
Collaborator

@cmgas cmgas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@gthompsnJCSDA we will likely change all the backgrounds later to have one date with all existing variables (will help future development).
In the meantime though we are making an effort to get rid of all colons in names, can you name these files so they are consistent with other fv3-jedi-data background files?

@fmahebert fmahebert merged commit 7fbbdfa into develop Mar 7, 2023
@fmahebert fmahebert deleted the feature/fix_effective_radii branch March 7, 2023 18:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

OBS OBS processing, UFO

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants