Skip to content

reduce memory required by MERRA2 data#757

Merged
climbfuji merged 4 commits into
NCAR:mainfrom
DeniseWorthen:feature/aero4
Oct 29, 2021
Merged

reduce memory required by MERRA2 data#757
climbfuji merged 4 commits into
NCAR:mainfrom
DeniseWorthen:feature/aero4

Conversation

@DeniseWorthen
Copy link
Copy Markdown
Contributor

@DeniseWorthen DeniseWorthen commented Oct 11, 2021

MERRA2 data is stored as float (r4) in the source files. When read in it is immediately promoted to double precision before being interpolated in time and space to the ATM model grid and timestep. The size of the associated (x,y,z,t,ntra) arrays in double precision causes the coupled model at C384mx025 to fail on Cheyenne.intel.

If the ingested arrays are retained as single precision until they are interpolated in aerinterpol, there is no change in model forecast file fields but all tests are able to run on Cheyenne.intel.

Associated ufs-weather-model issue #698
Required for ufs-weather-model PR #866

DeniseWorthen and others added 2 commits October 9, 2021 08:05
* switch aerin and aer_pres to r*4. time and space
bilinear interp will be done on r*4 variables and type
promotion to r*8 will occur there
Copy link
Copy Markdown
Collaborator

@climbfuji climbfuji left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @DeniseWorthen for this simple yet powerful change. If I understand you correctly, then the regression tests using MERRA2 will not change results, correct (Intel/GNU in Prod/Debug)?

@DeniseWorthen
Copy link
Copy Markdown
Contributor Author

The regression tests baselines will change, but only because I'd like to correct the diag_table used by the P7 tests to include the AOD variables at the same time. I didn't update them correctly when I committed the P7 tests. All common fields in the forecast files are B4B when I tested on hera.intel and hera.gnu.

@AnningCheng-NOAA
Copy link
Copy Markdown
Contributor

It is good to know the results are the same with improved the speed. Approved.
How much gain is it?

@DeniseWorthen
Copy link
Copy Markdown
Contributor Author

@AnningCheng-NOAA This change is not expected to impact the speed of the model.

climbfuji added a commit that referenced this pull request Oct 29, 2021
…ompson

Remove Noah-WRFv4, bug fix in Thompson MP inner loop, contains "reduce memory required by MERRA2 data" (#757)
@climbfuji climbfuji merged commit 56cb648 into NCAR:main Oct 29, 2021
JohanaRomeroAlvarez pushed a commit to JohanaRomeroAlvarez/ccpp-physics that referenced this pull request Sep 8, 2025
NCAR#757)

doxygen changes for io/module_fv3_io_def.F90 and module_fv3_config.F90

---------

Co-authored-by: Jun Wang <jun.wang@noaa.gov>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants