Skip to content

Update Hera and Orion modulefiles to use hpc-stack libs#193

Merged
DusanJovic-NOAA merged 18 commits into
ufs-community:developfrom
DusanJovic-NOAA:hpc-stack
Sep 21, 2020
Merged

Update Hera and Orion modulefiles to use hpc-stack libs#193
DusanJovic-NOAA merged 18 commits into
ufs-community:developfrom
DusanJovic-NOAA:hpc-stack

Conversation

@DusanJovic-NOAA
Copy link
Copy Markdown
Collaborator

@DusanJovic-NOAA DusanJovic-NOAA commented Aug 28, 2020

Description

Update Hera(Intel), Orion and WCOSS Dell modulefiles to use hpc-stack libs
New baselines required on Hera (Intel), Orion and WCOSS Dell.

Testing

Regression tests performed on Hera, Orion and WCOSS Dell against new baselines. Hera (GNU) and WCOSS Cray baselines are identical with the previous commits.

Dependencies

N/A

@junwang-noaa
Copy link
Copy Markdown
Collaborator

When will we have the hpc-stack on wcoss too? Or we just keep the current module files on wcoss?

@climbfuji
Copy link
Copy Markdown
Collaborator

Can we combine this PR with my PR #191? Seems to make sense to me.

@DusanJovic-NOAA
Copy link
Copy Markdown
Collaborator Author

DusanJovic-NOAA commented Aug 28, 2020

I don't know. We should ask NCEPLIBS group. As you can see in one of my commits in this PR (1ab5914) I actually tested it on WCOSS Dell using my hpc-stack build. But that's not 'official' build.

@DusanJovic-NOAA
Copy link
Copy Markdown
Collaborator Author

Can we combine this PR with my PR #191? Seems to make sense to me.

Sure.

@climbfuji
Copy link
Copy Markdown
Collaborator

Can we combine this PR with my PR #191? Seems to make sense to me.

Sure.

Great. Then I suggest that I pull in your PR and that we try to make this change today after Clara's code is merged. I can then update the CCPP tendencies PR over the weekend (should be little work) so that we will be ready to roll on Monday.

Copy link
Copy Markdown
Collaborator

@junwang-noaa junwang-noaa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The code changes look good to me, but I'd hope we test the same module file in s2s and confirm the same module files work for both before we do the commit

@climbfuji
Copy link
Copy Markdown
Collaborator

climbfuji commented Aug 28, 2020 via email

@DusanJovic-NOAA
Copy link
Copy Markdown
Collaborator Author

Difference (24h lowest layer temperature) between this commit and the previous one are on the order of magnitude as the difference between the butterfly test run and the control run of the previous commit:

d_output1

d_output2

@junwang-noaa
Copy link
Copy Markdown
Collaborator

Using hpc-stack library, following RT tests show differences while others are not:

fv3_cpt_ccpp
fv3_csawmg_ccpp
fv3_gfsv16_csawmg_ccpp
fv3_gfsv16_csawmgt_ccpp
fv3_gsd_ccpp
fv3_gsd_debug_ccpp
fv3_gsd_diag3d_debug_ccpp
fv3_hrrr_ccpp
fv3_rap_ccpp
fv3_rrfs_v1beta_ccpp
fv3_rrfs_v1beta_debug_ccpp

Taking fv3_csawmg_ccpp test as an example, butterfly test was conducted, the results are at
develop branch : /scratch1/NCEPDEV/nems/emc.nemspara/RT/NEMSfv3gfs/develop-20200917/INTEL/fv3_csawmg_ccpp
dev+butterfly: /scratch1/NCEPDEV/stmp2/Dusan.Jovic/FV3_RT/rt_88545/fv3_ccpp_csawmg_prod/dynf024.nemsio
hpc-stack branch: /scratch1/NCEPDEV/nems/emc.nemspara/RT/NEMSfv3gfs/develop-20200918/INTEL/fv3_csawmg_ccpp

Looking at the tmpsfc field in the phyf025.nemsio files in the above three directory:
dev: tmpsfc
butterfly: tmpsfc.2
stack: tmpsfc.3

From grads, the max/min difference of (tmpsfc-tmpsfc.2) is 8 and -8, the average of (tmpsfc-tmpsfc.2) is 0.00210166, the std is 0.27809.
From grads, the max/min difference of (tmpsfc-tmpsfc.3) is 8 and -6. the average of (tmpsfc-tmpsfc.2) is 0.000960768, the std is 0.250452

From the results the change from hpc-stack is comparable to that from butterfly test. While Dom is debugging the code that causes the difference, if he finds anything that needs to be fixes, he will submit a separate PR. With the results, we will commit the code.

@DusanJovic-NOAA DusanJovic-NOAA merged commit b8c5c22 into ufs-community:develop Sep 21, 2020
@DusanJovic-NOAA DusanJovic-NOAA deleted the hpc-stack branch September 21, 2020 21:58
pjpegion pushed a commit to NOAA-PSL/ufs-weather-model.p7b that referenced this pull request Jul 20, 2021
* New metadata for GP scheme.
* Removed redundant importing of kind_phys
* add units to index_for_diagnostic_printout metadata
* Bugfix in GP sampling routines.
epic-cicd-jenkins pushed a commit that referenced this pull request Apr 17, 2023
…tic (#193)

* Update hash of ufs weather model

* Update hash of regional workflow
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants