Skip to content

Update post and regional_workflow hashes, QOL improvements#167

Merged
JulieSchramm merged 5 commits into
ufs-community:developfrom
mkavulich:feature/update_post_hash+QOL_changes
Aug 31, 2021
Merged

Update post and regional_workflow hashes, QOL improvements#167
JulieSchramm merged 5 commits into
ufs-community:developfrom
mkavulich:feature/update_post_hash+QOL_changes

Conversation

@mkavulich
Copy link
Copy Markdown
Collaborator

@mkavulich mkavulich commented Aug 26, 2021

DESCRIPTION OF CHANGES:

EMC_post builds are currently failing on Hera due to an update to NCEPLIBS. While that is annoying, we also discovered that the App's EMC_post hash is from December 2020...way out of date! Updating to the latest hash fixes the build issue. In addition, regional_workflow must be updated and an additional PR must be applied (https://github.com/NOAA-EMC/regional_workflow/pull/581) in order to accommodate the new executable and filenames for the newer EMC_post hash.

In addition, some long-overdue quality-of-life improvements are added:

  • Including the "BUILD_ALWAYS" flag in CMakelists.txt; this will cause code to be properly rebuilt by cmake after making changes (already in the release branch from PR Updating the behavior of cmake to rebuild using changes to source code; fix devbuild.sh #91)
  • Adding "module load rocoto" to the Hera workflow environment file. Rocoto is not loaded by default and can be unloaded by the build environment, so adding this here (as it already exists for Cheyenne and Orion) makes sense.

TESTS CONDUCTED:

Cheyenne

  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_2017_gfdlmp
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_2017_gfdlmp_regional
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GSD_SAR
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_RAP_suite_HRRR
  • grid_RRFS_CONUS_25km_ics_GSMGFS_lbcs_GSMGFS_suite_GFS_2017_gfdlmp
  • grid_RRFS_CONUS_25km_ics_GSMGFS_lbcs_GSMGFS_suite_GFS_v15p2
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_HRRR_suite_GSD_SAR
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_HRRR_suite_HRRR
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_HRRR_suite_RRFS_v1beta
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_RAP_suite_GSD_SAR
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_RAP_suite_GSD_v0
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_RAP_suite_HRRR
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_RAP_suite_RRFS_v1alpha
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_RAP_suite_RRFS_v1beta

Hera

  • grid_CONUS_25km_GFDLgrid_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16
  • grid_RRFS_AK_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16
  • grid_RRFS_AK_3km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16
  • grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2
  • grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_2017_gfdlmp
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_2017_gfdlmp_regional
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GSD_SAR
  • grid_RRFS_NA_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GSD_v0
  • grid_RRFS_SUBCONUS_3km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16

DEPENDENCIES:

Copy link
Copy Markdown
Collaborator

@jwolff-ncar jwolff-ncar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Couple of questions on the regional_workflow fork/branch set in this PR.

Comment thread Externals.cfg Outdated
Comment thread Externals.cfg Outdated
@mkavulich
Copy link
Copy Markdown
Collaborator Author

Ran a number of tests on Cheyenne. The following WE2E tests passed:

  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_2017_gfdlmp
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_2017_gfdlmp_regional
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GSD_SAR
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_RAP_suite_HRRR
  • grid_RRFS_CONUS_25km_ics_GSMGFS_lbcs_GSMGFS_suite_GFS_2017_gfdlmp
  • grid_RRFS_CONUS_25km_ics_GSMGFS_lbcs_GSMGFS_suite_GFS_v15p2
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_HRRR_suite_GSD_SAR
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_HRRR_suite_HRRR
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_HRRR_suite_RRFS_v1beta
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_RAP_suite_GSD_SAR
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_RAP_suite_GSD_v0
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_RAP_suite_HRRR
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_RAP_suite_RRFS_v1alpha
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_RAP_suite_RRFS_v1beta

@mkavulich
Copy link
Copy Markdown
Collaborator Author

mkavulich commented Aug 30, 2021

Ran another set of tests on Hera, all succeeded that were expected to (there are known failures in the testing system right now due to data being shuffled around). The following WE2E tests passed:

  • grid_CONUS_25km_GFDLgrid_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16
  • grid_RRFS_AK_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16
  • grid_RRFS_AK_3km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16
  • grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2
  • grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_2017_gfdlmp
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_2017_gfdlmp_regional
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GSD_SAR
  • grid_RRFS_NA_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GSD_v0
  • grid_RRFS_SUBCONUS_3km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16

On Jet, I was not able to run any tests, as the old testing data has all been moved. I did build the code successfully.

@mkavulich mkavulich marked this pull request as ready for review August 30, 2021 14:56
@mkavulich mkavulich requested a review from jwolff-ncar August 30, 2021 14:56
@gsketefian
Copy link
Copy Markdown
Collaborator

@mkavulich Can you elaborate on what the BUILD_ALWAYS flag does? What is the undesired behavior that this fixes? Thanks.

@mkavulich
Copy link
Copy Markdown
Collaborator Author

@gsketefian The BUILD_ALWAYS flag ensures that when making changes to the source code in src/ and rebuilding, cmake will recognize that changes were made and make will rebuild with those changes as expected. This change was made in the release branch (#91) but never made it into develop.

Copy link
Copy Markdown

@JulieSchramm JulieSchramm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good.

Copy link
Copy Markdown
Collaborator

@gsketefian gsketefian left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good.

@JulieSchramm JulieSchramm merged commit 8db444d into ufs-community:develop Aug 31, 2021
shoyokota pushed a commit to shoyokota/ufs-srweather-app that referenced this pull request Jul 15, 2022
* Fix externals reference for GSI in Externals.cfg

The ncdiag was removed from GSI and replaced by a
submodule. This requires the GSI to be checked out
with the ncdiag submodule, which requires addition
of a separate Externals_gsi.cfg file to specify which
GSI submodules are needed.

* Add newline to last line of Externals_gsi.cfg
@mkavulich mkavulich deleted the feature/update_post_hash+QOL_changes branch September 13, 2023 14:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants