Release/public v2 gaea update#352
Merged
natalie-perlin merged 4 commits intoSep 28, 2022
Merged
Conversation
…epic account Add initialization of the Lmod installed on Gaea under the role.epic account, and maintained by EPIC, in /lustre/f2/dev/role.epic/contrib/ space
…pic account Added initialization of the Lmod installed on Gaea under the role.epic account, and maintained by EPIC, in /lustre/f2/dev/role.epic/contrib/ space
Updated paths for the modules needed to build the SRW, build following the update of the Lmod/8.7.12. All of the packages were installed under role.epic account in /lustre/f2/dev/role.epic/contrib/ space.
Updated paths for the modules needed to run the workflow for the SRW, build following the update of the Lmod/8.7.12. All of the packages were installed under role.epic account in /lustre/f2/dev/role.epic/contrib/ space.
37 tasks
Collaborator
|
@natalie-perlin I am able to checkout regional workflow with manage_externals and build your PR on gaea applying it to |
danielabdi-noaa
approved these changes
Sep 22, 2022
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
DESCRIPTION OF CHANGES:
Changes to this SRW release/public-v2 branch are specific to Gaea, and reflect the recent updates to the Lmod/8.7.12, miniconda3/4.12.0, and the hpc-stack modules built with the updated Lmod and miniconda. All these packages and the module manager have been installed under the role.epic account, maintained by EPIC, and in a following common space on Gaea:
/lustre/f2/dev/wpo/role.epic/contrib/
(also linked as /lustre/f2/dev/role.epic/contrib/)
These updates were found to be needed to address missing python packages in existing regional_workflow conda environments, when python plotting routines were used to generate basic plots of the model results.
The changes are related to Gaea only, and their sole purpose is to initialize Lmod properly (which is not installed system-wide on Gaea), and update the paths of the modules.
The files in the SRW repo that were updated, under the ./ufs-srweather-app/ main directory:
./etc/lmod-setup.sh, lmod_setup.csh
./modulefiles/build_gaea_intel
./modulefiles/wflow_gaea
Running the SRW also requred corresponding updates to the regional_workflow repository (yet unmerged, release/public-v2 branch), for which the PR-380 has been created in that repository:
PR-380
Type of change
TESTS CONDUCTED:
The test has been done on Gaea, to build the SRW and to run a workflow using rocoto and crontab, or the following test case from the comprehensive tests suite:
grid_RRFS_CONUScompact_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16.
Because of the dependency of the PR-380 in the regional_workflow repo, temporary modifications to the Externals.cfs in the tested code have been made to use the following regional_workflow repository and branch:
The test intended to provide the concept of loading the new Lmod, modules and packages properly, building the SRW code, and a functional workflow that launches and successfully completes the test.
Location of the test code built and launched on Gaea, under EPIC account:
/lustre/f2/dev/wpo/role.epic/sandbox/SRW/ufs-srw-pub-v2-update/
A corresponding test directory on Gaea is the following:
/lustre/f2/dev/wpo/role.epic/sandbox/SRW/expt_dirs/grid_RRFS_CONUScompact_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16
expt_dirs/grid_RRFS_CONUScompact_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16
DEPENDENCIES:
ISSUE:
CHECKLIST
LABELS (optional):
A Code Manager needs to add the following labels to this PR:
CONTRIBUTORS (optional):