-
Notifications
You must be signed in to change notification settings - Fork 50
Add automated CI testing on Hera #14
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from 23 commits
Commits
Show all changes
27 commits
Select commit
Hold shift + click to select a range
bd2d636
Use new python env on orion
CoryMartin-NOAA b9d6e10
Start of CI cron scripts
CoryMartin-NOAA 14a2d1e
Add writing of comment message
CoryMartin-NOAA 52a0c02
Make it a login shell for modules
CoryMartin-NOAA 4a19577
Merge branch 'feature/new_orion_modules' into feature/orion_cron_rt
CoryMartin-NOAA 5d9a9ef
Fix typo
CoryMartin-NOAA d54c8c6
Commit to save
CoryMartin-NOAA 3135026
move files to ci/
CoryMartin-NOAA 3189c35
Comment out repos for testing/debugging
CoryMartin-NOAA 4bfc5c7
Remove CRTM
CoryMartin-NOAA 9f11f28
Add scrubber and change of labels
CoryMartin-NOAA 39dab94
Changes to the CI script
CoryMartin-NOAA 86d99c2
Add back all repos
CoryMartin-NOAA 78484ef
Update comment format
CoryMartin-NOAA 6d84e38
Merge branch 'develop' into feature/orion_cron_rt
CoryMartin-NOAA d78686c
Add back unit tests on push
CoryMartin-NOAA a25b6a3
Changes to hera modules, and add hera ci config
CoryMartin-NOAA 2ff4158
Address reviewer comments round 1
CoryMartin-NOAA 2559339
Merge branch 'feature/orion_cron_rt' into feature/hera_cron_rt
CoryMartin-NOAA e1de501
Change test names
CoryMartin-NOAA 276e6d5
Remove ulimit
CoryMartin-NOAA 5374a7a
Merge branch 'feature/orion_cron_rt' into feature/hera_cron_rt
CoryMartin-NOAA b92580f
Merge branch 'develop' into feature/hera_cron_rt
CoryMartin-NOAA baf9baf
Reviewer comments
CoryMartin-NOAA 99b9c58
have pycodestyle only check certain dirs
CoryMartin-NOAA db7ee8b
Remove dirs that donot exist yet
CoryMartin-NOAA ae9633d
make extract verbose
CoryMartin-NOAA File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| GDAS_CI_ROOT=/scratch1/NCEPDEV/da/Cory.R.Martin/CI/GDASApp | ||
| GDAS_CI_HOST='hera' | ||
| export GDAS_MODULE_USE=$GDAS_CI_ROOT/repo/modulefiles | ||
| export SLURM_ACCOUNT=da-cpu | ||
| export SALLOC_ACCOUNT=$SLURM_ACCOUNT | ||
| export SBATCH_ACCOUNT=$SLURM_ACCOUNT | ||
| export SLURM_QOS=debug |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,24 +1,65 @@ | ||
| -- NOAA RDHPCS Hera Modulefile for UFS-DA | ||
| help([[ | ||
| Load environment for running JEDI applications with Intel compilers and MPI. | ||
| ]]) | ||
|
|
||
| local pkgName = myModuleName() | ||
| local pkgVersion = myModuleVersion() | ||
| local pkgNameVer = myModuleFullName() | ||
|
|
||
| conflict(pkgName) | ||
|
|
||
| local jedi_opt = '/scratch1/NCEPDEV/jcsda/jedipara/opt/modules' | ||
| setenv('JEDI_OPT', jedi_opt) | ||
| local jedi_core = pathJoin(jedi_opt, 'modulefiles/core') | ||
| prepend_path("MODULEPATH", jedi_core) | ||
|
|
||
| load('jedi/intel-impi/2020.2') | ||
| prepend_path("MODULEPATH", '/scratch1/NCEPDEV/da/python/opt/modulefiles/stack') | ||
|
|
||
| load("cmake/3.20.1") | ||
| load("git-lfs/2.11.0") | ||
|
|
||
| load("jedi-intel/2020.2") | ||
| load("szip/2.1.1") | ||
| load("zlib/1.2.11") | ||
| load("udunits/2.2.28") | ||
| load("gsl_lite/0.37.0") | ||
| load("jedi-impi/2020.2") | ||
|
|
||
| load("hdf5/1.12.0") | ||
| load("pnetcdf/1.12.1") | ||
| load("netcdf/4.7.4") | ||
|
|
||
| load("boost-headers/1.68.0") | ||
| load("eigen/3.3.7") | ||
| load("bufr/noaa-emc-11.5.0") | ||
|
|
||
| load("nccmp/1.8.7.0") | ||
| load("pio/2.5.1-debug") | ||
|
|
||
| load("ecbuild/ecmwf-3.6.1") | ||
| load("eckit/ecmwf-1.16.0") | ||
| load("fckit/ecmwf-0.9.2") | ||
| load("atlas/ecmwf-0.24.1") | ||
| load("nco/4.9.1") | ||
|
|
||
| load("pybind11/2.7.0") | ||
| load("json/3.9.1") | ||
| load("json-schema-validator/2.1.0") | ||
|
|
||
| load("hpc") | ||
| load("miniconda3") | ||
| load("gdasapp") | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. versions. |
||
|
|
||
| setenv("CC","mpiicc") | ||
| setenv("FC","mpiifort") | ||
| setenv("CXX","mpiicpc") | ||
|
|
||
| local mpiexec = '/apps/slurm/default/bin/srun' | ||
| local mpinproc = '-n' | ||
| setenv('MPIEXEC_EXEC', mpiexec) | ||
| setenv('MPIEXEC_NPROC', mpinproc) | ||
|
|
||
| whatis("Name: ".. pkgName) | ||
| whatis("Version: " .. pkgVersion) | ||
| whatis("Category: UFS-DA") | ||
| whatis("Description: Load JEDI-Stack for UFS-DA") | ||
| whatis("Version: ".. pkgVersion) | ||
| whatis("Category: GDASApp") | ||
| whatis("Description: Load all libraries needed for GDASApp") | ||
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
GDASApp