Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
204 commits
Select commit Hold shift + click to select a range
3786979
Feature/update model namelist definitions (#377)
mkavulich Dec 11, 2020
d889b0e
Cherry-pick #343 from release branch: Allow running from crontab on C…
mkavulich Dec 11, 2020
e04bb13
Maximize RRFS_CONUS_[25,13,3]km grids so they span as much of HRRR CO…
gsketefian Dec 14, 2020
458d6cc
Automate creation of symlinks to fixed files (i.e. pregenerated grid,…
gsketefian Dec 29, 2020
d5287f5
Enable fetching of FV3GFS files from NOAA HPSS after 202002600 (as we…
gsketefian Jan 6, 2021
ae3d1a6
Fix stochastic physics namelist block. Change tm${cyc} to tm00. (#387)
JeffBeck-NOAA Jan 11, 2021
4fd37fc
develop: Namelist changes following GSL, EMC, and DTC namelist consol…
JeffBeck-NOAA Jan 12, 2021
14b9142
Enhancements to Python plotting scripts (#381)
BenjaminBlake-NOAA Jan 13, 2021
e435468
Make DT_ATMOS, LAYOUT_X/Y, and BLOCKSIZE user-specifiable when using …
gsketefian Jan 13, 2021
3b99ca0
develop: Fix to run workflow tasks on WCOSS (#390)
chan-hoo Jan 15, 2021
9339f3c
Bugfixes for default values of grid parameters and forecast computati…
gsketefian Jan 20, 2021
2131065
Add submission scripts for python scripts for hera specifically (#412)
jwolff-ncar Jan 22, 2021
4fae5f8
Improve the way the climatology file for Thompson MP is handled (#414)
gsketefian Jan 25, 2021
eda1ac5
Improve the way LSM-related parameters are set. (#416)
gsketefian Jan 27, 2021
5bb994d
Add the FV3_HRRR suite to the workflow (#382)
gsketefian Jan 27, 2021
52335ba
develop: add support for SPP. (#409)
JeffBeck-NOAA Jan 28, 2021
ec125d9
Remove SPP from input.nml.FV3 template until code is ready in ufs-wea…
JeffBeck-NOAA Feb 3, 2021
9b83f82
Improvements to run workflow with NAM ICs/LBCs (#417)
gsketefian Feb 3, 2021
3702c85
Bug fix for setting GWD_HRRRsuite_BASEDIR when running the FV3_HRRR s…
gsketefian Feb 3, 2021
9134581
develop: changes required to process global NetCDF files. (#424)
JeffBeck-NOAA Feb 11, 2021
b4bc8b3
Add 'module purge' to the launch script for orion (#438)
chan-hoo Feb 18, 2021
c014b01
Make WE2E tests work on the WCOSS Dell and Cray (#450)
chan-hoo Mar 5, 2021
0057855
Fix the 'fdiag' issue on the develop branch (#454)
chan-hoo Mar 11, 2021
21da612
Sub-hourly post-processing enabled by some new config.sh entries. (#439)
Jeff-Duda Mar 15, 2021
846a1aa
Feature/add metplus (#219)
jwolff-ncar Mar 19, 2021
c6feec4
Updating develop branch with updates from the release branch (#457)
jwolff-ncar Mar 23, 2021
36c75ed
Rename GSD_RAP13km grid and adjust its write-component grid (#458)
gsketefian Mar 26, 2021
c53342c
Fixed a couple typos and modified syntax for status message to work c…
jwolff-ncar Apr 5, 2021
1df37a3
Add functionality for user-defined OMP settings and for the RUN_FCST …
JeffBeck-NOAA Apr 7, 2021
a546881
Modify path to external GFS data (#461)
chan-hoo Apr 8, 2021
d826679
Export OMP settings in the make_orog ex-script and change the default…
JeffBeck-NOAA Apr 14, 2021
87460c0
Add last three year global co2 data (#477)
chan-hoo Apr 16, 2021
791fad2
Update PR tempate to request name of branch PR will be issued to and …
jwolff-ncar Apr 19, 2021
bd47867
develop: Changes to processing and output related to sub-hourly simul…
JeffBeck-NOAA Apr 21, 2021
0a62317
Fix path to staged data for WE2E tests on Cheyenne (#481)
Apr 29, 2021
e96e698
Make the METplus tasks work on WCOSS (#483)
chan-hoo May 3, 2021
fa37432
Adding gsl gwd oro data files (#448)
May 5, 2021
9c4995b
Add dependencies to PR template (#489)
May 19, 2021
08c765d
Fix ensemble mode stochastic pattern seed values for ad-hoc and SPP s…
JeffBeck-NOAA May 24, 2021
4221a92
Modify fix-file list for Thompson scheme (#498)
chan-hoo May 24, 2021
bfc3012
Update for latest version of weather model (hash 2f1c8e1), add RRFS_N…
mkavulich May 25, 2021
66e5860
Add echo top verification and interpolation options for different fie…
jwolff-ncar May 26, 2021
913ca84
Update FV3 namelist settings (#422)
gsketefian Jun 4, 2021
3d6f63d
Make EXTRN_MDL_SYSBASEDIR_[ICS|LBCS] user-specifiable parameters (#473)
gsketefian Jun 8, 2021
7bceebb
Parameterize name of forecast model in ush/setup.sh (#504)
chan-hoo Jun 9, 2021
e1f8f3b
Make the name of the forecast model the same as its repository (#506)
chan-hoo Jun 10, 2021
a709241
Add flag for run_post (#510)
chan-hoo Jun 12, 2021
ae35586
Add array index to cycle_staus in launch script (#513)
chan-hoo Jun 14, 2021
5839bf9
Add /atmos to HPSS path for GFS grib2 files after certain date (#515)
JeffBeck-NOAA Jun 16, 2021
bd7fa17
Make restart_interval selectable in config.sh for warm start (#517)
chan-hoo Jun 17, 2021
b22b372
Update verification conf files to upgrade to MET 10.0, consolidate PB…
jwolff-ncar Jun 30, 2021
0b9d149
Update met and workflow template for wcoss (#535)
chan-hoo Jul 2, 2021
aaecc03
Make the coupling parameter CPL in model_configure selectable (#523)
chan-hoo Jul 2, 2021
4a2a85d
Add inline post option to the SRW App (#538)
chan-hoo Jul 7, 2021
0cc0f12
Changes required to produce the diag_table file at forecast run time.…
JeffBeck-NOAA Jul 9, 2021
a79c9e9
Fix inline post issue in nco mode (#541)
chan-hoo Jul 9, 2021
b99f264
Edit comments, remove unneeded variables, fix indentation.
gsketefian Jul 9, 2021
b564239
Revert "Edit comments, remove unneeded variables, fix indentation."
mkavulich Jul 12, 2021
56d0256
Streamline symlink creation (#536)
gsketefian Jul 13, 2021
1e1a41d
WE2E test for MET verification. (#537)
siwei-noaa Jul 13, 2021
61c76d8
Modify script for 3 digit forecast length (#549)
chan-hoo Jul 14, 2021
3e471ed
Update syntax for latest version of lmod. (#542)
christinaholtNOAA Jul 15, 2021
e87c6e6
change input.nml for filter topo to fix task failure (#547)
JiliDong-NOAA Jul 15, 2021
b429c44
Copy and link NEMS field dictionary file (#545)
danrosen25 Jul 16, 2021
bbfcfa3
Feature/met on hera (#552)
siwei-noaa Jul 16, 2021
bb28b5f
Modifications to allow workflow to run to completion with GNU build o…
Jul 21, 2021
9bd3926
Remove symbolic linking of diag_table when running in ensemble mode
JeffBeck-NOAA Jul 22, 2021
a7dea13
Enable fetching of (and running with) FV3GFS external model data in n…
gsketefian Jul 22, 2021
d8b401b
Add COMPILER="intel" to config.community.sh and config.nco.sh
Jul 23, 2021
c2ce7c5
Reorganize the WE2E (workflow end-to-end) testing system (#531)
gsketefian Jul 23, 2021
e05230d
Revert "Modifications to allow workflow to run to completion with GNU…
JeffBeck-NOAA Jul 23, 2021
76465bd
Remove domains_stack_size from input.yml (#558)
chan-hoo Jul 23, 2021
c8e1001
develop: Verification changes from the RRFS_baseline branch that are …
JeffBeck-NOAA Aug 3, 2021
f9db719
Remove ncores_per_node from model_configure and set PPN_RUN_FCST in s…
chan-hoo Aug 3, 2021
2152d8c
Bug fixes to WE2E test "MET_verification" (#564)
siwei-noaa Aug 3, 2021
9478276
Add the pazi parameter option to the creation of the regional_esg_gri…
JeffBeck-NOAA Aug 5, 2021
02eb626
fix filter_topo failure when GWD orog is on (#569)
JiliDong-NOAA Aug 9, 2021
916a3c8
Set up the parameters for MET on WCOSS in run_WE2E_tests.sh (#574)
chan-hoo Aug 18, 2021
c1dddf7
Move mrms_pull_topofhour.py from scripts/ to ush/ [develop] (#571)
jwolff-ncar Aug 26, 2021
367abb5
Fixes to the "pazi" parameter to work with both GFDL and ESG grids. (…
JeffBeck-NOAA Aug 26, 2021
9031286
Modify post files names to match what is used in latest EMC_post (#581)
JeffBeck-NOAA Aug 27, 2021
715d634
Port verification tasks to run on Cheyenne (#578)
jwolff-ncar Sep 1, 2021
dd9e3ab
Change EMC_post to UPP (#590)
chan-hoo Sep 7, 2021
226f0bb
Remove unbound variables (#592)
chan-hoo Sep 8, 2021
b2a853c
Update met/metplus version on wcoss cray (#595)
chan-hoo Sep 11, 2021
c34ca16
Add METplus-based ensemble verification (#575)
michelleharrold Sep 16, 2021
a223462
Update develop branch for generic linux, MacOS capability (#539)
mkavulich Sep 22, 2021
9490f2f
Add option for fv3gfs_aqm to run_post (#585)
chan-hoo Sep 23, 2021
bdcf42d
Remove Julie from CODEOWNERS (#609)
Sep 28, 2021
2a3a712
Add do_gsl* namelist entries to YAML file for FV3_HRRR SDF. (#597)
JeffBeck-NOAA Oct 6, 2021
f0a1dac
Fix unbound SED for cron commands in the launch script (#606)
chan-hoo Oct 7, 2021
e5e7e29
Adding an environment file for installing pygraf. (#604)
christinaholtNOAA Oct 19, 2021
c203a38
Modify workflow environment for orion (#616)
chan-hoo Oct 22, 2021
ca61138
increase wtime_make_orog for RRFS NA 3km on WCOSS (#622)
chan-hoo Oct 27, 2021
c236f52
Allow FVCOM to be used in Warm and Cold Starts (#620)
dmwright526 Oct 27, 2021
be1d0f9
Add support for Rocoto with generic LINUX platform (#617)
christinaholtNOAA Nov 11, 2021
f014ed9
Add ulimit to the task scripts for Orion (#626)
chan-hoo Nov 11, 2021
302c211
Modify WE2E tests for NCO mode (#629)
chan-hoo Nov 11, 2021
2c0e9e5
Remove rocoto for wcoss from launch script (#636)
chan-hoo Nov 15, 2021
75ae0f6
Rename unchanged readlink (#638)
chan-hoo Nov 17, 2021
58ddaa4
Fix -np warning by RUN_CMD_FCST (#633)
chan-hoo Nov 17, 2021
43fc3e8
Update template namelist files for newer ufs weather model (#642)
chan-hoo Nov 23, 2021
755a231
Add new DEBUG variable (#639)
gsketefian Dec 6, 2021
83b4d38
Toggle on/off workflow tasks (#645)
gsketefian Dec 6, 2021
2c6d750
Specify the number of tasks for run_fcst on Orion (#648)
chan-hoo Dec 7, 2021
d3c6854
Make cycl_freq adjustable in the configuration file (#634)
chan-hoo Dec 10, 2021
b6bbca2
Make thompson_mynn_lam3km ccpp suite available (#644)
chan-hoo Dec 13, 2021
a429a47
Adding variables, levels, and thresholds to ensemble vx (feature/add_…
michelleharrold Dec 21, 2021
01f1c53
Modify -N setting on Cray (#655)
chan-hoo Jan 4, 2022
c810e61
Add a flag for MERRA2 (#659)
chan-hoo Jan 5, 2022
6186978
Verification modifications to conf files. (#662)
JeffBeck-NOAA Jan 10, 2022
ac662c7
Refactor supported input path handling. (#653)
christinaholtNOAA Jan 13, 2022
b38acc4
Enhance ability to use template variables (#650)
gsketefian Jan 13, 2022
6a62056
Update divergence damping parameters (#657)
chan-hoo Jan 20, 2022
eb435aa
Add stand-alone Python data ingest tool. (#667)
christinaholtNOAA Jan 28, 2022
80101f7
Fixing path to input data on Jet. (#669)
christinaholtNOAA Jan 31, 2022
2e2523b
Make platform information configurable. (#666)
christinaholtNOAA Feb 1, 2022
3a7ff03
Update NOAA-EMC/regional_workflow references to ufs-community/regiona…
JeffBeck-NOAA Feb 1, 2022
c6d9937
Fix workflow on Cheyenne (#672)
mkavulich Feb 4, 2022
1762dfb
Adding hooks for running automated WE2E tests. (#676)
christinaholtNOAA Feb 15, 2022
6c17af9
Modify exregional_run_post to use the new fortran namelist (itag) fil…
hertneky Feb 19, 2022
f6afc17
Update CODEOWNERS file (#680)
JeffBeck-NOAA Feb 22, 2022
2b3df16
Enhancement for the ability to output satellite products from the UPP…
hertneky Feb 24, 2022
ddfc256
Use non-login shell for `launch_FV3LAM_wflow.sh`; remove support for …
gsketefian Mar 1, 2022
f2c0c7b
Fix to add missing "/" UPP namelist (#688)
hertneky Mar 2, 2022
48eace2
Fix bug for crontab feature when user's cron table is empty (#690)
gsketefian Mar 4, 2022
337df57
Feature/singularity addition (#686)
EdwardSnyder-NOAA Mar 4, 2022
cc21ad7
Bug fixes in machine files (#692)
gsketefian Mar 8, 2022
5790920
Add NOAA cloud platforms to SRW (#689)
mark-a-potts Mar 8, 2022
8daa824
Add SPP to the SRW App (#685)
JeffBeck-NOAA Mar 9, 2022
0ea005d
Adding python utilities in preparation for providing a python workflo…
danielabdi-noaa Mar 10, 2022
513b0b3
Fix crontab newline issue on wcoss_dell_p3 (#693)
chan-hoo Mar 11, 2022
a78ffef
Remove old/obsolete suites (CPT_v0, GSD_v0, GSD_SAR) from workflow (#…
gsketefian Mar 15, 2022
432e178
Update locations of static data on Cheyenne, Hera, and Jet (#701)
mkavulich Mar 21, 2022
f07f66d
Add -1 to restart_interval (#703)
chan-hoo Mar 22, 2022
d8dac82
back to original values for gfs_2017_gfdlmp (#706)
chan-hoo Mar 22, 2022
598e389
Convert verification to solely use METplus configuration files (featu…
michelleharrold Mar 22, 2022
d03d311
Add missing user-defined stochastic physics options; fix stochastic p…
JeffBeck-NOAA Mar 23, 2022
20df567
Add namelist option for netCDF4 when running with the 3-km NA domain;…
JeffBeck-NOAA Mar 23, 2022
d6913a2
Tweaks to allow compiler and build_env_fn to be specified in the run_…
mark-a-potts Mar 23, 2022
09236d0
Changed 20200304 to 20200303 in ush/mrms_pull_topofhour.py (#712)
michelleharrold Mar 23, 2022
8d7e64f
Remove unused rocoto directory in ush (#720)
christinaholtNOAA Mar 31, 2022
74defd4
Fix bug for nco we2e tests on Orion; re-organize we2e input data and …
chan-hoo Apr 1, 2022
788667c
Added stand-alone verification scripts (feature/issue_683_standaloneV…
michelleharrold Apr 1, 2022
832c932
remove machine base logic (#727)
chan-hoo Apr 2, 2022
251fd79
Allow user-defined file names for input template files (#717)
chan-hoo Apr 4, 2022
e99a458
Changes to RRFS 3- and 13-km domains, setup.sh script bug fixes, make…
JeffBeck-NOAA Apr 4, 2022
e36d367
Adding 25 km tests to Jet/Hera suites. (#718)
christinaholtNOAA Apr 4, 2022
95bf1fc
Add a small 3km predefined grid over Indianapolis for testing (#725)
gsketefian Apr 11, 2022
779accc
Use Python tool for get_extrnl_mdl_file tasks (#681)
christinaholtNOAA Apr 12, 2022
0902510
Increase size of RRFS CONUS grid (#724)
BenjaminBlake-NOAA Apr 13, 2022
bc50915
add include-style quality mark options in metplus confs (#738)
willmayfield Apr 17, 2022
6701c61
Add Gaea as a supported platform for the regional_workflow (#734)
mark-a-potts Apr 22, 2022
6509e64
Add more parameters to CSV file containing WE2E test info (#740)
gsketefian Apr 22, 2022
c46b301
Update directory structure of NCO mode (#743)
chan-hoo Apr 25, 2022
5fffa02
Default CCPP physics option is FV3_GFS_v16 (#746)
natalie-perlin Apr 25, 2022
0ea64f6
Adds an alternative python workflow generation path (#698)
danielabdi-noaa Apr 26, 2022
4f47df4
Fix typo and crontab issue on wcoss dell in workflow python scripts (…
chan-hoo Apr 28, 2022
e07b886
Add new WE2E configs (#748)
EdwardSnyder-NOAA Apr 28, 2022
7e85d73
Added a fixed WoF grid and the python tool to determine the write com…
ywangwof Apr 29, 2022
42a256c
Replace env with modulefiles in scripts (#752)
chan-hoo May 2, 2022
fc435cb
WE2E script improvements for usability (#745)
gsketefian May 2, 2022
543a94e
Standardize static data across Tier-1 platforms; fix and improve IC a…
mkavulich May 3, 2022
4b59a7e
Bug fixes (grid size + suppress screen output from module load) (#756)
gsketefian May 5, 2022
e5d159b
Update default SPP ISEED array in config_defaults.sh to use unique va…
JeffBeck-NOAA May 9, 2022
617d071
Update workflow python scripts (#760)
chan-hoo May 9, 2022
eb06e82
Change output file name of run_post to meet NCO standards (#758)
chan-hoo May 10, 2022
c9e1fbf
Add POST_OUTPUT_DOMAIN_NAME to WE2E tests for new grids (#763)
chan-hoo May 10, 2022
d1fa826
Modifications to `CODEOWNERS` file (#757)
gsketefian May 13, 2022
85ef19b
Adding a python utility for summarizing compute. (#769)
christinaholtNOAA May 16, 2022
6f50e04
Add github actions for python unittests. (#747)
danielabdi-noaa May 16, 2022
3490cbb
Update sample script for NCO mode (#771)
chan-hoo May 17, 2022
4946ed9
Feature/noaacloud (#767)
mark-a-potts May 19, 2022
1d3b45f
removed cheyenne-specific crontab editing section (#773)
mark-a-potts May 19, 2022
829f064
Pin down hera miniconda3 module file version. (#770)
christinaholtNOAA May 19, 2022
68fa679
update staged data dir (#774)
EdwardSnyder-NOAA May 20, 2022
681a37a
update IC/LBC file paths to match new IC/LBC file structure (#766)
EdwardSnyder-NOAA May 26, 2022
afe98dd
add a machine file for MacOS (#777)
natalie-perlin May 26, 2022
d0b3a98
Add columns for relative test and time step to CSV file containing WE…
gsketefian May 31, 2022
bc77ad6
Bug fix for calculation of number of time steps for a given WE2E test…
gsketefian Jun 1, 2022
429a174
Bugfix: Pass domain name to python plotting scripts (#783)
gsketefian Jun 2, 2022
edba717
Update scripts to work with the latest hashes of UFS_UTILS and UPP (#…
chan-hoo Jun 9, 2022
270ff1e
adding new e2e tests (#792)
EdwardSnyder-NOAA Jun 10, 2022
8be67a4
[develop] Update scripts to run with the latest hash of ufs weather m…
chan-hoo Jun 23, 2022
f0f369f
[develop] Update MET/METplus versions and configuration files (#779)
willmayfield Jun 24, 2022
80d59ef
add a linux.sh machine file (a template) (#798) (#803)
gspetro-NOAA Jun 27, 2022
4dfc9ee
[develop] Rename variables related to GFDLgrid-type grids (#787)
gsketefian Jun 27, 2022
64013c8
Remove un-readable path to systemdir on Hera. (#806)
christinaholtNOAA Jun 30, 2022
761b6c3
[develop] Add MET/METplus to Jet (#799)
EdwardSnyder-NOAA Jul 1, 2022
553d01a
Remove RRFS_v1alpha suite (#809)
chan-hoo Jul 12, 2022
e7a2240
[develop]: Remove shell workflow. (#764)
danielabdi-noaa Jul 18, 2022
8ce26ba
Remove wcoss_dell_p3 from workflow (#810)
chan-hoo Jul 19, 2022
833ecb4
Replace deprecated NCAR python environment with conda on Cheyenne (#812)
mkavulich Jul 21, 2022
be534f2
Fix issue on get_extrn_lbcs when FCST_LEN_HRS>=40 with netcdf (#814)
chan-hoo Jul 22, 2022
66e185f
Fixes a problem with adding crontabline when the existing lines have …
danielabdi-noaa Jul 27, 2022
871983f
Bugfix for ensemble+stochastic physics issue and new WE2E test case f…
danielabdi-noaa Aug 9, 2022
fa0d226
Adding data ingest for global ensembles. (#805)
christinaholtNOAA Aug 12, 2022
64157d6
fixed typo (#822)
mark-a-potts Aug 12, 2022
a03c194
Bugfix with machine file wrapper. (#823)
danielabdi-noaa Aug 18, 2022
00a6559
Mods to METplus vx to address multiple issues (#826)
michelleharrold Aug 25, 2022
4a5af68
Use new MET/METplus installs on Gaea (#824)
willmayfield Aug 26, 2022
1603943
Merge remote-tracking branch 'rw/develop' into develop
mkavulich Aug 26, 2022
67a074a
Remove regional_workflow from Externals.cfg
mkavulich Sep 1, 2022
9f6a04b
Modifications to allow WE2E tests to run in new merged structure.
mkavulich Sep 1, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
170 changes: 170 additions & 0 deletions .cicd/Jenkinsfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,170 @@
pipeline {
agent none

options {
skipDefaultCheckout(true)
}

parameters {
// Allow job runner to filter based on platform
// choice(name: 'SRW_PLATFORM_FILTER', choices: ['all', 'cheyenne', 'gaea', 'hera', 'jet', 'orion', 'pcluster_noaa_v2_use1', 'azcluster_noaa', 'gcluster_noaa_v2_usc1'], description: 'Specify the platform(s) to use')
choice(name: 'SRW_PLATFORM_FILTER', choices: ['all', 'cheyenne', 'gaea', 'hera', 'jet', 'orion'], description: 'Specify the platform(s) to use')
// Allow job runner to filter based on compiler
choice(name: 'SRW_COMPILER_FILTER', choices: ['all', 'gnu', 'intel'], description: 'Specify the compiler(s) to use to build')
}

stages {
/*
// Start the NOAA Parallel Works clusters, if necessary
stage('Start Parallel Works Clusters') {
matrix {
// Start all clusters by default or only the specified cluster given by SRW_PLATFORM_FILTER
when {
anyOf {
expression { params.SRW_PLATFORM_FILTER == 'all' }
expression { params.SRW_PLATFORM_FILTER == env.SRW_PLATFORM }
}
}

axes {
axis {
name 'SRW_PLATFORM'
values 'pcluster_noaa_v2_use1', 'azcluster_noaa', 'gcluster_noaa_v2_usc1'
}
}

stages {
// Call the parallel-works-jenkins-client/start-cluster job using SRW_PLATFORM for the
// PW_CLUSTER_NAME parameter
stage('Start Cluster') {
steps {
build job: 'parallel-works-jenkins-client/start-cluster', parameters: [string(name: 'PW_CLUSTER_NAME', value: env.SRW_PLATFORM), string(name: 'PW_CLUSTER_SSH_KEY', value: '~/.ssh/id_rsa'), string(name: 'JAVA_VERSION', value: '11')]
}
}
}
}
}
*/

// Build and test the SRW application on all supported platforms using the supported compilers for each platform
stage('Build and Test') {
matrix {
// Run on all platform/compiler combinations by default or build and test only on the platform(s) and
// compiler(s) specified by SRW_PLATFORM_FILTER and SRW_COMPILER_FILTER
when {
allOf {
anyOf {
expression { params.SRW_PLATFORM_FILTER == 'all' }
expression { params.SRW_PLATFORM_FILTER == env.SRW_PLATFORM }
}

anyOf {
expression { params.SRW_COMPILER_FILTER == 'all' }
expression { params.SRW_COMPILER_FILTER == env.SRW_COMPILER }
}
}
}

axes {
axis {
name 'SRW_PLATFORM'
// values 'cheyenne', 'gaea', 'hera', 'jet', 'orion', 'pcluster_noaa_v2_use1', 'azcluster_noaa', 'gcluster_noaa_v2_usc1'
values 'cheyenne', 'gaea', 'hera', 'jet', 'orion'
}

axis {
name 'SRW_COMPILER'
values 'gnu', 'intel'
}
}

excludes {
// Exclude GNU from platforms that don't support it
exclude {
axis {
name 'SRW_PLATFORM'
values 'gaea', 'hera', 'jet', 'orion'
}

axis {
name 'SRW_COMPILER'
values 'gnu'
}
}
}

agent {
label env.SRW_PLATFORM
}

environment {
BRANCH_NAME_ESCAPED = env.BRANCH_NAME.replace('/', '_')
BUILD_VERSION = "${env.SRW_PLATFORM}-${env.SRW_COMPILER}-${env.BRANCH_NAME_ESCAPED}-${env.BUILD_NUMBER}"
BUILD_NAME = "ufs-srweather-app_${env.BUILD_VERSION}"
}

stages {
// Clean the workspace, checkout the repository, and run checkout_externals
stage('Initialize') {
steps {
echo "Initializing SRW (${env.SRW_COMPILER}) build environment on ${env.SRW_PLATFORM}"
cleanWs()
checkout scm
sh '"${WORKSPACE}/manage_externals/checkout_externals"'
}
}

// Run the unified build script; if successful create a tarball of the build and upload to S3
stage('Build') {
steps {
echo "Building SRW (${env.SRW_COMPILER}) on ${env.SRW_PLATFORM}"
sh 'bash --login "${WORKSPACE}/.cicd/scripts/srw_build.sh"'
}

post {
success {
sh 'tar --create --gzip --verbose --file "${WORKSPACE}/${BUILD_NAME}.tgz" bin include lib share'
s3Upload consoleLogLevel: 'INFO', dontSetBuildResultOnFailure: false, dontWaitForConcurrentBuildCompletion: false, entries: [[bucket: 'woc-epic-jenkins-artifacts', excludedFile: '', flatten: false, gzipFiles: false, keepForever: false, managedArtifacts: true, noUploadOnFailure: true, selectedRegion: 'us-east-1', showDirectlyInBrowser: false, sourceFile: "${env.BUILD_NAME}.tgz", storageClass: 'STANDARD', uploadFromSlave: false, useServerSideEncryption: false]], pluginFailureResultConstraint: 'FAILURE', profileName: 'main', userMetadata: []
}
}
}

// Run the unified test script
stage('Test') {
steps {
echo "Testing SRW (${env.SRW_COMPILER}) on ${env.SRW_PLATFORM}"
sh 'bash --login "${WORKSPACE}/.cicd/scripts/srw_test.sh"'
}
}
}
}
}
}

/*
post {
always {
// Stop any Parallel Works clusters that were started during the pipeline execution
script {
def pw_clusters = ['pcluster_noaa_v2_use1', 'azcluster_noaa', 'gcluster_noaa_v2_usc1']
def clusters = []

// Determine which clusters need to be stopped, if any
if (params.SRW_PLATFORM_FILTER == 'all') {
clusters = pw_clusters
} else if (params.SRW_PLATFORM_FILTER in pw_clusters) {
clusters = [params.SRW_PLATFORM_FILTER]
} else {
echo 'No Parallel Works clusters were used in build'
}

for (int i = 0; i < clusters.size(); ++i) {
// Call the parallel-works-jenkins-client/stop-cluster job using clusters[i] for the
// PW_CLUSTER_NAME parameter
build job: 'parallel-works-jenkins-client/stop-cluster', parameters: [string(name: 'PW_CLUSTER_NAME', value: clusters[i])]
}
}
}
}
*/
}
31 changes: 31 additions & 0 deletions .cicd/scripts/srw_build.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,31 @@
#!/usr/bin/env bash
#
# A unified build script for the SRW application. This script is expected to
# build the SRW application for all supported platforms.
#
set -e -u -x

script_dir="$(cd -- "$(dirname -- "${BASH_SOURCE[0]}")" > /dev/null 2>&1 && pwd)"

# Get repository root from Jenkins WORKSPACE variable if set, otherwise, set
# relative to script directory.
declare workspace
if [[ -n "${WORKSPACE}" ]]; then
workspace="${WORKSPACE}"
else
workspace="$(cd -- "${script_dir}/../.." && pwd)"
fi

build_dir="${workspace}/build"

# Set build related environment variables and load required modules.
source "${workspace}/etc/lmod-setup.sh" "${SRW_PLATFORM}"
module use "${workspace}/modulefiles"
module load "build_${SRW_PLATFORM}_${SRW_COMPILER}"

# Compile SRW application and install to repository root.
mkdir "${build_dir}"
pushd "${build_dir}"
cmake -DCMAKE_INSTALL_PREFIX="${workspace}" -DENABLE_RRFS=on "${workspace}"
make -j "${MAKE_JOBS}"
popd
21 changes: 21 additions & 0 deletions .cicd/scripts/srw_test.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
#!/usr/bin/env bash
#
# A unified test script for the SRW application. This script is expected to
# test the SRW application for all supported platforms. NOTE: At this time,
# this script is a placeholder for a more robust test framework.
#
set -e -u -x

script_dir="$(cd -- "$(dirname -- "${BASH_SOURCE[0]}")" > /dev/null 2>&1 && pwd)"

# Get repository root from Jenkins WORKSPACE variable if set, otherwise, set
# relative to script directory.
declare workspace
if [[ -n "${WORKSPACE}" ]]; then
workspace="${WORKSPACE}"
else
workspace="$(cd -- "${script_dir}/../.." && pwd)"
fi

# Verify that there is a non-zero sized weather model executable.
[[ -s "${workspace}/bin/ufs_model" ]] || [[ -s "${workspace}/bin/NEMS.exe" ]]
3 changes: 1 addition & 2 deletions .github/CODEOWNERS
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,7 @@

# These owners will be the default owners for everything in the repo.
#* @defunkt
* @JulieSchramm @mkavulich @gsketefian @JeffBeck-NOAA @RatkoVasic-NOAA @BenjaminBlake-NOAA

* @mkavulich @gsketefian @JeffBeck-NOAA @RatkoVasic-NOAA @BenjaminBlake-NOAA @ywangwof @chan-hoo @panll @christinaholtNOAA @christopherwharrop-noaa @danielabdi-noaa @mark-a-potts @jkbk2004 @willmayfield @dmwright526 @gspetro-NOAA @natalie-perlin @EdwardSnyder-NOAA
# Order is important. The last matching pattern has the most precedence.
# So if a pull request only touches javascript files, only these owners
# will be requested to review.
Expand Down
44 changes: 44 additions & 0 deletions .github/ISSUE_TEMPLATE/bug_report.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,44 @@
---
name: Bug report
about: Create a report to help us improve
title: ''
labels: bug
assignees: ''

---

<!-- Please remove unwanted/unrelated/irrelevant information such as comments.
Please copy any output files into a public Github gist (see https://gist.github.com/) and link to the gist, rather than relying on paths that might change. -->

Your bug may already be reported!
Please search on the [Issue tracker](https://github.com/ufs-community/ufs-srweather-app/issues) before creating a new issue.
If an issue already exists, please use that issue to add any additional information.

## Expected behavior
<!-- Tell us what should happen. -->

## Current behavior
<!-- Tell us what happens instead of the expected behavior. -->

## Machines affected
<!--- Please provide any relevant information about your setup, including machine/compiler combination. -->
<!-- Reference other issues or PRs in other repositories that this issue is related to, and how they are related. -->

## Steps To Reproduce
<!--- Provide a link to a live example, a code snippet, and/or an explicit set of steps to reproduce this bug.
1. Step 1
2. Step 2
3. See the bug... -->

## Detailed Description of Fix (optional)
<!--- Provide a detailed description of the change or addition you are proposing. -->

## Additional Information (optional)
<!-- Any other relevant information that we should know to correctly understand and reproduce the issue.
Please describe in as much detail as possible. -->

## Possible Implementation (optional)
<!--- Suggest an idea for implementing addition or change. -->

## Output (optional)
<!-- Please include any relevant log files, screenshots or other output here. -->
41 changes: 41 additions & 0 deletions .github/ISSUE_TEMPLATE/feature_request.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
---
name: Feature request
about: Suggest an idea for this project
title: ''
labels: enhancement
assignees: ''

---

<!-- Please remove unwanted/unrelated/irrelevant information such as comments.
Please copy any output files into a public Github gist (see https://gist.github.com/)
and link to the gist, rather than relying on paths that might change. -->

Your issue may already be reported!
Please search on the [Issue tracker](https://github.com/ufs-community/ufs-srweather-app/issues) before creating a new issue. If an issue already exists, please use that issue to add any additional information.

## Description
<!-- Provide a clear and concise description of the problem to be solved. -->
<!-- What problem needs to be fixed? -->
<!-- What new capability needs to be added? -->

## Solution
<!-- Add a clear and concise description of the proposed solution. -->

## Requirements**
<!-- What does the new code need to accomplish? Does it require an update
to a version of software (e.g. modules of NCEPLibs, NetCDF, etc.), components
(e.g. UFS-Weather-Model), or system tools (e.g. python3) -->

## Acceptance Criteria (Definition of Done)
<!-- What does it mean for this feature to be finished? -->

## Dependencies (optional)
<!-- Directly reference any issues or PRs in this or other repositories that this
issue is related to, and describe how they are related. -->
<!-- Does this block progress on other issues? Add this issue as a dependency to
other issues as appropriate e.g. #IssueNumber has a dependency on this issue -->

## Alternative Solutions (optional)
<!-- If applicable, add a description of any alternative solutions or features
you've considered. -->
20 changes: 20 additions & 0 deletions .github/ISSUE_TEMPLATE/textonly_request.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
---
name: Text-only request
about: Suggest an idea for this project
title: ''
labels: textonly
assignees: ''

---

## Description
<!-- Provide a clear and concise description of the problem to be solved. -->

## Solution
<!-- Add a clear and concise description of the proposed solution. -->

## Alternatives (optional)
<!-- If applicable, add a description of any alternative solutions or features you've considered. -->

## Related to (optional)
<!-- Directly reference any issues or PRs in this or other repositories that this is related to, and describe how they are related. -->
Loading