Skip to content

Update gdas.cd hash to resolve msu prod_util failure#3556

Merged
DavidHuber-NOAA merged 1 commit into
NOAA-EMC:developfrom
RussTreadon-NOAA:bugfix/msu_modulefiles
Apr 8, 2025
Merged

Update gdas.cd hash to resolve msu prod_util failure#3556
DavidHuber-NOAA merged 1 commit into
NOAA-EMC:developfrom
RussTreadon-NOAA:bugfix/msu_modulefiles

Conversation

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor

@RussTreadon-NOAA RussTreadon-NOAA commented Apr 7, 2025

Description

This PR updates the sorc/gdas.cd hash to resolve failures in marine DA job gdas_prepoceanobs on Hercules and Orion. The failure is due to the wrong prod_util module being used on MSU machines. GDASApp PR #1595 updated the Hercules and Orion modules to use the correct prod_util. Marine DA job gdas_prepoceanobs runs to completion with the updated sorc/gdas.cd hash.

Resolves #3555

Type of change

  • Bug fix (fixes something broken)

Change characteristics

  • Is this a breaking change (a change in existing functionality)? NO
  • Does this change require a documentation update? NO
  • Does this change require an update to any of the following submodules? NO

How has this been tested?

GDASApp based g-w CI was run on Hercules and Orion as part of GDASApp PR #1595 testing. All tests, including gdas_prepoceanobs, pass on MSU machines.

Checklist

  • Any dependent changes have been merged and published
  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • New and existing tests pass with my changes

@RussTreadon-NOAA RussTreadon-NOAA self-assigned this Apr 7, 2025
@RussTreadon-NOAA RussTreadon-NOAA added bug Something isn't working JEDI Feature development to support JEDI-based DA labels Apr 7, 2025
@DavidHuber-NOAA
Copy link
Copy Markdown
Contributor

Thanks for the PR @RussTreadon-NOAA! Let's go ahead and run a suite of tests on Hercules and WCOSS2.

@DavidHuber-NOAA DavidHuber-NOAA added CI-Hercules-Ready **CM use only** PR is ready for CI testing on Hercules CI-Wcoss2-Ready PR is ready for CI testing on WCOSS2. labels Apr 7, 2025
@emcbot emcbot added CI-Hercules-Building **Bot use only** CI testing is cloning/building on Hercules CI-Hercules-Running **Bot use only** CI testing on Hercules for this PR is in-progress and removed CI-Hercules-Ready **CM use only** PR is ready for CI testing on Hercules CI-Hercules-Building **Bot use only** CI testing is cloning/building on Hercules labels Apr 7, 2025
@KateFriedman-NOAA KateFriedman-NOAA added CI-Wcoss2-Building CI testing is cloning/building on WCOSS2 CI-Wcoss2-Running CI testing on WCOSS for this PR is in-progress and removed CI-Wcoss2-Ready PR is ready for CI testing on WCOSS2. CI-Wcoss2-Building CI testing is cloning/building on WCOSS2 labels Apr 7, 2025
@KateFriedman-NOAA
Copy link
Copy Markdown
Contributor

CI Tests set up to run in /lfs/h2/emc/ptmp/emc.global/PR/PR_3556/RUNTESTS on WCOSS

@weihuang-jedi weihuang-jedi added the CI-Awsepicglobalworkflow-Ready **CM use only** PR is ready for CI testing on NOAA CSP label Apr 7, 2025
@emcbot emcbot added CI-Awsepicglobalworkflow-Building **Bot use only** CI testing is cloning/building on NOAA CSP CI-Awsepicglobalworkflow-Running **Bot use only** CI testing on NOAA CSP for this PR is in-progress and removed CI-Awsepicglobalworkflow-Ready **CM use only** PR is ready for CI testing on NOAA CSP CI-Awsepicglobalworkflow-Building **Bot use only** CI testing is cloning/building on NOAA CSP labels Apr 7, 2025
@KateFriedman-NOAA
Copy link
Copy Markdown
Contributor

CI tests on WCOSS2 completed successfully (extended still going but far enough along):

Mon Apr  7 20:26:50 UTC 2025
******** C48_ATM_3556 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Apr 07 2025 16:16:46    Apr 07 2025 17:25:30

******** C48mx500_3DVarAOWCDA_3556 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Apr 07 2025 16:16:49    Apr 07 2025 16:35:50
202103250000        Done    Apr 07 2025 16:16:49    Apr 07 2025 18:20:41

******** C48mx500_hybAOWCDA_3556 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Apr 07 2025 16:16:51    Apr 07 2025 16:35:57
202103250000        Done    Apr 07 2025 16:16:51    Apr 07 2025 17:40:44

******** C48_S2SW_3556 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Apr 07 2025 16:16:53    Apr 07 2025 17:31:03

******** C48_S2SWA_gefs_3556 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Apr 07 2025 16:16:55    Apr 07 2025 18:05:51

******** C96_atm3DVar_extended_3556 ********
202112210000             gfs_genesis                    29130625             RUNNING                   -         0           0.0
202112210000    gfs_gempak_f363-f384                    29130626             RUNNING                   -         0           0.0
202112210000    gfs_awips_20km_1p0deg_f112-f115                    29131289              QUEUED                   -         0           0.0
202112210000    gfs_awips_20km_1p0deg_f116-f119                    29131290              QUEUED                   -         0           0.0
202112210000    gfs_awips_20km_1p0deg_f120-f129                    29131291              QUEUED                   -         0           0.0
202112210000    gfs_awips_20km_1p0deg_f132-f141                    29131292              QUEUED                   -         0           0.0
202112210000    gfs_awips_20km_1p0deg_f144-f153                    29131293              QUEUED                   -         0           0.0
202112210000    gfs_awips_20km_1p0deg_f156-f165                    29131294              QUEUED                   -         0           0.0
202112210000    gfs_awips_20km_1p0deg_f168-f177                    29131295              QUEUED                   -         0           0.0
202112210000    gfs_awips_20km_1p0deg_f180-f186                    29131296              QUEUED                   -         0           0.0
202112210000    gfs_awips_20km_1p0deg_f189-f195                    29131297              QUEUED                   -         0           0.0
202112210000    gfs_awips_20km_1p0deg_f198-f204                    29131298              QUEUED                   -         0           0.0
202112210000    gfs_awips_20km_1p0deg_f207-f213                    29131299              QUEUED                   -         0           0.0
202112210000    gfs_awips_20km_1p0deg_f216-f222                    29131300              QUEUED                   -         0           0.0
202112210000    gfs_awips_20km_1p0deg_f225-f231                    29131301              QUEUED                   -         0           0.0
202112210000    gfs_awips_20km_1p0deg_f234-f240                    29131302              QUEUED                   -         0           0.0
202112210600           gfs_fcst_seg1                    29124568             RUNNING                   -         0           0.0
202112210600    gfs_atmos_prod_f291-f312                    29131303              QUEUED                   -         0           0.0
202112210600        gfs_goesupp_f294                    29131304              QUEUED                   -         0           0.0
202112210600        gfs_goesupp_f297                    29131305              QUEUED                   -         0           0.0
202112210600        gfs_goesupp_f300                    29131306              QUEUED                   -         0           0.0
202112210600        gfs_goesupp_f303                    29131307              QUEUED                   -         0           0.0
202112210600        gfs_goesupp_f306                    29131308              QUEUED                   -         0           0.0
202112210600        gfs_goesupp_f309                    29131309              QUEUED                   -         0           0.0
202112210600        gfs_goesupp_f312                    29131310              QUEUED                   -         0           0.0
202112210600    gfs_gempak_f267-f288                    29131311              QUEUED                   -         0           0.0
202112211200           gfs_fcst_seg1                    29130217             RUNNING                   -         0           0.0
202112211200        gfs_goesupp_f195                    29131312              QUEUED                   -         0           0.0
202112211200        gfs_goesupp_f198                    29131313              QUEUED                   -         0           0.0
202112211200        gfs_goesupp_f201                    29131314              QUEUED                   -         0           0.0
202112211200        gfs_goesupp_f204                    29131315              QUEUED                   -         0           0.0
202112211200    gfs_gempak_f123-f144                    29129034             RUNNING                   -         0           0.0
202112211200    gfs_gempak_f147-f168                    29130222             RUNNING                   -         0           0.0
202112211200    gfs_gempak_f171-f192                    29131316              QUEUED                   -         0           0.0

******** C96C48_hybatmaerosnowDA_3556 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Apr 07 2025 16:17:01    Apr 07 2025 16:41:16
202112201800        Done    Apr 07 2025 16:17:01    Apr 07 2025 18:46:06
202112210000        Done    Apr 07 2025 16:17:01    Apr 07 2025 18:36:06

******** C96C48_hybatmDA_3556 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Apr 07 2025 16:17:03    Apr 07 2025 16:36:38
202112210000        Done    Apr 07 2025 16:17:03    Apr 07 2025 18:21:23
202112210600        Done    Apr 07 2025 16:17:03    Apr 07 2025 18:26:14

******** C96C48_ufs_hybatmDA_3556 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202402231800        Done    Apr 07 2025 16:17:05    Apr 07 2025 16:36:46
202402240000        Done    Apr 07 2025 16:17:05    Apr 07 2025 19:31:24
202402240600        Done    Apr 07 2025 16:17:05    Apr 07 2025 19:11:17

@KateFriedman-NOAA KateFriedman-NOAA added CI-Wcoss2-Passed CI testing on WCOSS for this PR has completed successfully and removed CI-Wcoss2-Running CI testing on WCOSS for this PR is in-progress labels Apr 7, 2025
@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

Thank you @KateFriedman-NOAA for running CI-Wcoss2

@emcbot emcbot added CI-Hercules-Passed **Bot use only** CI testing on Hercules for this PR has completed successfully and removed CI-Hercules-Running **Bot use only** CI testing on Hercules for this PR is in-progress labels Apr 7, 2025
@emcbot
Copy link
Copy Markdown

emcbot commented Apr 7, 2025

CI Passed on Hercules in Build# 1
Built and ran in directory /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/CI/3556


Experiment C48_ATM_78c40eaa Completed 1 Cycles: *SUCCESS* at Mon Apr  7 12:41:18 CDT 2025
Experiment C96mx100_S2S_78c40eaa Completed 1 Cycles: *SUCCESS* at Mon Apr  7 13:53:55 CDT 2025
Experiment C48mx500_hybAOWCDA_78c40eaa Completed 2 Cycles: *SUCCESS* at Mon Apr  7 14:18:03 CDT 2025
Experiment C96C48_hybatmDA_78c40eaa Completed 3 Cycles: *SUCCESS* at Mon Apr  7 15:06:44 CDT 2025
Experiment C96_atm3DVar_78c40eaa Completed 3 Cycles: *SUCCESS* at Mon Apr  7 15:12:45 CDT 2025
Experiment C48_S2SW_78c40eaa Completed 1 Cycles: *SUCCESS* at Mon Apr  7 15:24:41 CDT 2025
Experiment C48mx500_3DVarAOWCDA_78c40eaa Completed 2 Cycles: *SUCCESS* at Mon Apr  7 16:07:29 CDT 2025
Experiment C48_S2SWA_gefs_78c40eaa Completed 1 Cycles: *SUCCESS* at Mon Apr  7 16:20:02 CDT 2025

@emcbot emcbot added CI-Awsepicglobalworkflow-Failed **Bot use only** CI testing on AWS for this PR has failed and removed CI-Awsepicglobalworkflow-Running **Bot use only** CI testing on NOAA CSP for this PR is in-progress labels Apr 7, 2025
@emcbot
Copy link
Copy Markdown

emcbot commented Apr 7, 2025

Experiment C48_S2SWA_gefs FAILED on Awsepicglobalworkflow in Build# 1 in
/lustre/jenkins/3556/global-workflow/RUNTESTS/EXPDIR/C48_S2SWA_gefs_78c40eaa

@emcbot
Copy link
Copy Markdown

emcbot commented Apr 7, 2025

Experiment C48_S2SW FAILED on Awsepicglobalworkflow in Build# 1 in
/lustre/jenkins/3556/global-workflow/RUNTESTS/EXPDIR/C48_S2SW_78c40eaa

@emcbot
Copy link
Copy Markdown

emcbot commented Apr 7, 2025

Experiment C48_ATM FAILED on Awsepicglobalworkflow in Build# 1 in
/lustre/jenkins/3556/global-workflow/RUNTESTS/EXPDIR/C48_ATM_78c40eaa

@emcbot emcbot added CI-Awsepicglobalworkflow-Failed **Bot use only** CI testing on AWS for this PR has failed and removed CI-Awsepicglobalworkflow-Failed **Bot use only** CI testing on AWS for this PR has failed labels Apr 7, 2025
@emcbot
Copy link
Copy Markdown

emcbot commented Apr 7, 2025

CI Failed on Awsepicglobalworkflow in Build# 1
Built and ran in directory /lustre/jenkins/3556/global-workflow


Experiment C48_S2SWA_gefs_78c40eaa Terminated with 0
FAIL
FAIL tasks failed and 1 dead at Mon Apr  7 21:28:30 UTC 2025
Experiment C48_S2SWA_gefs_78c40eaa Terminated: *FAIL*
Error logs:
/lustre/jenkins/3556/global-workflow/RUNTESTS/COMROOT/C48_S2SWA_gefs_78c40eaa/logs/2021032312/gefs_fcst_mem001_seg0.log
Experiment C48_S2SW_78c40eaa Terminated with 0
FAIL
FAIL tasks failed and 2 dead at Mon Apr  7 22:36:13 UTC 2025
Experiment C48_S2SW_78c40eaa Terminated: *FAIL*
Experiment C48_ATM_78c40eaa Terminated with 0
FAIL
FAIL tasks failed and 2 dead at Mon Apr  7 22:36:13 UTC 2025
Experiment C48_ATM_78c40eaa Terminated: *FAIL*
Error logs:
/lustre/jenkins/3556/global-workflow/RUNTESTS/COMROOT/C48_S2SW_78c40eaa/logs/2021032312/gfs_genesis.log
/lustre/jenkins/3556/global-workflow/RUNTESTS/COMROOT/C48_S2SW_78c40eaa/logs/2021032312/gfs_tracker.log
Error logs:
/lustre/jenkins/3556/global-workflow/RUNTESTS/COMROOT/C48_ATM_78c40eaa/logs/2021032312/gfs_genesis.log
/lustre/jenkins/3556/global-workflow/RUNTESTS/COMROOT/C48_ATM_78c40eaa/logs/2021032312/gfs_tracker.log

@DavidHuber-NOAA
Copy link
Copy Markdown
Contributor

All tests passed on WCOSS2 and Hercules. Merging.

@DavidHuber-NOAA DavidHuber-NOAA merged commit 022846c into NOAA-EMC:develop Apr 8, 2025
@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

Thank you @DavidHuber-NOAA for quickly getting this bug fix into develop.

@RussTreadon-NOAA RussTreadon-NOAA deleted the bugfix/msu_modulefiles branch April 14, 2025 09:56
tsga added a commit to tsga/global-workflow that referenced this pull request May 1, 2025
* develop:
  Update GSI hash and GSI fix version to resolve bugs (NOAA-EMC#3626)
  Add missing marine DA files to archiving  (NOAA-EMC#3596)
  Add a low resolution test to mimic GFSv17 cycling as much as possible (NOAA-EMC#3617)
  Add the setting to use the reject list for station t/q observations in GSI based soil DA (NOAA-EMC#3599)
  GitLab CI Framework for schedule PR cases and ctests on multi hosts (NOAA-EMC#3603)
  Avoid parallel restart I/O on WCOSS2 (NOAA-EMC#3615)
  Enables user toggling of GDASApp g-w ctests (NOAA-EMC#3587)
  COM variable updates for prep and some external downstream jobs (NOAA-EMC#3608)
  Remove MOS from system (NOAA-EMC#3612)
  Updates to enable soil DA  (NOAA-EMC#3452)
  Unexport SHELLOPTS when running htar (NOAA-EMC#3601)
  Fix check for netcdf wave restart (NOAA-EMC#3594)
  Call err_chk/err_exit for fatal errors in post JJobs/ex-scripts (NOAA-EMC#3571)
  Remove support for Jet and S4 (NOAA-EMC#3572)
  Hotfix in GitLab pipline for Nightly (env MACHINE breaks build on head node) (NOAA-EMC#3578)
  [hotfix] Missed a path during merging develop (NOAA-EMC#3577)
  Prepare for ops readiness - part 1 (NOAA-EMC#3557)
  Update UFS weather-model to 20250328 hash (NOAA-EMC#3528)
  Fix SFS fcst config (NOAA-EMC#3574)
  Use err_chk in GDAS j-jobs (NOAA-EMC#3570)
  Perform compute builds on Gaea head nodes (NOAA-EMC#3560)
  Add initial capability to produce JEDI-based observation space summary stat files (NOAA-EMC#3471)
  Spread epos over more nodes on Hera to increase allocated memory (NOAA-EMC#3567)
  Create separate gists when multiple files are published on GitHub (NOAA-EMC#3551)
  Use err_chk in GSI J-Jobs and scripts (NOAA-EMC#3549)
  Add unified jinja obs list to marine DA (NOAA-EMC#3530)
  Save snow and aerosol analysis increments (and logs and YAMLs) every cycle (NOAA-EMC#3537)
  Add Dependencies to SFS Cleanup Job (NOAA-EMC#3559)
  Updates archiving to reflect current naming of marine anl output (NOAA-EMC#3541)
  Temporarily disable compute builds on C6 (NOAA-EMC#3558)
  Update gdas.cd hash to resolve msu prod_util failure (NOAA-EMC#3556)
  COMIN/COMOUT updates for enkf chgres and downstream product jobs (NOAA-EMC#3518)
  Call err_chk in forecast scripts for fatal errors (NOAA-EMC#3515)
  Add Rocoto Jobs for the Missing Products of GEFS (NOAA-EMC#3466)
  Download subset fix data with python script (NOAA-EMC#3400)
  Check that partition should be set (NOAA-EMC#3543)
  Rename wave output and refactor some wave scripts to use MPMD, and fix some bugzillas along the way (NOAA-EMC#3517)
  Add support for dual batch partitions on AWS NOAA-EMC#3483
  Update CI build and run directories for GitLab Nightlies on C6 and added GitLab support on Hera (NOAA-EMC#3536)
  Hotfix path for CI in Jenkins on Gaea C6 to it's world-share path (NOAA-EMC#3532)
  Create single ocean grib2 product file (NOAA-EMC#3529)
  Scheduled Nightly CI/CD Pipeline Script in GitLab on Gaea C6 (NOAA-EMC#3493)
  make sure cold starts are handled correctly when DOIAU=YES (issue NOAA-EMC#3516) (NOAA-EMC#3520)
  Add check for DO_AERO_FCST before copying fv_tracer files (NOAA-EMC#3485)
  Use jinja templates instead of `@VARNAME@` in config files (NOAA-EMC#3411)
  Replace "status" (or comparable) with "err" in preparation for moving to err_chk/err_exit (NOAA-EMC#3507)
  Error in Java launch script for CI (NOAA-EMC#3465)
  Delete DATAROOT when running generate_workflows.sh (NOAA-EMC#3504)
  Fix 3244 garbled change (NOAA-EMC#3492)
  Enable ensemble archiving via Globus (NOAA-EMC#3479)
  Update MSU FIX_DIR paths (NOAA-EMC#3488)
  Updates for AOWCDA and hybatmaerosnowDA cases on Gaea C6 (NOAA-EMC#3487)
  Update GOCART path for GDAS/GFS/GCAFS implementations  (NOAA-EMC#3455)
  Make RUN Variables Explicit in `config.resources` (NOAA-EMC#3478)
  Remove unused key from enkfgdas_earc_vrfy (NOAA-EMC#3473)
  Bug fix to the failing early cycle marine DA ensemble re-centering (NOAA-EMC#3454)
  Make marine LETKF optional (NOAA-EMC#3462)
  When sourcing for RUN=enkf*, use CASE_ENS (NOAA-EMC#3475)
  Updates for Gaea: verif-global tag, tracker tag, Fit2Obs tag, and C768 analysis resources (NOAA-EMC#3463)
  Update gefswave glo_025 mesh file with new mask (NOAA-EMC#3457)
  Update MSU glopara paths to new role-global space (NOAA-EMC#3443)
  Enable CI testing on AWS (NOAA-EMC#3459)
  Enable Gaea C5 Jenkins CI (NOAA-EMC#3447)
  Job reference removal from WMO product names (NOAA-EMC#3460)
  Turn off aerosol prognostic radiative feedback for GDAS NOAA-EMC#2926 (NOAA-EMC#3445)
  Add DO_GEMPAK check to postsnd subtask (NOAA-EMC#3451)
  Add a force option to setup_xml to ignore unwritable directories (NOAA-EMC#3448)
  Remove the eomg job (NOAA-EMC#3331)
  Migration to role account for Jenkins on Orion (NOAA-EMC#3440)
  Eliminate `_gfs`, `_gdas`, etc, variables and add necessary if blocks (NOAA-EMC#3420)
  Update workflow staging for sfcanl tiles and waveinit (NOAA-EMC#3429)
  Improve messaging to display clear warning when missing snogrb file (NOAA-EMC#3317)
  JEDI-based ensemble recentering and analysis calculation (NOAA-EMC#3312)
  Enable HPSS archiving on C5/6 (NOAA-EMC#3437)
  Check if HOMEDIR STMP and PTMP are writable (NOAA-EMC#3430)
  Update UFS_Utils and GFS-utils hashes to update Gaea support and ocean/ice post products (NOAA-EMC#3433)
  Enable C1152 forecasts on gaea C6 (NOAA-EMC#3438)
  Migration to role account for Jenkins on Hercules (NOAA-EMC#3423)
  Remove Direct Linking to COM from DATA for `extractvars` Job (NOAA-EMC#3379)
  Enable HPSS via Globus on Hercules and Orion
  Remove job name from product files & update GEMPAK module. (NOAA-EMC#3415)
  `link` instead of `copy` in staging jobs (NOAA-EMC#3410)
  Migrate CI Jenkins to role account on Hera (NOAA-EMC#3414)
  Add rocotorc documentation when using scrontab (NOAA-EMC#3417)
  Update jgdas atmos verfozn and verfrad with COMIN/COMOUT prefix instead of COM (NOAA-EMC#3342)
  Add configuration for empirically-corrected ozone parameters (NOAA-EMC#3386)
  Enable global-workflow to run C768C384 GSI on Gaea-C6 (NOAA-EMC#3412)
  Move logical checks into if blocks (NOAA-EMC#3339)
  Adding Jenkins CI to GaeaC6 using role account (NOAA-EMC#3389)
  Enable GDASApp g-w CI cases to run on wcoss2 (NOAA-EMC#3399)
  CI/CD Test on Gaea C5- And update config.gaea under ci/platform (NOAA-EMC#3280)
  Enable cycling support for Gaea C6 (NOAA-EMC#3323)
  Update enkf archive jobs to use COMIN/COMOUT (NOAA-EMC#3393)
  Copy marine ensemble output observation diags and spread (NOAA-EMC#3407)
  Ci testing on aws 2 (NOAA-EMC#3408)
  Disable METplus jobs on Hera (NOAA-EMC#3403)
  Add the mean EnKF soil increment to the deterministic member (NOAA-EMC#3295)
  Add mpich/8.1.19 to the WCOSS2 LD_LIBRARY_PATH for GDASApp jobs (NOAA-EMC#3396)
  Change order of RUNs (NOAA-EMC#3335)
  CI testing on aws (NOAA-EMC#3391)
  Rename Gulf of Mexico in bufr station list in GFSv17 (NOAA-EMC#3384)
  Enabling AWS CI/testing (NOAA-EMC#3383)
  Update issue templates to use new issue type field (NOAA-EMC#3369)
  Replace WAVECUR_DID variable with "rtofs" (NOAA-EMC#3337)
  Allow for C1152 ATM-Aero cycled DA to run on WCOSS2 (NOAA-EMC#3309)
  Remove Direct Linking to COM from DATA for `wavepostsbs` Job (NOAA-EMC#3303)
  Update jgdas enkf update job with COMIN or COMOUT prefix instead of COM (NOAA-EMC#3333)
  Add capability to run diff resolutions for marine anl and background (NOAA-EMC#3238)
  Update high resolution tests and fix minor wave issues  (NOAA-EMC#3289)
  Add sfs as valid system (NOAA-EMC#3243)
  Add missing arch_tars dependencies (NOAA-EMC#3319)
  Fix the empty aerosol DA aerostat tar file issue (NOAA-EMC#3332)
  Add missing file safeguard for IMS prep in snow analysis tasks (NOAA-EMC#3329)
  Fix memory unsetting on Gaea (NOAA-EMC#3325)
  Fix error log parsing in compute build CI (NOAA-EMC#3301)
  Remove marineanlvrfy task from global-workflow (NOAA-EMC#3314)
  Add `gfs_wavepostpnt` dependencies to gfs_cleanup (NOAA-EMC#3313)
  Increase the GDASApp build wallclock (NOAA-EMC#3298)
  Capture build fail in Jenkins pipeline when no error logs are produced (NOAA-EMC#3297)
  Add/update config files for Gaea and check existence before sourcing config files in generate_workflows.sh (NOAA-EMC#3286)
  Fix ocean restarts when cold starting with DOIAU=YES (NOAA-EMC#3278)
  Splitting up the archive task (NOAA-EMC#3242)
  CTests extended validation for C48_ATM and staged C48_S2SW for gfs_fcst and gfs_atmos (NOAA-EMC#3256)
  Add esnowanl to enkfgfs cycle (NOAA-EMC#3283)
  Add gfs cycles to C48mx500_3DVarAOWCDA (NOAA-EMC#3249)
  Add fetch job and update stage_ic to work with fetched ICs (NOAA-EMC#3141)
  Remove WAFS files and references from `develop` (NOAA-EMC#3263)
  fix intel stack version number on c5 (NOAA-EMC#3258)
  Update gsi_monitor and ufs_utils hashes to recent hashes for C5/C6 build and run (NOAA-EMC#3252)
  Enable DA cycling on gaea C5/C6 (NOAA-EMC#3255)
  Copy post-processed sea ice increment for diagnostics (NOAA-EMC#3235)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working CI-Awsepicglobalworkflow-Failed **Bot use only** CI testing on AWS for this PR has failed CI-Hercules-Passed **Bot use only** CI testing on Hercules for this PR has completed successfully CI-Wcoss2-Passed CI testing on WCOSS for this PR has completed successfully JEDI Feature development to support JEDI-based DA

Projects

None yet

Development

Successfully merging this pull request may close these issues.

GDASApp jobs fail due to the wrong prod_util module being loaded on MSU

5 participants