Skip to content

Update JEDI hashes (20250423)#1629

Merged
RussTreadon-NOAA merged 10 commits into
developfrom
feature/stable-nightly
Apr 23, 2025
Merged

Update JEDI hashes (20250423)#1629
RussTreadon-NOAA merged 10 commits into
developfrom
feature/stable-nightly

Conversation

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor

@RussTreadon-NOAA RussTreadon-NOAA commented Apr 20, 2025

Description

Weekly update of JEDI hashes

Companion PRs

Issues

Resolves #1628

Automated CI tests to run in Global Workflow

  • atm_jjob
  • C96C48_ufs_hybatmDA
  • C96C48_hybatmaerosnowDA
  • C48mx500_3DVarAOWCDA
  • C48mx500_hybAOWCDA
  • C96C48_hybatmDA

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

WCOSS2 g-w CI

Install feature/stable-nightly at 789c8b3 inside g-w PR #3587 with local modifications to jcb-gdas amsua_n19.yaml.j2 and atms_n20.yaml.j2. See GDASApp issue #1628 for details regarding modified yaml templates.

Run g-w CI on Cactus with the following results

/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48_ATM_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Apr 20 2025 12:46:24    Apr 20 2025 13:55:39
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48mx500_3DVarAOWCDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Apr 20 2025 12:46:26    Apr 20 2025 13:00:52
202103250000        Done    Apr 20 2025 12:46:26    Apr 20 2025 14:35:38
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48mx500_hybAOWCDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Apr 20 2025 12:46:27    Apr 20 2025 13:00:56
202103250000        Done    Apr 20 2025 12:46:27    Apr 20 2025 14:05:44
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48_S2SWA_gefs_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Apr 20 2025 12:46:30    Apr 20 2025 14:10:57
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48_S2SW_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Apr 20 2025 12:46:32    Apr 20 2025 13:55:56
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96_atm3DVar_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Apr 20 2025 12:46:34    Apr 20 2025 13:01:08
202112210000        Done    Apr 20 2025 12:46:34    Apr 20 2025 15:10:55
202112210600        Done    Apr 20 2025 12:46:34    Apr 20 2025 14:55:51
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96C48_hybatmaerosnowDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Apr 20 2025 12:46:36    Apr 20 2025 13:06:00
202112201800        Done    Apr 20 2025 12:46:36    Apr 20 2025 15:10:59
202112210000        Done    Apr 20 2025 12:46:36    Apr 20 2025 15:01:06
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96C48_hybatmDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Apr 20 2025 12:46:38    Apr 20 2025 13:01:16
202112210000        Done    Apr 20 2025 12:46:38    Apr 20 2025 14:45:56
202112210600        Done    Apr 20 2025 12:46:38    Apr 20 2025 14:50:46
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96C48_ufs_hybatmDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202402231800        Done    Apr 20 2025 12:46:39    Apr 20 2025 13:01:20
202402240000        Done    Apr 20 2025 12:46:39    Apr 20 2025 15:40:37
202402240600        Done    Apr 20 2025 12:46:39    Apr 20 2025 15:35:55
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96mx100_S2S_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
199405010000        Done    Apr 20 2025 12:46:41    Apr 20 2025 14:16:06

All jobs in all g-w CI cases tested run to completion.

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

Hercules and Orion GDASApp ctests

Install feature/stable-nightly at 789c8b3 inside g-w PR #3587 with local modifications to jcb-gdas amsua_n19.yaml.j2 and atms_n20.yaml.j2. See GDASApp issue #1628 for details regarding modified yaml templates.

Hercules results

Test project /work/noaa/da/rtreadon/git/global-workflow/pr3587/sorc/gdas.cd/build
        Start 2034: test_gdasapp_C96C48_ufs_hybatmDA
        Start 2015: test_gdasapp_C96C48_hybatmDA
        Start 2058: test_gdasapp_C96C48_hybatmaerosnowDA
        Start 2083: test_gdasapp_C48mx500_3DVarAOWCDA
        Start 2093: test_gdasapp_C48mx500_hybAOWCDA
        Start 2108: test_gdasapp_setup_atm_jjob_cycled_exp
        Start 1622: test_gdasapp_util_prepdata
        Start 1620: test_gdasapp_util_coding_norms
        Start 1621: test_gdasapp_util_ioda_example
        Start 1625: test_gdasapp_util_rtofstmp
        Start 1626: test_gdasapp_util_rtofssal
        Start 2008: test_gdasapp_check_python_norms
  1/136 Test #1622: test_gdasapp_util_prepdata ...............................................   Passed    1.55 sec
        Start 1623: test_gdasapp_util_rads2ioda
  2/136 Test #1620: test_gdasapp_util_coding_norms ...........................................   Passed    2.55 sec

...

133/136 Test #2055: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_ecen_fv3jedi_202402240000 ......   Passed   85.59 sec
        Start 2057: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_fcst_202402240000
134/136 Test #2048: test_gdasapp_C96C48_ufs_hybatmDA_gdas_analcalc_fv3jedi_202402240000 ......   Passed   92.47 sec
135/136 Test #2057: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_fcst_202402240000 ..............   Passed  288.32 sec
136/136 Test #2049: test_gdasapp_C96C48_ufs_hybatmDA_gdas_fcst_202402240000 ..................   Passed  347.03 sec

100% tests passed, 0 tests failed out of 136

Label Time Summary:
gdas-utils    =  41.96 sec*proc (15 tests)
gdasapp       = 18815.00 sec*proc (103 tests)
script        = 18856.97 sec*proc (118 tests)

Total Test time (real) = 3155.82 sec

Orion results

Test project /work2/noaa/da/rtreadon/git/global-workflow/pr3587/sorc/gdas.cd/build
        Start 2034: test_gdasapp_C96C48_ufs_hybatmDA
        Start 2015: test_gdasapp_C96C48_hybatmDA
        Start 2058: test_gdasapp_C96C48_hybatmaerosnowDA
        Start 2083: test_gdasapp_C48mx500_3DVarAOWCDA
        Start 2093: test_gdasapp_C48mx500_hybAOWCDA
        Start 2108: test_gdasapp_setup_atm_jjob_cycled_exp
        Start 1622: test_gdasapp_util_prepdata
        Start 1620: test_gdasapp_util_coding_norms
        Start 1621: test_gdasapp_util_ioda_example
        Start 1625: test_gdasapp_util_rtofstmp
        Start 1626: test_gdasapp_util_rtofssal
        Start 2008: test_gdasapp_check_python_norms
  1/136 Test #1622: test_gdasapp_util_prepdata ...............................................   Passed    2.74 sec
        Start 1623: test_gdasapp_util_rads2ioda
  2/136 Test #1621: test_gdasapp_util_ioda_example ...........................................   Passed    4.40 sec

...

134/136 Test #2048: test_gdasapp_C96C48_ufs_hybatmDA_gdas_analcalc_fv3jedi_202402240000 ......   Passed  118.46 sec
135/136 Test #2057: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_fcst_202402240000 ..............   Passed  416.08 sec
136/136 Test #2049: test_gdasapp_C96C48_ufs_hybatmDA_gdas_fcst_202402240000 ..................   Passed  500.57 sec

100% tests passed, 0 tests failed out of 136

Label Time Summary:
gdas-utils    =  30.79 sec*proc (15 tests)
gdasapp       = 29425.63 sec*proc (103 tests)
script        = 29456.42 sec*proc (118 tests)

Total Test time (real) = 5935.28 sec

136 out of 136 ctests pass on both Hercules and Orion.

@RussTreadon-NOAA RussTreadon-NOAA self-assigned this Apr 20, 2025
@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

Hera GDASApp ctests

The stable-nightly run on Hera has been modified install feature/stable-nightly inside g-w PR #3597 with local modifications to jcb-gdas amsua_n19.yaml.j2 and atms_n20.yaml.j2

GDASApp ctests were run with 136 out of 136 tests passing

Test project /scratch1/NCEPDEV/da/Russ.Treadon/CI/GDASApp/stable/20250420/global-workflow/sorc/gdas.cd/build
        Start 2034: test_gdasapp_C96C48_ufs_hybatmDA
        Start 2015: test_gdasapp_C96C48_hybatmDA
        Start 2058: test_gdasapp_C96C48_hybatmaerosnowDA
        Start 2083: test_gdasapp_C48mx500_3DVarAOWCDA
        Start 2093: test_gdasapp_C48mx500_hybAOWCDA
        Start 2108: test_gdasapp_setup_atm_jjob_cycled_exp
        Start 1622: test_gdasapp_util_prepdata
        Start 1620: test_gdasapp_util_coding_norms
        Start 1621: test_gdasapp_util_ioda_example
        Start 1625: test_gdasapp_util_rtofstmp
        Start 1626: test_gdasapp_util_rtofssal
        Start 2008: test_gdasapp_check_python_norms
  1/136 Test #1621: test_gdasapp_util_ioda_example ...........................................   Passed    0.77 sec
        Start 2009: test_gdasapp_check_yaml_keys
  2/136 Test #2009: test_gdasapp_check_yaml_keys .............................................   Passed    0.51 sec
        Start 2010: test_gdasapp_snow_create_ens
  3/136 Test #1626: test_gdasapp_util_rtofssal ...............................................   Passed    1.45 sec

...

135/136 Test #2049: test_gdasapp_C96C48_ufs_hybatmDA_gdas_fcst_202402240000 ..................   Passed  994.53 sec
136/136 Test #2057: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_fcst_202402240000 ..............   Passed  1177.33 sec

100% tests passed, 0 tests failed out of 136

Label Time Summary:
gdas-utils    =  12.59 sec*proc (15 tests)
gdasapp       = 34078.63 sec*proc (103 tests)
script        = 34091.22 sec*proc (118 tests)

Total Test time (real) = 6203.92 sec

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

@DavidNew-NOAA , @CoryMartin-NOAA , and @guillaumevernieres : As you know, g-w based GDASApp ctests are currently broken. We need to

  1. update g-w to allow g-w to build GDASApp with g-w based GDASApp ctests on. g-w PR #3587 addresses this.
  2. update ufs weather model hash to generate cubed_sphere_grid files in the format JEDI atmospheric DA requires. ufs-weather-model PR #2508 addresses this.
  3. resolve the issue with amsu_n19 and atms jcb-gdas observation templates (see GDASApp issue #1628). We update the jcb-gdas hash in GDASApp when this issue is resolved.
  4. update GDASApp ci/run_ci.sh to work with restructured g-w directories. The workflow directory is now in dev/workflow. GDASApp CI needs to activate g-w based CI tests via WORKFLOW_TESTS="ON". These changes are already in feature/stable-nightly and are part of this PR.

The g-w PR, item 1 above, is waiting for updated ufs_model.fd (item 2) and gdas.cd (item 4) hashes. I do not know how long it will take to resolve item 2.

Resolution of item 3 could be done in one or two steps.

The one step approach is to figure out why the current amsua-n19.yaml.j2 and atms_n20.yaml.j2 don't work with GDASApp, develop a fix, and update the parm/jcb-gdas hash. I don't know how long this will take.

The two step approach adds a patch prior to the real fix. The patch allows atmospheric GDASApp g-w CI to temporarily pass while we work on the real fix. The patch temporarily revert changes to amsua_n19.yaml.j2 and atms_n20.yaml.j2. The patch jcb-gdas hash is added to the PR.

Thoughts? Comments?

@DavidNew-NOAA
Copy link
Copy Markdown
Collaborator

@RussTreadon-NOAA Thanks for the update. My vote would be for the two-step approach get things working again ASAP while we work on a more permanent fix.

@CoryMartin-NOAA
Copy link
Copy Markdown
Contributor

Don't we have to wait for 1 and 2 to be resolved before everything will pass properly? If so, doesn't that give us time to fix the YAML templates properly? If we don't have to wait then I agree fixing as quickly as possible is preferred

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

Yes, for everything to work out of the box we need 1, 2, 3, and 4. The two step approach for 3 allows us to more quickly provide an updated GDASApp hash for 1. I have no idea how long item 2 will take to be completed. g-w PR #3587 currently contains patch changes which allow us to get around item 2. These patches are only temporary until item 2 is completed.

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

jcb-gdas PR #109 has been opened to resolve item 3 above. Given additional QC in the updated amsua_n19, several reference files for test_gdasapp_atm_jjob ctests had to be updated. The updated reference files have been added to this PR.

Once PR #109 is approved and merged into jcb-gdas, I'll update the parm/jcb-gdas hash in feature/stable-nightly.

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

Items 3 and 4 from above have been merged into feature/stable-nightly.

feature/stable-nightly at 6bb6e4b has been built inside g-w RussTreadon-NOAA:bugfix/gdasapp_gwtests at 7a38bd2 on Hera, Hercules, Orion, and Cactus. The suite of 136 test_gdasapp ctests has been launched on each machine. Results will be reported in subsequent comments.

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

GDASApp CI on Hera, Hercules, and Orion

Install feature/stable-nightly at 2ab6674 inside g-w RussTreadon-NOAA:bugfix/gdasapp_gwtests at 7a38bd2. Build GDASApp with WORKFLOW_TESTS="ON". Run GDASApp ctests. All 136 tests pass on each machine. Hera results are shared below:

Test project /scratch1/NCEPDEV/da/Russ.Treadon/CI/GDASApp/stable/20250423/global-workflow/sorc/gdas.cd/build
        Start 2034: test_gdasapp_C96C48_ufs_hybatmDA
        Start 2015: test_gdasapp_C96C48_hybatmDA
        Start 2058: test_gdasapp_C96C48_hybatmaerosnowDA
        Start 2083: test_gdasapp_C48mx500_3DVarAOWCDA
        Start 2093: test_gdasapp_C48mx500_hybAOWCDA
        Start 2108: test_gdasapp_setup_atm_jjob_cycled_exp
        Start 1622: test_gdasapp_util_prepdata
        Start 1620: test_gdasapp_util_coding_norms
        Start 1621: test_gdasapp_util_ioda_example
        Start 1625: test_gdasapp_util_rtofstmp
        Start 1626: test_gdasapp_util_rtofssal
        Start 2008: test_gdasapp_check_python_norms
  1/136 Test #1621: test_gdasapp_util_ioda_example ...........................................   Passed    0.53 sec
        Start 2009: test_gdasapp_check_yaml_keys
  2/136 Test #2009: test_gdasapp_check_yaml_keys .............................................   Passed    0.16 sec
        Start 2010: test_gdasapp_snow_create_ens
  3/136 Test #1626: test_gdasapp_util_rtofssal ...............................................   Passed    1.26 sec
        Start 2011: test_gdasapp_snow_imsproc
  4/136 Test #2108: test_gdasapp_setup_atm_jjob_cycled_exp ...................................   Passed    1.37 sec
        Start 2113: test_gdasapp_atm_jjob_ens_init
  5/136 Test #1625: test_gdasapp_util_rtofstmp ...............................................   Passed    1.59 sec
        Start 2109: test_gdasapp_atm_jjob_var_init
  6/136 Test #2010: test_gdasapp_snow_create_ens .............................................   Passed    1.89 sec
        Start 2012: test_gdasapp_snow_apply_jediincr
  7/136 Test #1622: test_gdasapp_util_prepdata ...............................................   Passed    3.36 sec
        Start 1623: test_gdasapp_util_rads2ioda
  8/136 Test #1623: test_gdasapp_util_rads2ioda ..............................................   Passed    0.15 sec
        Start 1624: test_gdasapp_util_ghrsst2ioda
  9/136 Test #1620: test_gdasapp_util_coding_norms ...........................................   Passed    3.54 sec
        Start 1627: test_gdasapp_util_smap2ioda
 10/136 Test #1624: test_gdasapp_util_ghrsst2ioda ............................................   Passed    0.13 sec
        Start 1628: test_gdasapp_util_smos2ioda
 11/136 Test #1627: test_gdasapp_util_smap2ioda ..............................................   Passed    0.12 sec
        Start 1629: test_gdasapp_util_viirsaod2ioda
 12/136 Test #1628: test_gdasapp_util_smos2ioda ..............................................   Passed    0.14 sec
        Start 1630: test_gdasapp_util_icecabi2ioda
 13/136 Test #1629: test_gdasapp_util_viirsaod2ioda ..........................................   Passed    0.13 sec
        Start 1631: test_gdasapp_util_icecamsr2ioda
 14/136 Test #1631: test_gdasapp_util_icecamsr2ioda ..........................................   Passed    0.12 sec
        Start 1632: test_gdasapp_util_icecmirs2ioda
 15/136 Test #1630: test_gdasapp_util_icecabi2ioda ...........................................   Passed    0.15 sec
        Start 1633: test_gdasapp_util_icecjpssrr2ioda
 16/136 Test #1632: test_gdasapp_util_icecmirs2ioda ..........................................   Passed    0.13 sec
        Start 1634: test_gdasapp_util_insituall2ioda
 17/136 Test #1633: test_gdasapp_util_icecjpssrr2ioda ........................................   Passed    0.12 sec
        Start 2013: test_gdasapp_snow_letkfoi_snowda
 18/136 Test #1634: test_gdasapp_util_insituall2ioda .........................................   Passed    0.13 sec
        Start 2014: test_gdasapp_convert_bufr_adpsfc_snow
 19/136 Test #2008: test_gdasapp_check_python_norms ..........................................   Passed    4.81 sec
        Start 2106: test_gdasapp_convert_bufr_adpsfc
 20/136 Test #2011: test_gdasapp_snow_imsproc ................................................   Passed    3.63 sec
        Start 2107: test_gdasapp_convert_gsi_satbias
 21/136 Test #2012: test_gdasapp_snow_apply_jediincr .........................................   Passed    4.79 sec
        Start 2120: test_gdasapp_aero_gen_3dvar_yaml
 22/136 Test #2014: test_gdasapp_convert_bufr_adpsfc_snow ....................................   Passed    3.26 sec
        Start 2121: test_gdasapp_bufr2ioda_insitu_profile_argo
 23/136 Test #2120: test_gdasapp_aero_gen_3dvar_yaml .........................................   Passed    0.91 sec
        Start 2122: test_gdasapp_bufr2ioda_insitu_profile_bathy
 24/136 Test #2083: test_gdasapp_C48mx500_3DVarAOWCDA ........................................   Passed    8.85 sec
        Start 2084: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_stage_ic_202103241800
 25/136 Test #2106: test_gdasapp_convert_bufr_adpsfc .........................................   Passed    4.24 sec
        Start 2085: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_waveinit_202103241800
 26/136 Test #2107: test_gdasapp_convert_gsi_satbias .........................................   Passed    5.60 sec
        Start 2123: test_gdasapp_bufr2ioda_insitu_profile_glider
 27/136 Test #2093: test_gdasapp_C48mx500_hybAOWCDA ..........................................   Passed   11.23 sec
        Start 2094: test_gdasapp_C48mx500_hybAOWCDA_gdas_stage_ic_202103241800
 28/136 Test #2015: test_gdasapp_C96C48_hybatmDA .............................................   Passed   12.50 sec
        Start 2016: test_gdasapp_C96C48_hybatmDA_gdas_stage_ic_202112201800
 29/136 Test #2034: test_gdasapp_C96C48_ufs_hybatmDA .........................................   Passed   13.36 sec
        Start 2035: test_gdasapp_C96C48_ufs_hybatmDA_gdas_stage_ic_202402231800
 30/136 Test #2122: test_gdasapp_bufr2ioda_insitu_profile_bathy ..............................   Passed    5.20 sec
        Start 2038: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_stage_ic_202402231800
 31/136 Test #2058: test_gdasapp_C96C48_hybatmaerosnowDA .....................................   Passed   14.49 sec
        Start 2059: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_stage_ic_202112201200
 32/136 Test #2123: test_gdasapp_bufr2ioda_insitu_profile_glider .............................   Passed    4.43 sec
        Start 2019: test_gdasapp_C96C48_hybatmDA_enkfgdas_stage_ic_202112201800
 33/136 Test #2121: test_gdasapp_bufr2ioda_insitu_profile_argo ...............................   Passed   10.94 sec
        Start 2063: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_stage_ic_202112201200
 34/136 Test #2013: test_gdasapp_snow_letkfoi_snowda .........................................   Passed   20.81 sec
        Start 2096: test_gdasapp_C48mx500_hybAOWCDA_enkfgdas_stage_ic_202103241800
 35/136 Test #2084: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_stage_ic_202103241800 .............   Passed   40.35 sec
        Start 2086: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_fcst_202103241800
 36/136 Test #2016: test_gdasapp_C96C48_hybatmDA_gdas_stage_ic_202112201800 ..................   Passed   41.90 sec
        Start 2017: test_gdasapp_C96C48_hybatmDA_gdas_fcst_202112201800
 37/136 Test #2059: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_stage_ic_202112201200 ..........   Passed   40.07 sec
        Start 2060: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_fcst_202112201200
 38/136 Test #2094: test_gdasapp_C48mx500_hybAOWCDA_gdas_stage_ic_202103241800 ...............   Passed   43.99 sec
        Start 2095: test_gdasapp_C48mx500_hybAOWCDA_gdas_fcst_202103241800
 39/136 Test #2096: test_gdasapp_C48mx500_hybAOWCDA_enkfgdas_stage_ic_202103241800 ...........   Passed   37.96 sec
        Start 2097: test_gdasapp_C48mx500_hybAOWCDA_enkfgdas_fcst_202103241800
 40/136 Test #2038: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_stage_ic_202402231800 ..........   Passed   54.48 sec
        Start 2039: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_fcst_202402231800
 41/136 Test #2019: test_gdasapp_C96C48_hybatmDA_enkfgdas_stage_ic_202112201800 ..............   Passed   53.78 sec
        Start 2020: test_gdasapp_C96C48_hybatmDA_enkfgdas_fcst_202112201800
 42/136 Test #2035: test_gdasapp_C96C48_ufs_hybatmDA_gdas_stage_ic_202402231800 ..............   Passed   55.86 sec
        Start 2036: test_gdasapp_C96C48_ufs_hybatmDA_gdas_fcst_202402231800
 43/136 Test #2063: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_stage_ic_202112201200 ......   Passed   51.73 sec
        Start 2064: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_fcst_202112201200
 44/136 Test #2113: test_gdasapp_atm_jjob_ens_init ...........................................   Passed   78.14 sec
        Start 2114: test_gdasapp_atm_jjob_ens_letkf
 45/136 Test #2109: test_gdasapp_atm_jjob_var_init ...........................................   Passed   78.34 sec
        Start 2110: test_gdasapp_atm_jjob_var_run
 46/136 Test #2085: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_waveinit_202103241800 .............   Passed  129.95 sec
        Start 2124: test_gdasapp_bufr2ioda_insitu_profile_tesac
 47/136 Test #2124: test_gdasapp_bufr2ioda_insitu_profile_tesac ..............................   Passed    8.88 sec
        Start 2125: test_gdasapp_bufr2ioda_insitu_profile_tropical
 48/136 Test #2125: test_gdasapp_bufr2ioda_insitu_profile_tropical ...........................   Passed    1.55 sec
        Start 2126: test_gdasapp_bufr2ioda_insitu_profile_xbtctd
 49/136 Test #2126: test_gdasapp_bufr2ioda_insitu_profile_xbtctd .............................   Passed    1.06 sec
        Start 2127: test_gdasapp_bufr2ioda_insitu_surface_drifter
 50/136 Test #2127: test_gdasapp_bufr2ioda_insitu_surface_drifter ............................   Passed    1.36 sec
        Start 2128: test_gdasapp_bufr2ioda_insitu_surface_trkob
 51/136 Test #2128: test_gdasapp_bufr2ioda_insitu_surface_trkob ..............................   Passed    1.08 sec
 52/136 Test #2020: test_gdasapp_C96C48_hybatmDA_enkfgdas_fcst_202112201800 ..................   Passed  365.90 sec
        Start 2022: test_gdasapp_C96C48_hybatmDA_enkfgdas_epmn_202112201800
 53/136 Test #2064: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_fcst_202112201200 ..........   Passed  366.39 sec
        Start 2066: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_epmn_202112201200
 54/136 Test #2039: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_fcst_202402231800 ..............   Passed  382.64 sec
        Start 2040: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_epmn_202402231800
 55/136 Test #2095: test_gdasapp_C48mx500_hybAOWCDA_gdas_fcst_202103241800 ...................   Passed  462.62 sec
        Start 2098: test_gdasapp_C48mx500_hybAOWCDA_gdas_prepoceanobs_202103250000
 56/136 Test #2017: test_gdasapp_C96C48_hybatmDA_gdas_fcst_202112201800 ......................   Passed  473.18 sec
        Start 2018: test_gdasapp_C96C48_hybatmDA_gdas_atmos_prod_202112201800
        Start 2021: test_gdasapp_C96C48_hybatmDA_enkfgdas_echgres_202112201800
 57/136 Test #2114: test_gdasapp_atm_jjob_ens_letkf ..........................................   Passed  458.48 sec
        Start 2115: test_gdasapp_atm_jjob_ens_init_split
 58/136 Test #2036: test_gdasapp_C96C48_ufs_hybatmDA_gdas_fcst_202402231800 ..................   Passed  473.46 sec
        Start 2037: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmos_prod_202402231800
 59/136 Test #2086: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_fcst_202103241800 .................   Passed  494.23 sec
        Start 2087: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_prepoceanobs_202103250000
 60/136 Test #2097: test_gdasapp_C48mx500_hybAOWCDA_enkfgdas_fcst_202103241800 ...............   Passed  485.36 sec
        Start 2088: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marinebmat_202103250000
 61/136 Test #2110: test_gdasapp_atm_jjob_var_run ............................................   Passed  522.26 sec
        Start 2099: test_gdasapp_C48mx500_hybAOWCDA_gdas_marinebmat_202103250000
 62/136 Test #2115: test_gdasapp_atm_jjob_ens_init_split .....................................   Passed   78.11 sec
        Start 2116: test_gdasapp_atm_jjob_ens_obs
 63/136 Test #2021: test_gdasapp_C96C48_hybatmDA_enkfgdas_echgres_202112201800 ...............   Passed   91.86 sec
        Start 2111: test_gdasapp_atm_jjob_var_inc
 64/136 Test #2111: test_gdasapp_atm_jjob_var_inc ............................................   Passed   74.16 sec
        Start 2112: test_gdasapp_atm_jjob_var_final
 65/136 Test #2116: test_gdasapp_atm_jjob_ens_obs ............................................   Passed  138.23 sec
        Start 2117: test_gdasapp_atm_jjob_ens_sol
 66/136 Test #2060: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_fcst_202112201200 ..............   Passed  712.20 sec
        Start 2061: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_atmos_prod_202112201200
 67/136 Test #2088: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marinebmat_202103250000 ...........   Passed  232.69 sec
        Start 2062: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_aeroanlgenb_202112201200
 68/136 Test #2099: test_gdasapp_C48mx500_hybAOWCDA_gdas_marinebmat_202103250000 .............   Passed  182.89 sec
        Start 2065: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_echgres_202112201200
 69/136 Test #2112: test_gdasapp_atm_jjob_var_final ..........................................   Passed  106.21 sec
 70/136 Test #2022: test_gdasapp_C96C48_hybatmDA_enkfgdas_epmn_202112201800 ..................   Passed  372.35 sec
 71/136 Test #2018: test_gdasapp_C96C48_hybatmDA_gdas_atmos_prod_202112201800 ................   Passed  292.31 sec
        Start 2023: test_gdasapp_C96C48_hybatmDA_gdas_prep_202112210000
 72/136 Test #2117: test_gdasapp_atm_jjob_ens_sol ............................................   Passed   74.21 sec
        Start 2118: test_gdasapp_atm_jjob_ens_inc
 73/136 Test #2066: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_epmn_202112201200 ..........   Passed  397.87 sec
 74/136 Test #2037: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmos_prod_202402231800 ............   Passed  299.59 sec
        Start 2041: test_gdasapp_C96C48_ufs_hybatmDA_gdas_prep_202402240000
 75/136 Test #2040: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_epmn_202402231800 ..............   Passed  399.59 sec
 76/136 Test #2065: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_echgres_202112201200 .......   Passed   67.53 sec
 77/136 Test #2087: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_prepoceanobs_202103250000 .........   Passed  341.02 sec
        Start 2089: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marineanlinit_202103250000
 78/136 Test #2098: test_gdasapp_C48mx500_hybAOWCDA_gdas_prepoceanobs_202103250000 ...........   Passed  378.48 sec
        Start 2101: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlinit_202103250000
        Start 2100: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlletkf_202103250000
 79/136 Test #2118: test_gdasapp_atm_jjob_ens_inc ............................................   Passed   74.17 sec
        Start 2119: test_gdasapp_atm_jjob_ens_final
 80/136 Test #2062: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_aeroanlgenb_202112201200 .......   Passed  131.92 sec
 81/136 Test #2061: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_atmos_prod_202112201200 ........   Passed  153.25 sec
        Start 2067: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_prep_202112201800
 82/136 Test #2119: test_gdasapp_atm_jjob_ens_final ..........................................   Passed   42.17 sec
 83/136 Test #2089: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marineanlinit_202103250000 ........   Passed   65.74 sec
        Start 2090: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marineanlvar_202103250000
 84/136 Test #2101: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlinit_202103250000 ..........   Passed   60.45 sec
        Start 2102: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlvar_202103250000
 85/136 Test #2102: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlvar_202103250000 ...........   Passed   77.94 sec
        Start 2104: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlchkpt_202103250000
 86/136 Test #2100: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlletkf_202103250000 .........   Passed  146.68 sec
        Start 2103: test_gdasapp_C48mx500_hybAOWCDA_gdas_ocnanalecen_202103250000
 87/136 Test #2090: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marineanlvar_202103250000 .........   Passed   94.65 sec
        Start 2091: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marineanlchkpt_202103250000
 88/136 Test #2091: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marineanlchkpt_202103250000 .......   Passed   65.96 sec
        Start 2092: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marineanlfinal_202103250000
 89/136 Test #2104: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlchkpt_202103250000 .........   Passed   77.96 sec
        Start 2105: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlfinal_202103250000
 90/136 Test #2103: test_gdasapp_C48mx500_hybAOWCDA_gdas_ocnanalecen_202103250000 ............   Passed   79.35 sec
 91/136 Test #2092: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marineanlfinal_202103250000 .......   Passed  181.96 sec
 92/136 Test #2105: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlfinal_202103250000 .........   Passed  191.30 sec
 93/136 Test #2023: test_gdasapp_C96C48_hybatmDA_gdas_prep_202112210000 ......................   Passed  892.31 sec
        Start 2024: test_gdasapp_C96C48_hybatmDA_gdas_anal_202112210000
        Start 2028: test_gdasapp_C96C48_hybatmDA_enkfgdas_eobs_202112210000
 94/136 Test #2067: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_prep_202112201800 ..............   Passed  796.57 sec
        Start 2068: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_anal_202112201800
        Start 2076: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_eobs_202112201800
        Start 2069: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_aeroanlinit_202112201800
        Start 2072: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_snowanl_202112201800
 95/136 Test #2041: test_gdasapp_C96C48_ufs_hybatmDA_gdas_prep_202402240000 ..................   Passed  1014.77 sec
        Start 2042: test_gdasapp_C96C48_ufs_hybatmDA_gdas_prepatmiodaobs_202402240000
 96/136 Test #2069: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_aeroanlinit_202112201800 .......   Passed  146.05 sec
        Start 2070: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_aeroanlvar_202112201800
 97/136 Test #2072: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_snowanl_202112201800 ...........   Passed  219.43 sec
        Start 2080: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_esnowanl_202112201800
 98/136 Test #2080: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_esnowanl_202112201800 ......   Passed  121.44 sec
 99/136 Test #2070: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_aeroanlvar_202112201800 ........   Passed  346.16 sec
        Start 2071: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_aeroanlfinal_202112201800
100/136 Test #2076: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_eobs_202112201800 ..........   Passed  567.12 sec
        Start 2077: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_ediag_202112201800
101/136 Test #2028: test_gdasapp_C96C48_hybatmDA_enkfgdas_eobs_202112210000 ..................   Passed  578.41 sec
        Start 2029: test_gdasapp_C96C48_hybatmDA_enkfgdas_ediag_202112210000
102/136 Test #2071: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_aeroanlfinal_202112201800 ......   Passed  123.03 sec
103/136 Test #2042: test_gdasapp_C96C48_ufs_hybatmDA_gdas_prepatmiodaobs_202402240000 ........   Passed  476.36 sec
        Start 2050: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlinit_202402240000
        Start 2043: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmanlinit_202402240000
104/136 Test #2029: test_gdasapp_C96C48_hybatmDA_enkfgdas_ediag_202112210000 .................   Passed  198.71 sec
        Start 2030: test_gdasapp_C96C48_hybatmDA_enkfgdas_eupd_202112210000
105/136 Test #2077: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_ediag_202112201800 .........   Passed  215.50 sec
        Start 2078: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_eupd_202112201800
106/136 Test #2043: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmanlinit_202402240000 ............   Passed  179.33 sec
        Start 2044: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmanlvar_202402240000
107/136 Test #2050: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlinit_202402240000 .....   Passed  179.90 sec
        Start 2051: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlobs_202402240000
108/136 Test #2024: test_gdasapp_C96C48_hybatmDA_gdas_anal_202112210000 ......................   Passed  962.90 sec
        Start 2025: test_gdasapp_C96C48_hybatmDA_gdas_sfcanl_202112210000
109/136 Test #2078: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_eupd_202112201800 ..........   Passed  231.04 sec
110/136 Test #2030: test_gdasapp_C96C48_hybatmDA_enkfgdas_eupd_202112210000 ..................   Passed  258.66 sec
111/136 Test #2025: test_gdasapp_C96C48_hybatmDA_gdas_sfcanl_202112210000 ....................   Passed   82.84 sec
        Start 2026: test_gdasapp_C96C48_hybatmDA_gdas_analcalc_202112210000
        Start 2027: test_gdasapp_C96C48_hybatmDA_gdas_fcst_202112210000
112/136 Test #2068: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_anal_202112201800 ..............   Passed  1089.67 sec
        Start 2073: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_sfcanl_202112201800
113/136 Test #2073: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_sfcanl_202112201800 ............   Passed   67.14 sec
        Start 2074: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_analcalc_202112201800
        Start 2075: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_fcst_202112201800
114/136 Test #2026: test_gdasapp_C96C48_hybatmDA_gdas_analcalc_202112210000 ..................   Passed  129.79 sec
        Start 2031: test_gdasapp_C96C48_hybatmDA_enkfgdas_ecmn_202112210000
        Start 2032: test_gdasapp_C96C48_hybatmDA_enkfgdas_esfc_202112210000
115/136 Test #2031: test_gdasapp_C96C48_hybatmDA_enkfgdas_ecmn_202112210000 ..................   Passed   82.87 sec
116/136 Test #2074: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_analcalc_202112201800 ..........   Passed  120.50 sec
        Start 2079: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_ecmn_202112201800
        Start 2081: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_esfc_202112201800
117/136 Test #2032: test_gdasapp_C96C48_hybatmDA_enkfgdas_esfc_202112210000 ..................   Passed  150.91 sec
        Start 2033: test_gdasapp_C96C48_hybatmDA_enkfgdas_fcst_202112210000
118/136 Test #2079: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_ecmn_202112201800 ..........   Passed   84.63 sec
119/136 Test #2051: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlobs_202402240000 ......   Passed  570.46 sec
        Start 2052: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlsol_202402240000
120/136 Test #2081: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_esfc_202112201800 ..........   Passed  168.73 sec
        Start 2082: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_fcst_202112201800
121/136 Test #2044: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmanlvar_202402240000 .............   Passed  734.58 sec
        Start 2045: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmanlfv3inc_202402240000
122/136 Test #2027: test_gdasapp_C96C48_hybatmDA_gdas_fcst_202112210000 ......................   Passed  558.62 sec
123/136 Test #2033: test_gdasapp_C96C48_hybatmDA_enkfgdas_fcst_202112210000 ..................   Passed  431.60 sec
124/136 Test #2052: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlsol_202402240000 ......   Passed  484.30 sec
        Start 2053: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlfv3inc_202402240000
125/136 Test #2082: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_fcst_202112201800 ..........   Passed  480.31 sec
126/136 Test #2045: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmanlfv3inc_202402240000 ..........   Passed  473.69 sec
        Start 2046: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmanlfinal_202402240000
127/136 Test #2053: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlfv3inc_202402240000 ...   Passed  175.74 sec
        Start 2054: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlfinal_202402240000
128/136 Test #2075: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_fcst_202112201800 ..............   Passed  889.09 sec
129/136 Test #2046: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmanlfinal_202402240000 ...........   Passed  155.83 sec
        Start 2047: test_gdasapp_C96C48_ufs_hybatmDA_gdas_sfcanl_202402240000
        Start 2048: test_gdasapp_C96C48_ufs_hybatmDA_gdas_analcalc_fv3jedi_202402240000
130/136 Test #2047: test_gdasapp_C96C48_ufs_hybatmDA_gdas_sfcanl_202402240000 ................   Passed   62.18 sec
        Start 2049: test_gdasapp_C96C48_ufs_hybatmDA_gdas_fcst_202402240000
131/136 Test #2054: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlfinal_202402240000 ....   Passed  242.53 sec
        Start 2055: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_ecen_fv3jedi_202402240000
        Start 2056: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_esfc_202402240000
132/136 Test #2048: test_gdasapp_C96C48_ufs_hybatmDA_gdas_analcalc_fv3jedi_202402240000 ......   Passed  120.70 sec
133/136 Test #2055: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_ecen_fv3jedi_202402240000 ......   Passed   91.12 sec
134/136 Test #2056: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_esfc_202402240000 ..............   Passed  149.84 sec
        Start 2057: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_fcst_202402240000
135/136 Test #2049: test_gdasapp_C96C48_ufs_hybatmDA_gdas_fcst_202402240000 ..................   Passed  454.74 sec
136/136 Test #2057: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_fcst_202402240000 ..............   Passed  763.67 sec

100% tests passed, 0 tests failed out of 136

Label Time Summary:
gdas-utils    =  11.62 sec*proc (15 tests)
gdasapp       = 27259.39 sec*proc (103 tests)
script        = 27271.01 sec*proc (118 tests)

Total Test time (real) = 4900.92 sec

WCOSS2 g-w CI
Install same package on Cactus. Run g-w CI. All cases successfully run to completion

/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48_ATM_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Apr 22 2025 20:21:31    Apr 22 2025 21:35:33
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48mx500_3DVarAOWCDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Apr 22 2025 20:21:34    Apr 22 2025 20:40:51
202103250000        Done    Apr 22 2025 20:21:34    Apr 22 2025 22:50:40
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48mx500_hybAOWCDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Apr 22 2025 20:21:36    Apr 22 2025 20:40:59
202103250000        Done    Apr 22 2025 20:21:36    Apr 22 2025 21:50:56
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48_S2SWA_gefs_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Apr 22 2025 20:21:39    Apr 22 2025 22:05:45
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48_S2SW_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Apr 22 2025 20:21:42    Apr 22 2025 21:41:07
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96_atm3DVar_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Apr 22 2025 20:21:45    Apr 22 2025 20:41:20
202112210000        Done    Apr 22 2025 20:21:45    Apr 22 2025 23:20:56
202112210600        Done    Apr 22 2025 20:21:45    Apr 22 2025 22:50:50
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96C48_hybatmaerosnowDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Apr 22 2025 20:21:47    Apr 22 2025 20:46:22
202112201800        Done    Apr 22 2025 20:21:47    Apr 22 2025 23:15:48
202112210000        Done    Apr 22 2025 20:21:47    Apr 22 2025 23:05:46
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96C48_hybatmDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Apr 22 2025 20:21:50    Apr 22 2025 20:41:33
202112210000        Done    Apr 22 2025 20:21:50    Apr 22 2025 22:50:57
202112210600        Done    Apr 22 2025 20:21:50    Apr 22 2025 22:50:57
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96C48_ufs_hybatmDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202402231800        Done    Apr 22 2025 20:21:52    Apr 22 2025 20:41:38
202402240000        Done    Apr 22 2025 20:21:52    Apr 22 2025 23:35:47
202402240600        Done    Apr 22 2025 20:21:52    Apr 22 2025 23:35:47
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96mx100_S2S_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
199405010000        Done    Apr 22 2025 20:21:54    Apr 22 2025 22:06:08

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

This PR is ready for re-review. Once the PR is merged into GDASApp develop, the sorc/gdas.cd hash in g-w PR #3587 will be pointed to the updated GDASApp develop.

@RussTreadon-NOAA RussTreadon-NOAA changed the title Update JEDI hashes (20250421) Update JEDI hashes (20250423) Apr 23, 2025
@RussTreadon-NOAA RussTreadon-NOAA merged commit 03c10c2 into develop Apr 23, 2025
5 checks passed
@RussTreadon-NOAA RussTreadon-NOAA deleted the feature/stable-nightly branch April 23, 2025 20:56
@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

Thank you @CoryMartin-NOAA for the approval!

jspsl pushed a commit to NOAA-PSL/GDASApp that referenced this pull request Apr 30, 2025
DavidNew-NOAA pushed a commit that referenced this pull request Jan 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

GDASApp atmosphere variational DA ctests are broken

3 participants