Skip to content

Enables user toggling of GDASApp g-w ctests#3587

Merged
DavidHuber-NOAA merged 16 commits into
NOAA-EMC:developfrom
RussTreadon-NOAA:bugfix/gdasapp_gwtests
Apr 28, 2025
Merged

Enables user toggling of GDASApp g-w ctests#3587
DavidHuber-NOAA merged 16 commits into
NOAA-EMC:developfrom
RussTreadon-NOAA:bugfix/gdasapp_gwtests

Conversation

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor

@RussTreadon-NOAA RussTreadon-NOAA commented Apr 15, 2025 •
edited
Loading

Description

This PR allows users to toggle on/off creation of g-w based CI tests when building GDASApp. Setting WORKFLOW_TESTS=ON in the user environment turns on the creation of g-w based CI tests when building GDASApp. WORKFLOW_TESTS=OFF is the default.

Resolves #3579
Resolves #3593
Resolves #3595
Resolves #3338

Type of change

  • Bug fix (fixes something broken)

Change characteristics

  • Is this a breaking change (a change in existing functionality)? NO
  • Does this change require a documentation update? NO
  • Does this change require an update to any of the following submodules? YES

How has this been tested?

Clone, build, and run GDASApp 136 ctests on Hera and Hercules

Checklist

  • Any dependent changes have been merged and published
  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • New and existing tests pass with my changes
  • This change is covered by an existing CI test or a new one has been added

@RussTreadon-NOAA RussTreadon-NOAA self-assigned this Apr 15, 2025
@DavidNew-NOAA DavidNew-NOAA added the JEDI Feature development to support JEDI-based DA label Apr 15, 2025
@RussTreadon-NOAA RussTreadon-NOAA mentioned this pull request Apr 15, 2025
Merged
6 tasks
@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

RussTreadon-NOAA commented Apr 15, 2025

GDASApp PR #1615 has been merged into develop. The sorc/gdas.cd hash was updated to the new GDASApp develop. Done at bd1cf41.

This PR is ready for review.

@RussTreadon-NOAA RussTreadon-NOAA marked this pull request as ready for review April 15, 2025 20:25
KateFriedman-NOAA
KateFriedman-NOAA previously approved these changes Apr 16, 2025
View reviewed changes
Copy link
Copy Markdown
Contributor

@KateFriedman-NOAA KateFriedman-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good but question, how would a user specify WORKFLOW_BUILD or WORKFLOW_TESTS to override the build_gdas.sh defaults?

@KateFriedman-NOAA
Copy link
Copy Markdown
Contributor

KateFriedman-NOAA commented Apr 16, 2025

@RussTreadon-NOAA I am the only g-w CM available to approve and merge this week. Would you like either Rahul or Dave to review this before I run CI and potentially merge this?

Also, I just merged a couple PRs into develop so please sync your branch with develop...then CI can be run on this. Thanks!

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

RussTreadon-NOAA commented Apr 16, 2025

@KateFriedman-NOAA , thank you contacting me. I've been running CI for this PR on my own to identify & fix issues. There are some related threads it would be good to get closure on (e.g., g-w issue #3593) before we run the official CI on this PR

@KateFriedman-NOAA
Copy link
Copy Markdown
Contributor

KateFriedman-NOAA commented Apr 16, 2025

@RussTreadon-NOAA Sounds good, let me know when you're ready for official CI to run on this.

This was referenced Apr 17, 2025
Closed
Closed
@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

RussTreadon-NOAA commented Apr 17, 2025

GDASApp g-w CI

GDASApp ctests run subset of jobs from g-w CI cases. Install RussTreadon-NOAA:bugfix/gdasapp_gwtests at 4e33848 on Hera, Hercules, and Orion. Run GDASApp ctests. 136 out of 136 ctests pass. For example, below is GDASApp ctest output from Hercules

Test project /work/noaa/da/rtreadon/git/global-workflow/stable-nightly/sorc/gdas.cd/build
        Start 2021: test_gdasapp_C96C48_ufs_hybatmDA
        Start 2045: test_gdasapp_C96C48_hybatmaerosnowDA
        Start 2002: test_gdasapp_C96C48_hybatmDA
        Start 2080: test_gdasapp_C48mx500_hybAOWCDA
        Start 2070: test_gdasapp_C48mx500_3DVarAOWCDA
        Start 2095: test_gdasapp_setup_atm_jjob_cycled_exp
        Start 1609: test_gdasapp_util_prepdata
        Start 2000: test_gdasapp_snow_letkfoi_snowda
        Start 2108: test_gdasapp_bufr2ioda_insitu_profile_argo
        Start 2111: test_gdasapp_bufr2ioda_insitu_profile_tesac
        Start 2109: test_gdasapp_bufr2ioda_insitu_profile_bathy
        Start 2110: test_gdasapp_bufr2ioda_insitu_profile_glider
  1/136 Test #1609: test_gdasapp_util_prepdata ...............................................   Passed    4.49 sec
        Start 1997: test_gdasapp_snow_create_ens
  2/136 Test #2095: test_gdasapp_setup_atm_jjob_cycled_exp ...................................   Passed    8.32 sec
        Start 2100: test_gdasapp_atm_jjob_ens_init
  3/136 Test #1997: test_gdasapp_snow_create_ens .............................................   Passed    7.08 sec
        Start 2096: test_gdasapp_atm_jjob_var_init
  4/136 Test #2070: test_gdasapp_C48mx500_3DVarAOWCDA ........................................   Passed   27.22 sec
        Start 2071: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_stage_ic_202103241800
  5/136 Test #2080: test_gdasapp_C48mx500_hybAOWCDA ..........................................   Passed   32.36 sec
        Start 2081: test_gdasapp_C48mx500_hybAOWCDA_gdas_stage_ic_202103241800
  6/136 Test #2002: test_gdasapp_C96C48_hybatmDA .............................................   Passed   33.08 sec
        Start 2003: test_gdasapp_C96C48_hybatmDA_gdas_stage_ic_202112201800
  7/136 Test #2021: test_gdasapp_C96C48_ufs_hybatmDA .........................................   Passed   33.74 sec
        Start 2022: test_gdasapp_C96C48_ufs_hybatmDA_gdas_stage_ic_202402231800
  8/136 Test #2045: test_gdasapp_C96C48_hybatmaerosnowDA .....................................   Passed   35.56 sec
        Start 2025: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_stage_ic_202402231800
  9/136 Test #2000: test_gdasapp_snow_letkfoi_snowda .........................................   Passed   49.08 sec
        Start 2046: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_stage_ic_202112201200
 10/136 Test #2110: test_gdasapp_bufr2ioda_insitu_profile_glider .............................   Passed   64.67 sec
        Start 2006: test_gdasapp_C96C48_hybatmDA_enkfgdas_stage_ic_202112201800
 11/136 Test #2109: test_gdasapp_bufr2ioda_insitu_profile_bathy ..............................   Passed   64.69 sec
        Start 2050: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_stage_ic_202112201200
 12/136 Test #2111: test_gdasapp_bufr2ioda_insitu_profile_tesac ..............................   Passed   65.56 sec
        Start 2083: test_gdasapp_C48mx500_hybAOWCDA_enkfgdas_stage_ic_202103241800
 13/136 Test #2108: test_gdasapp_bufr2ioda_insitu_profile_argo ...............................   Passed   66.09 sec
        Start 2072: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_waveinit_202103241800
 14/136 Test #2025: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_stage_ic_202402231800 ..........   Passed   38.38 sec
        Start 2026: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_fcst_202402231800
 15/136 Test #2046: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_stage_ic_202112201200 ..........   Passed   27.52 sec
        Start 2047: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_fcst_202112201200
 16/136 Test #2071: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_stage_ic_202103241800 .............   Passed   52.57 sec
        Start 2073: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_fcst_202103241800
 17/136 Test #2081: test_gdasapp_C48mx500_hybAOWCDA_gdas_stage_ic_202103241800 ...............   Passed   50.60 sec
        Start 2082: test_gdasapp_C48mx500_hybAOWCDA_gdas_fcst_202103241800
 18/136 Test #2003: test_gdasapp_C96C48_hybatmDA_gdas_stage_ic_202112201800 ..................   Passed   51.04 sec
        Start 2004: test_gdasapp_C96C48_hybatmDA_gdas_fcst_202112201800
 19/136 Test #2022: test_gdasapp_C96C48_ufs_hybatmDA_gdas_stage_ic_202402231800 ..............   Passed   50.99 sec
        Start 2023: test_gdasapp_C96C48_ufs_hybatmDA_gdas_fcst_202402231800
 20/136 Test #2100: test_gdasapp_atm_jjob_ens_init ...........................................   Passed   76.61 sec
        Start 2101: test_gdasapp_atm_jjob_ens_letkf
 21/136 Test #2050: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_stage_ic_202112201200 ......   Passed   26.18 sec
        Start 2051: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_fcst_202112201200
 22/136 Test #2006: test_gdasapp_C96C48_hybatmDA_enkfgdas_stage_ic_202112201800 ..............   Passed   26.53 sec
        Start 2007: test_gdasapp_C96C48_hybatmDA_enkfgdas_fcst_202112201800
 23/136 Test #2096: test_gdasapp_atm_jjob_var_init ...........................................   Passed   80.19 sec
        Start 2097: test_gdasapp_atm_jjob_var_run
 24/136 Test #2083: test_gdasapp_C48mx500_hybAOWCDA_enkfgdas_stage_ic_202103241800 ...........   Passed   26.19 sec
        Start 2084: test_gdasapp_C48mx500_hybAOWCDA_enkfgdas_fcst_202103241800
 25/136 Test #2072: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_waveinit_202103241800 .............   Passed   39.25 sec
        Start 1998: test_gdasapp_snow_imsproc
 26/136 Test #1998: test_gdasapp_snow_imsproc ................................................   Passed    2.76 sec
        Start 1995: test_gdasapp_check_python_norms
 27/136 Test #1995: test_gdasapp_check_python_norms ..........................................   Passed    4.51 sec
        Start 1607: test_gdasapp_util_coding_norms
 28/136 Test #1607: test_gdasapp_util_coding_norms ...........................................   Passed    2.72 sec
        Start 1612: test_gdasapp_util_rtofstmp
 29/136 Test #1612: test_gdasapp_util_rtofstmp ...............................................   Passed    2.34 sec
        Start 1613: test_gdasapp_util_rtofssal
 30/136 Test #1613: test_gdasapp_util_rtofssal ...............................................   Passed    0.43 sec
        Start 2094: test_gdasapp_convert_gsi_satbias
 31/136 Test #2094: test_gdasapp_convert_gsi_satbias .........................................   Passed    4.62 sec
        Start 1999: test_gdasapp_snow_apply_jediincr
 32/136 Test #1999: test_gdasapp_snow_apply_jediincr .........................................   Passed    6.15 sec
        Start 1608: test_gdasapp_util_ioda_example
 33/136 Test #1608: test_gdasapp_util_ioda_example ...........................................   Passed    0.29 sec
        Start 2093: test_gdasapp_convert_bufr_adpsfc
 34/136 Test #2093: test_gdasapp_convert_bufr_adpsfc .........................................   Passed    4.23 sec
        Start 2001: test_gdasapp_convert_bufr_adpsfc_snow
 35/136 Test #2001: test_gdasapp_convert_bufr_adpsfc_snow ....................................   Passed    2.28 sec
        Start 2112: test_gdasapp_bufr2ioda_insitu_profile_tropical
 36/136 Test #2112: test_gdasapp_bufr2ioda_insitu_profile_tropical ...........................   Passed    1.34 sec
        Start 1610: test_gdasapp_util_rads2ioda
 37/136 Test #1610: test_gdasapp_util_rads2ioda ..............................................   Passed    0.13 sec
        Start 1996: test_gdasapp_check_yaml_keys
 38/136 Test #1996: test_gdasapp_check_yaml_keys .............................................   Passed    0.11 sec
        Start 2114: test_gdasapp_bufr2ioda_insitu_surface_drifter
 39/136 Test #2114: test_gdasapp_bufr2ioda_insitu_surface_drifter ............................   Passed    1.03 sec
        Start 2115: test_gdasapp_bufr2ioda_insitu_surface_trkob
 40/136 Test #2115: test_gdasapp_bufr2ioda_insitu_surface_trkob ..............................   Passed    0.95 sec
        Start 2113: test_gdasapp_bufr2ioda_insitu_profile_xbtctd
 41/136 Test #2113: test_gdasapp_bufr2ioda_insitu_profile_xbtctd .............................   Passed    0.95 sec
        Start 2107: test_gdasapp_aero_gen_3dvar_yaml
 42/136 Test #2107: test_gdasapp_aero_gen_3dvar_yaml .........................................   Passed    0.37 sec
        Start 1615: test_gdasapp_util_smos2ioda
 43/136 Test #1615: test_gdasapp_util_smos2ioda ..............................................   Passed    0.13 sec
        Start 1616: test_gdasapp_util_viirsaod2ioda
 44/136 Test #1616: test_gdasapp_util_viirsaod2ioda ..........................................   Passed    0.09 sec
        Start 1617: test_gdasapp_util_icecabi2ioda
 45/136 Test #1617: test_gdasapp_util_icecabi2ioda ...........................................   Passed    0.11 sec
        Start 1620: test_gdasapp_util_icecjpssrr2ioda
 46/136 Test #1620: test_gdasapp_util_icecjpssrr2ioda ........................................   Passed    0.09 sec
        Start 1621: test_gdasapp_util_insituall2ioda
 47/136 Test #1621: test_gdasapp_util_insituall2ioda .........................................   Passed    0.11 sec
        Start 1611: test_gdasapp_util_ghrsst2ioda
 48/136 Test #1611: test_gdasapp_util_ghrsst2ioda ............................................   Passed    0.10 sec
        Start 1614: test_gdasapp_util_smap2ioda
 49/136 Test #1614: test_gdasapp_util_smap2ioda ..............................................   Passed    0.10 sec
        Start 1619: test_gdasapp_util_icecmirs2ioda
 50/136 Test #1619: test_gdasapp_util_icecmirs2ioda ..........................................   Passed    0.09 sec
        Start 1618: test_gdasapp_util_icecamsr2ioda
 51/136 Test #1618: test_gdasapp_util_icecamsr2ioda ..........................................   Passed    0.11 sec
 52/136 Test #2097: test_gdasapp_atm_jjob_var_run ............................................   Passed   74.18 sec
        Start 2098: test_gdasapp_atm_jjob_var_inc
 53/136 Test #2098: test_gdasapp_atm_jjob_var_inc ............................................   Passed   74.16 sec
        Start 2099: test_gdasapp_atm_jjob_var_final
 54/136 Test #2099: test_gdasapp_atm_jjob_var_final ..........................................   Passed   42.16 sec
 55/136 Test #2051: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_fcst_202112201200 ..........   Passed  261.53 sec
        Start 2053: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_epmn_202112201200
 56/136 Test #2026: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_fcst_202402231800 ..............   Passed  282.15 sec
        Start 2027: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_epmn_202402231800
 57/136 Test #2007: test_gdasapp_C96C48_hybatmDA_enkfgdas_fcst_202112201800 ..................   Passed  267.99 sec
        Start 2009: test_gdasapp_C96C48_hybatmDA_enkfgdas_epmn_202112201800
 58/136 Test #2053: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_epmn_202112201200 ..........   Passed   58.23 sec
 59/136 Test #2027: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_epmn_202402231800 ..............   Passed   58.32 sec
 60/136 Test #2009: test_gdasapp_C96C48_hybatmDA_enkfgdas_epmn_202112201800 ..................   Passed   57.14 sec
 61/136 Test #2082: test_gdasapp_C48mx500_hybAOWCDA_gdas_fcst_202103241800 ...................   Passed  335.11 sec
        Start 2085: test_gdasapp_C48mx500_hybAOWCDA_gdas_prepoceanobs_202103250000
 62/136 Test #2004: test_gdasapp_C96C48_hybatmDA_gdas_fcst_202112201800 ......................   Passed  336.99 sec
        Start 2005: test_gdasapp_C96C48_hybatmDA_gdas_atmos_prod_202112201800
        Start 2008: test_gdasapp_C96C48_hybatmDA_enkfgdas_echgres_202112201800
 63/136 Test #2023: test_gdasapp_C96C48_ufs_hybatmDA_gdas_fcst_202402231800 ..................   Passed  345.78 sec
        Start 2024: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmos_prod_202402231800
 64/136 Test #2073: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_fcst_202103241800 .................   Passed  350.95 sec
        Start 2074: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_prepoceanobs_202103250000
        Start 2075: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marinebmat_202103250000
 65/136 Test #2084: test_gdasapp_C48mx500_hybAOWCDA_enkfgdas_fcst_202103241800 ...............   Passed  351.46 sec
        Start 2086: test_gdasapp_C48mx500_hybAOWCDA_gdas_marinebmat_202103250000
 66/136 Test #2008: test_gdasapp_C96C48_hybatmDA_enkfgdas_echgres_202112201800 ...............   Passed   38.85 sec
 67/136 Test #2005: test_gdasapp_C96C48_hybatmDA_gdas_atmos_prod_202112201800 ................   Passed   86.14 sec
        Start 2010: test_gdasapp_C96C48_hybatmDA_gdas_prep_202112210000
 68/136 Test #2024: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmos_prod_202402231800 ............   Passed   87.28 sec
        Start 2028: test_gdasapp_C96C48_ufs_hybatmDA_gdas_prep_202402240000
 69/136 Test #2075: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marinebmat_202103250000 ...........   Passed  112.35 sec
 70/136 Test #2086: test_gdasapp_C48mx500_hybAOWCDA_gdas_marinebmat_202103250000 .............   Passed  107.99 sec
 71/136 Test #2047: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_fcst_202112201200 ..............   Passed  515.51 sec
        Start 2048: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_atmos_prod_202112201200
        Start 2049: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_aeroanlgenb_202112201200
        Start 2052: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_echgres_202112201200
 72/136 Test #2101: test_gdasapp_atm_jjob_ens_letkf ..........................................   Passed  522.23 sec
        Start 2102: test_gdasapp_atm_jjob_ens_init_split
 73/136 Test #2052: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_echgres_202112201200 .......   Passed   39.68 sec
 74/136 Test #2102: test_gdasapp_atm_jjob_ens_init_split .....................................   Passed   44.55 sec
        Start 2103: test_gdasapp_atm_jjob_ens_obs
 75/136 Test #2074: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_prepoceanobs_202103250000 .........   Passed  224.78 sec
        Start 2076: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marineanlinit_202103250000
 76/136 Test #2010: test_gdasapp_C96C48_hybatmDA_gdas_prep_202112210000 ......................   Passed  155.97 sec
        Start 2011: test_gdasapp_C96C48_hybatmDA_gdas_anal_202112210000
        Start 2015: test_gdasapp_C96C48_hybatmDA_enkfgdas_eobs_202112210000
 77/136 Test #2085: test_gdasapp_C48mx500_hybAOWCDA_gdas_prepoceanobs_202103250000 ...........   Passed  248.51 sec
        Start 2088: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlinit_202103250000
        Start 2087: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlletkf_202103250000
 78/136 Test #2048: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_atmos_prod_202112201200 ........   Passed   86.71 sec
        Start 2054: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_prep_202112201800
 79/136 Test #2103: test_gdasapp_atm_jjob_ens_obs ............................................   Passed   42.18 sec
        Start 2104: test_gdasapp_atm_jjob_ens_sol
 80/136 Test #2028: test_gdasapp_C96C48_ufs_hybatmDA_gdas_prep_202402240000 ..................   Passed  180.51 sec
        Start 2029: test_gdasapp_C96C48_ufs_hybatmDA_gdas_prepatmiodaobs_202402240000
 81/136 Test #2076: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marineanlinit_202103250000 ........   Passed   56.09 sec
        Start 2077: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marineanlvar_202103250000
 82/136 Test #2088: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlinit_202103250000 ..........   Passed   49.44 sec
        Start 2089: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlvar_202103250000
 83/136 Test #2104: test_gdasapp_atm_jjob_ens_sol ............................................   Passed   42.16 sec
        Start 2105: test_gdasapp_atm_jjob_ens_inc
 84/136 Test #2049: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_aeroanlgenb_202112201200 .......   Passed  147.58 sec
 85/136 Test #2089: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlvar_202103250000 ...........   Passed   61.28 sec
        Start 2091: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlchkpt_202103250000
 86/136 Test #2105: test_gdasapp_atm_jjob_ens_inc ............................................   Passed   74.18 sec
        Start 2106: test_gdasapp_atm_jjob_ens_final
 87/136 Test #2077: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marineanlvar_202103250000 .........   Passed   99.25 sec
        Start 2078: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marineanlchkpt_202103250000
 88/136 Test #2091: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlchkpt_202103250000 .........   Passed   54.60 sec
        Start 2092: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlfinal_202103250000
 89/136 Test #2087: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlletkf_202103250000 .........   Passed  166.06 sec
        Start 2090: test_gdasapp_C48mx500_hybAOWCDA_gdas_ocnanalecen_202103250000
 90/136 Test #2054: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_prep_202112201800 ..............   Passed  156.75 sec
        Start 2055: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_anal_202112201800
        Start 2063: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_eobs_202112201800
        Start 2059: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_snowanl_202112201800
        Start 2056: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_aeroanlinit_202112201800
 91/136 Test #2106: test_gdasapp_atm_jjob_ens_final ..........................................   Passed   42.16 sec
 92/136 Test #2078: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marineanlchkpt_202103250000 .......   Passed   51.06 sec
        Start 2079: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marineanlfinal_202103250000
 93/136 Test #2092: test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlfinal_202103250000 .........   Passed   48.99 sec
 94/136 Test #2056: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_aeroanlinit_202112201800 .......   Passed   60.09 sec
        Start 2057: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_aeroanlvar_202112201800
 95/136 Test #2090: test_gdasapp_C48mx500_hybAOWCDA_gdas_ocnanalecen_202103250000 ............   Passed   84.78 sec
 96/136 Test #2079: test_gdasapp_C48mx500_3DVarAOWCDA_gdas_marineanlfinal_202103250000 .......   Passed   63.16 sec
 97/136 Test #2059: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_snowanl_202112201800 ...........   Passed  108.65 sec
        Start 2067: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_esnowanl_202112201800
 98/136 Test #2067: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_esnowanl_202112201800 ......   Passed   85.76 sec
 99/136 Test #2015: test_gdasapp_C96C48_hybatmDA_enkfgdas_eobs_202112210000 ..................   Passed  436.80 sec
        Start 2016: test_gdasapp_C96C48_hybatmDA_enkfgdas_ediag_202112210000
100/136 Test #2029: test_gdasapp_C96C48_ufs_hybatmDA_gdas_prepatmiodaobs_202402240000 ........   Passed  407.27 sec
        Start 2030: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmanlinit_202402240000
        Start 2037: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlinit_202402240000
101/136 Test #2037: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlinit_202402240000 .....   Passed   60.62 sec
        Start 2038: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlobs_202402240000
102/136 Test #2030: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmanlinit_202402240000 ............   Passed   60.92 sec
        Start 2031: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmanlvar_202402240000
103/136 Test #2057: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_aeroanlvar_202112201800 ........   Passed  322.91 sec
        Start 2058: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_aeroanlfinal_202112201800
104/136 Test #2063: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_eobs_202112201800 ..........   Passed  411.83 sec
        Start 2064: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_ediag_202112201800
105/136 Test #2016: test_gdasapp_C96C48_hybatmDA_enkfgdas_ediag_202112210000 .................   Passed  157.15 sec
        Start 2017: test_gdasapp_C96C48_hybatmDA_enkfgdas_eupd_202112210000
106/136 Test #2058: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_aeroanlfinal_202112201800 ......   Passed   50.56 sec
107/136 Test #2064: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_ediag_202112201800 .........   Passed  146.38 sec
        Start 2065: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_eupd_202112201800
108/136 Test #2011: test_gdasapp_C96C48_hybatmDA_gdas_anal_202112210000 ......................   Passed  749.52 sec
        Start 2012: test_gdasapp_C96C48_hybatmDA_gdas_sfcanl_202112210000
109/136 Test #2017: test_gdasapp_C96C48_hybatmDA_enkfgdas_eupd_202112210000 ..................   Passed  161.69 sec
110/136 Test #2012: test_gdasapp_C96C48_hybatmDA_gdas_sfcanl_202112210000 ....................   Passed   49.88 sec
        Start 2013: test_gdasapp_C96C48_hybatmDA_gdas_analcalc_202112210000
        Start 2014: test_gdasapp_C96C48_hybatmDA_gdas_fcst_202112210000
111/136 Test #2065: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_eupd_202112201800 ..........   Passed  133.37 sec
112/136 Test #2013: test_gdasapp_C96C48_hybatmDA_gdas_analcalc_202112210000 ..................   Passed   83.46 sec
        Start 2019: test_gdasapp_C96C48_hybatmDA_enkfgdas_esfc_202112210000
        Start 2018: test_gdasapp_C96C48_hybatmDA_enkfgdas_ecmn_202112210000
113/136 Test #2018: test_gdasapp_C96C48_hybatmDA_enkfgdas_ecmn_202112210000 ..................   Passed   57.30 sec
114/136 Test #2019: test_gdasapp_C96C48_hybatmDA_enkfgdas_esfc_202112210000 ..................   Passed  132.11 sec
        Start 2020: test_gdasapp_C96C48_hybatmDA_enkfgdas_fcst_202112210000
115/136 Test #2038: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlobs_202402240000 ......   Passed  521.86 sec
        Start 2039: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlsol_202402240000
116/136 Test #2055: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_anal_202112201800 ..............   Passed  871.43 sec
        Start 2060: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_sfcanl_202112201800
117/136 Test #2060: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_sfcanl_202112201800 ............   Passed   50.45 sec
        Start 2061: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_analcalc_202112201800
        Start 2062: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_fcst_202112201800
118/136 Test #2039: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlsol_202402240000 ......   Passed   78.23 sec
        Start 2040: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlfv3inc_202402240000
119/136 Test #2040: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlfv3inc_202402240000 ...   Passed   50.31 sec
        Start 2041: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlfinal_202402240000
120/136 Test #2061: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_analcalc_202112201800 ..........   Passed   71.94 sec
        Start 2068: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_esfc_202112201800
        Start 2066: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_ecmn_202112201800
121/136 Test #2014: test_gdasapp_C96C48_hybatmDA_gdas_fcst_202112210000 ......................   Passed  402.86 sec
122/136 Test #2066: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_ecmn_202112201800 ..........   Passed   44.37 sec
123/136 Test #2068: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_esfc_202112201800 ..........   Passed  137.62 sec
        Start 2069: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_fcst_202112201800
124/136 Test #2020: test_gdasapp_C96C48_hybatmDA_enkfgdas_fcst_202112210000 ..................   Passed  330.77 sec
125/136 Test #2041: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_atmensanlfinal_202402240000 ....   Passed  237.89 sec
        Start 2043: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_esfc_202402240000
126/136 Test #2043: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_esfc_202402240000 ..............   Passed  133.16 sec
127/136 Test #2031: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmanlvar_202402240000 .............   Passed  1052.73 sec
        Start 2032: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmanlfv3inc_202402240000
128/136 Test #2032: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmanlfv3inc_202402240000 ..........   Passed   50.20 sec
        Start 2033: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmanlfinal_202402240000
129/136 Test #2069: test_gdasapp_C96C48_hybatmaerosnowDA_enkfgdas_fcst_202112201800 ..........   Passed  319.24 sec
130/136 Test #2062: test_gdasapp_C96C48_hybatmaerosnowDA_gdas_fcst_202112201800 ..............   Passed  628.50 sec
131/136 Test #2033: test_gdasapp_C96C48_ufs_hybatmDA_gdas_atmanlfinal_202402240000 ...........   Passed  232.85 sec
        Start 2035: test_gdasapp_C96C48_ufs_hybatmDA_gdas_analcalc_fv3jedi_202402240000
        Start 2042: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_ecen_fv3jedi_202402240000
        Start 2034: test_gdasapp_C96C48_ufs_hybatmDA_gdas_sfcanl_202402240000
132/136 Test #2034: test_gdasapp_C96C48_ufs_hybatmDA_gdas_sfcanl_202402240000 ................   Passed   37.57 sec
        Start 2036: test_gdasapp_C96C48_ufs_hybatmDA_gdas_fcst_202402240000
133/136 Test #2035: test_gdasapp_C96C48_ufs_hybatmDA_gdas_analcalc_fv3jedi_202402240000 ......   Passed   62.64 sec
134/136 Test #2042: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_ecen_fv3jedi_202402240000 ......   Passed  131.86 sec
        Start 2044: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_fcst_202402240000
135/136 Test #2036: test_gdasapp_C96C48_ufs_hybatmDA_gdas_fcst_202402240000 ..................   Passed  347.00 sec
136/136 Test #2044: test_gdasapp_C96C48_ufs_hybatmDA_enkfgdas_fcst_202402240000 ..............   Passed  281.96 sec

100% tests passed, 0 tests failed out of 136

Label Time Summary:
gdas-utils    =  11.32 sec*proc (15 tests)
gdasapp       = 17055.04 sec*proc (103 tests)
script        = 17066.35 sec*proc (118 tests)

Total Test time (real) = 2920.70 sec

@RussTreadon-NOAA RussTreadon-NOAA mentioned this pull request Apr 18, 2025
Closed
guillaumevernieres
guillaumevernieres previously approved these changes Apr 18, 2025
View reviewed changes
Copy link
Copy Markdown
Contributor

@guillaumevernieres guillaumevernieres left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @RussTreadon-NOAA

@emcbot emcbot added the CI-Hercules-Failed **Bot use only** CI testing on Hercules for this PR has failed label Apr 24, 2025
@emcbot
Copy link
Copy Markdown

emcbot commented Apr 24, 2025

CI Failed on Hercules in Build# 3
Built and ran in directory /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/CI/3587


Experiment C96mx100_S2S_d420c8c8 Terminated with  tasks failed and  dead at Thu Apr 24 14:38:53 CDT 2025
Experiment C96mx100_S2S_d420c8c8 Terminated: **
Experiment C48_S2SWA_gefs_d420c8c8 Terminated with  tasks failed and  dead at Thu Apr 24 14:39:06 CDT 2025
Experiment C48_S2SWA_gefs_d420c8c8 Terminated: **

@emcbot emcbot added CI-Gaeac6-Running CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress CI-Gaeac6-Passed **Bot use only** CI testing on Gaea C6 for this PR has completed successfully and removed CI-Gaeac6-Building **Bot use only** CI testing is cloning/building on Gaea C6 CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera CI-Gaeac6-Running labels Apr 24, 2025
@emcbot
Copy link
Copy Markdown

emcbot commented Apr 24, 2025

CI Passed on Gaeac6 in Build# 4
Built and ran in directory /gpfs/f6/drsa-precip3/world-shared/global/CI/3587


Experiment C48_ATM_d34ed055 Completed 1 Cycles: *SUCCESS* at Thu 24 Apr 2025 05:20:47 PM EDT
Experiment C48_S2SW_d34ed055 Completed 1 Cycles: *SUCCESS* at Thu 24 Apr 2025 05:20:48 PM EDT
Experiment C48mx500_hybAOWCDA_d34ed055 Completed 2 Cycles: *SUCCESS* at Thu 24 Apr 2025 05:39:15 PM EDT
Experiment C48_S2SWA_gefs_d34ed055 Completed 1 Cycles: *SUCCESS* at Thu 24 Apr 2025 05:51:35 PM EDT
Experiment C48mx500_3DVarAOWCDA_d34ed055 Completed 2 Cycles: *SUCCESS* at Thu 24 Apr 2025 06:03:44 PM EDT
Experiment C96_atm3DVar_d34ed055 Completed 3 Cycles: *SUCCESS* at Thu 24 Apr 2025 06:27:42 PM EDT
Experiment C96C48_hybatmaerosnowDA_d34ed055 Completed 3 Cycles: *SUCCESS* at Thu 24 Apr 2025 06:40:13 PM EDT
Experiment C96C48_hybatmDA_d34ed055 Completed 3 Cycles: *SUCCESS* at Thu 24 Apr 2025 06:52:31 PM EDT

@emcbot emcbot added CI-Hera-Passed **Bot use only** CI testing on Hera for this PR has completed successfully and removed CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress labels Apr 25, 2025
@emcbot
Copy link
Copy Markdown

emcbot commented Apr 25, 2025

CI Passed on Hera in Build# 5
Built and ran in directory /scratch1/NCEPDEV/global/glopara/CI/3587


Experiment C48_ATM_d34ed055 Completed 1 Cycles: *SUCCESS* at Fri Apr 25 00:58:15 UTC 2025
Experiment C96mx100_S2S_d34ed055 Completed 1 Cycles: *SUCCESS* at Fri Apr 25 01:16:32 UTC 2025
Experiment C48mx500_hybAOWCDA_d34ed055 Completed 2 Cycles: *SUCCESS* at Fri Apr 25 01:22:37 UTC 2025
Experiment C48_S2SW_d34ed055 Completed 1 Cycles: *SUCCESS* at Fri Apr 25 01:28:46 UTC 2025
Experiment C48mx500_3DVarAOWCDA_d34ed055 Completed 2 Cycles: *SUCCESS* at Fri Apr 25 01:59:24 UTC 2025
Experiment C96_atm3DVar_d34ed055 Completed 3 Cycles: *SUCCESS* at Fri Apr 25 02:05:21 UTC 2025
Experiment C48_S2SWA_gefs_d34ed055 Completed 1 Cycles: *SUCCESS* at Fri Apr 25 02:24:34 UTC 2025
Experiment C96C48_hybatmDA_d34ed055 Completed 3 Cycles: *SUCCESS* at Fri Apr 25 03:06:18 UTC 2025
Experiment C96C48_hybatmaerosnowDA_d34ed055 Completed 3 Cycles: *SUCCESS* at Fri Apr 25 03:06:38 UTC 2025
Experiment C96C48_ufs_hybatmDA_d34ed055 Completed 3 Cycles: *SUCCESS* at Fri Apr 25 04:31:48 UTC 2025

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

RussTreadon-NOAA commented Apr 25, 2025

Hercules g-w CI

Install RussTreadon-NOAA:bugfix/gdasapp_gwtests at d34ed05 on Hercules. Run g-w CI with the following results

/work2/noaa/stmp/rtreadon/HERCULES/EXPDIR/C48_ATM_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103231200        Done    Apr 25 2025 00:50:39    Apr 25 2025 02:45:03

/work2/noaa/stmp/rtreadon/HERCULES/EXPDIR/C48_S2SW_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103231200        Done    Apr 25 2025 00:50:40    Apr 25 2025 02:55:05

/work2/noaa/stmp/rtreadon/HERCULES/EXPDIR/C48_S2SWA_gefs_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103231200        Done    Apr 25 2025 00:50:41    Apr 25 2025 04:05:06

/work2/noaa/stmp/rtreadon/HERCULES/EXPDIR/C48mx500_3DVarAOWCDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103241800        Done    Apr 25 2025 00:50:42    Apr 25 2025 01:40:08
202103250000        Done    Apr 25 2025 00:50:42    Apr 25 2025 04:25:05

/work2/noaa/stmp/rtreadon/HERCULES/EXPDIR/C48mx500_hybAOWCDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103241800        Done    Apr 25 2025 00:50:43    Apr 25 2025 01:40:09
202103250000        Done    Apr 25 2025 00:50:43    Apr 25 2025 04:25:06

/work2/noaa/stmp/rtreadon/HERCULES/EXPDIR/C96C48_hybatmDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202112201800        Done    Apr 25 2025 00:50:44    Apr 25 2025 01:45:08
202112210000        Done    Apr 25 2025 00:50:44    Apr 25 2025 04:45:07
202112210600        Done    Apr 25 2025 00:50:44    Apr 25 2025 05:40:09

/work2/noaa/stmp/rtreadon/HERCULES/EXPDIR/C96C48_hybatmaerosnowDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202112201200        Done    Apr 25 2025 00:50:45    Apr 25 2025 01:50:11
202112201800        Done    Apr 25 2025 00:50:45    Apr 25 2025 05:30:08
202112210000        Done    Apr 25 2025 00:50:45    Apr 25 2025 05:25:13

/work2/noaa/stmp/rtreadon/HERCULES/EXPDIR/C96C48_ufs_hybatmDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202402231800        Done    Apr 25 2025 00:50:46    Apr 25 2025 01:50:11
202402240000        Done    Apr 25 2025 00:50:46    Apr 25 2025 05:45:09
202402240600        Done    Apr 25 2025 00:50:46    Apr 25 2025 05:50:09

/work2/noaa/stmp/rtreadon/HERCULES/EXPDIR/C96_atm3DVar_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202112201800        Done    Apr 25 2025 00:50:47    Apr 25 2025 01:50:12
202112210000        Done    Apr 25 2025 00:50:47    Apr 25 2025 04:45:10
202112210600        Done    Apr 25 2025 00:50:47    Apr 25 2025 05:15:13

/work2/noaa/stmp/rtreadon/HERCULES/EXPDIR/C96mx100_S2S_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
199405010000        Done    Apr 25 2025 00:50:47    Apr 25 2025 04:00:50

All jobs in all cases ran to completion.

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

RussTreadon-NOAA commented Apr 25, 2025

Check the log files for the role-global Hercules failures

Log file gefs_fcst_mem000_seg0.log in /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/CI/3587/RUNTESTS/COMROOT/C48_S2SWA_gefs_d420c8c8/logs/2021032312/ contains

slurmstepd: error: couldn't chdir to `/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/CI/3587/RUNTESTS/EXPDIR/C48_S2SWA_gefs_d420c8c8': No such file or directory: going to /tmp instead
slurmstepd: error: couldn't chdir to `/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/CI/3587/RUNTESTS/EXPDIR/C48_S2SWA_gefs_d420c8c8': No such file or directory: going to /tmp instead
/var/spool/slurmd/job5177425/slurm_script: line 24: /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/CI/3587/global-workflow/dev/jobs/fcst.sh: No such file or directory

Same message in gefs_fcst_mem001_seg0.log and gefs_fcst_mem002_seg0.log

Log file sfs_fcst_mem000_seg0.log in /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/CI/3587/RUNTESTS/COMROOT/C96mx100_S2S_d420c8c8/logs/1994050100 contains

slurmstepd: error: couldn't chdir to `/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/CI/3587/RUNTESTS/EXPDIR/C96mx100_S2S_d420c8c8': No such file or directory: going to /tmp instead
slurmstepd: error: couldn't chdir to `/work2/noaa/global/role-global/GFS_CI_CD/HERCULES/CI/3587/RUNTESTS/EXPDIR/C96mx100_S2S_d420c8c8': No such file or directory: going to /tmp instead
/var/spool/slurmd/job5177422/slurm_script: line 24: /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/CI/3587/global-workflow/dev/jobs/fcst.sh: No such file or directory

Same message in sfs_fcst_mem001_seg0.log and sfs_fcst_mem002_seg0.log.

These appear to be system and/or automated CI driver errors.

@emcbot emcbot added CI-Wcoss2-Building CI testing is cloning/building on WCOSS2 and removed CI-Wcoss2-Ready PR is ready for CI testing on WCOSS2. labels Apr 25, 2025
@DavidHuber-NOAA
Copy link
Copy Markdown
Contributor

DavidHuber-NOAA commented Apr 25, 2025

@TerrenceMcGuinness-NOAA Could you take a look at the Hercules failure? Based on this message, it seems that perhaps the CI system may have rebooted at some point?? Are we safe to add the label again?

This was referenced Apr 25, 2025
Merged
Closed
@emcbot emcbot added CI-Wcoss2-Running CI testing on WCOSS for this PR is in-progress and removed CI-Wcoss2-Building CI testing is cloning/building on WCOSS2 labels Apr 25, 2025
@emcbot
Copy link
Copy Markdown

emcbot commented Apr 25, 2025

CI Tests set up to run in /lfs/h2/emc/ptmp/emc.global/PR/PR_3587/RUNTESTS on WCOSS

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

RussTreadon-NOAA commented Apr 25, 2025

Orion g-w CI

Install RussTreadon-NOAA:bugfix/gdasapp_gwtests at d34ed05 on Orion. Run g-w CI with the following results

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C48_ATM_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103231200        Done    Apr 25 2025 00:56:42    Apr 25 2025 12:15:04

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C48mx500_3DVarAOWCDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103241800        Done    Apr 25 2025 00:56:44    Apr 25 2025 10:55:11
202103250000        Done    Apr 25 2025 00:56:44    Apr 25 2025 13:10:11

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C48mx500_hybAOWCDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103241800        Done    Apr 25 2025 00:56:45    Apr 25 2025 11:00:13
202103250000        Done    Apr 25 2025 00:56:45    Apr 25 2025 12:40:13

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C48_S2SWA_gefs_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103231200        Done    Apr 25 2025 00:56:47    Apr 25 2025 12:30:07

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C48_S2SW_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202103231200        Done    Apr 25 2025 00:56:49    Apr 25 2025 12:20:09

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C96_atm3DVar_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202112201800        Done    Apr 25 2025 00:56:50    Apr 25 2025 11:00:20
202112210000        Done    Apr 25 2025 00:56:50    Apr 25 2025 14:04:51
202112210600        Done    Apr 25 2025 00:56:50    Apr 25 2025 13:44:00

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C96C48_hybatmaerosnowDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202112201200        Done    Apr 25 2025 00:56:52    Apr 25 2025 11:00:17
202112201800        Done    Apr 25 2025 00:56:52    Apr 25 2025 13:48:06
202112210000        Done    Apr 25 2025 00:56:52    Apr 25 2025 13:40:18

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C96C48_hybatmDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202112201800        Done    Apr 25 2025 00:56:54    Apr 25 2025 11:00:15
202112210000        Done    Apr 25 2025 00:56:54    Apr 25 2025 14:00:15
202112210600        Done    Apr 25 2025 00:56:54    Apr 25 2025 13:20:16

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C96C48_ufs_hybatmDA_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
202402231800        Done    Apr 25 2025 00:56:55    Apr 25 2025 11:00:18
202402240000        Done    Apr 25 2025 00:56:55    Apr 25 2025 14:47:39
202402240600        Done    Apr 25 2025 00:56:55    Apr 25 2025 14:35:16

/work2/noaa/stmp/rtreadon/ORION/EXPDIR/C96mx100_S2S_pr3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED
199405010000        Done    Apr 25 2025 00:56:57    Apr 25 2025 12:40:21

All jobs in all cases ran to completion.

@emcbot
Copy link
Copy Markdown

emcbot commented Apr 26, 2025

CI Passed on Hercules in Build# 7
Built and ran in directory /work2/noaa/global/role-global/GFS_CI_CD/HERCULES/CI/3587


Experiment C48_ATM_d34ed055 Completed 1 Cycles: *SUCCESS* at Sat Apr 26 00:06:11 CDT 2025
Experiment C48_S2SW_d34ed055 Completed 1 Cycles: *SUCCESS* at Sat Apr 26 00:30:35 CDT 2025
Experiment C48mx500_hybAOWCDA_d34ed055 Completed 2 Cycles: *SUCCESS* at Sat Apr 26 00:54:36 CDT 2025
Experiment C96mx100_S2S_d34ed055 Completed 1 Cycles: *SUCCESS* at Sat Apr 26 01:12:49 CDT 2025
Experiment C48mx500_3DVarAOWCDA_d34ed055 Completed 2 Cycles: *SUCCESS* at Sat Apr 26 01:19:00 CDT 2025
Experiment C48_S2SWA_gefs_d34ed055 Completed 1 Cycles: *SUCCESS* at Sat Apr 26 02:56:45 CDT 2025
Experiment C96_atm3DVar_d34ed055 Completed 3 Cycles: *SUCCESS* at Sat Apr 26 03:26:58 CDT 2025
Experiment C96C48_hybatmDA_d34ed055 Completed 3 Cycles: *SUCCESS* at Sat Apr 26 03:51:12 CDT 2025

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

RussTreadon-NOAA commented Apr 28, 2025

WCOSS2 g-w CI

Below are results from emc.global WCOSS2 g-w CI which was initiated on 4/25/2025

/lfs/h2/emc/ptmp/emc.global/PR/PR_3587/RUNTESTS/EXPDIR/C48_ATM_3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Apr 25 2025 13:26:33    Apr 25 2025 14:35:38
 
/lfs/h2/emc/ptmp/emc.global/PR/PR_3587/RUNTESTS/EXPDIR/C48mx500_3DVarAOWCDA_3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Apr 25 2025 13:26:35    Apr 25 2025 13:45:47
202103250000        Done    Apr 25 2025 13:26:35    Apr 25 2025 15:20:30
 
/lfs/h2/emc/ptmp/emc.global/PR/PR_3587/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Apr 25 2025 13:26:37    Apr 25 2025 13:45:51
202103250000        Done    Apr 25 2025 13:26:37    Apr 25 2025 14:50:36
 
/lfs/h2/emc/ptmp/emc.global/PR/PR_3587/RUNTESTS/EXPDIR/C48_S2SWA_gefs_3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Apr 25 2025 13:26:41    Apr 25 2025 14:50:41
 
/lfs/h2/emc/ptmp/emc.global/PR/PR_3587/RUNTESTS/EXPDIR/C48_S2SW_3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Apr 25 2025 13:26:39    Apr 25 2025 14:35:53
 
/lfs/h2/emc/ptmp/emc.global/PR/PR_3587/RUNTESTS/EXPDIR/C96_atm3DVar_extended_3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Apr 25 2025 13:26:43    Apr 25 2025 13:46:05
202112210000        Done    Apr 25 2025 13:26:43    Apr 25 2025 17:55:47
202112210600        Done    Apr 25 2025 13:26:43    Apr 25 2025 18:51:11
202112211200        Done    Apr 25 2025 13:50:46    Apr 25 2025 19:55:55
202112211800        Done    Apr 25 2025 18:01:07    Apr 25 2025 22:50:51
 
/lfs/h2/emc/ptmp/emc.global/PR/PR_3587/RUNTESTS/EXPDIR/C96C48_hybatmaerosnowDA_3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Apr 25 2025 13:26:46    Apr 25 2025 13:50:51
202112201800        Done    Apr 25 2025 13:26:46    Apr 25 2025 15:55:51
202112210000        Done    Apr 25 2025 13:26:46    Apr 25 2025 15:45:47
 
/lfs/h2/emc/ptmp/emc.global/PR/PR_3587/RUNTESTS/EXPDIR/C96C48_hybatmDA_3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Apr 25 2025 13:26:48    Apr 25 2025 13:46:12
202112210000        Done    Apr 25 2025 13:26:48    Apr 25 2025 15:55:55
202112210600        Done    Apr 25 2025 13:26:48    Apr 25 2025 15:45:49
 
/lfs/h2/emc/ptmp/emc.global/PR/PR_3587/RUNTESTS/EXPDIR/C96C48_ufs_hybatmDA_3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202402231800        Done    Apr 25 2025 13:26:49    Apr 25 2025 13:46:16
202402240000        Done    Apr 25 2025 13:26:49    Apr 25 2025 16:30:46
202402240600        Done    Apr 25 2025 13:26:49    Apr 25 2025 16:16:00
 
/lfs/h2/emc/ptmp/emc.global/PR/PR_3587/RUNTESTS/EXPDIR/C96mx100_S2S_3587
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
199405010000        Done    Apr 25 2025 13:26:51    Apr 25 2025 15:01:06

All jobs ran to completion in all cases.

FYI @KateFriedman-NOAA

DavidHuber-NOAA
DavidHuber-NOAA approved these changes Apr 28, 2025
View reviewed changes
Copy link
Copy Markdown
Contributor

@DavidHuber-NOAA DavidHuber-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changes look good. All CI passed. Approve.

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor Author

RussTreadon-NOAA commented Apr 28, 2025

Thank you @DavidHuber-NOAA and @KateFriedman-NOAA for the approvals. Thank you @DavidHuber-NOAA for merging these changes into g-w develop.

@RussTreadon-NOAA RussTreadon-NOAA mentioned this pull request May 2, 2025
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@DavidHuber-NOAA DavidHuber-NOAA DavidHuber-NOAA approved these changes

@CoryMartin-NOAA CoryMartin-NOAA CoryMartin-NOAA left review comments

@aerorahul aerorahul aerorahul left review comments

@guillaumevernieres guillaumevernieres guillaumevernieres left review comments

@WalterKolczynski-NOAA WalterKolczynski-NOAA Awaiting requested review from WalterKolczynski-NOAA

@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA Awaiting requested review from TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA is a code owner

@junwang-noaa junwang-noaa Awaiting requested review from junwang-noaa

+1 more reviewer

@KateFriedman-NOAA KateFriedman-NOAA KateFriedman-NOAA approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

@RussTreadon-NOAA RussTreadon-NOAA

Labels

CI-Gaeac6-Passed **Bot use only** CI testing on Gaea C6 for this PR has completed successfully CI-Hera-Passed **Bot use only** CI testing on Hera for this PR has completed successfully CI-Hercules-Passed **Bot use only** CI testing on Hercules for this PR has completed successfully CI-Wcoss2-Passed CI testing on WCOSS for this PR has completed successfully JEDI Feature development to support JEDI-based DA

Projects

None yet

Milestone

No milestone