Skip to content

JEDI-based ensemble recentering and analysis calculation#3312

Merged
aerorahul merged 124 commits into
NOAA-EMC:developfrom
DavidNew-NOAA:feature/calcanl
Mar 14, 2025
Merged

JEDI-based ensemble recentering and analysis calculation#3312
aerorahul merged 124 commits into
NOAA-EMC:developfrom
DavidNew-NOAA:feature/calcanl

Conversation

@DavidNew-NOAA
Copy link
Copy Markdown
Contributor

@DavidNew-NOAA DavidNew-NOAA commented Feb 10, 2025 •
edited
Loading

Description

COORDINATED MERGE

This PR implements ensemble recentering and analysis calculation in the Global Workflow, using JEDI-based applications to replace certain GSI utilities when JEDI is turned on in the workflow. If using GSI, then the workflow will remain unchanged. This PR also (finally) implements native-grid DA increments into the worflow.

The gdas_analcalc and enkfgdas_ecen jobs will be replaced by gdas_analcalc_fv3jedi and enkfgdas_ecen_fv3jedi jobs respectively. The enkfgdas_echgres job is eliminated, since changing of resolution of the deterministic backgrounds is done internally in the JEDI-based recentering application.

The design for this PR is based on discussions between the DA team and GW team a few months ago. Explanation of the flow of data through the workflow:

The gdas_analcalc_fv3jedi job dependencies do not change. The native-grid backgrounds andincrements are staged, and then the GDASApp JEDI fv3jedi_add_increments application is run to add them and interpolate to the Gaussian grid. The Gaussian-grid backgrounds are also staged, and then a simple Python function inserts to these analysis variables into the histories, which become the Gaussian analyses. This is done this way to guarantee that the resulting Gaussian analyses are in the exact format required by UPP.

The enkfgdas_ecen_fv3jedi no longer depends on the analysis calc job, since the ensemble-resolution variational analysis is computed/interpolated internally in the JEDI-based recentering application. All other job dependencies remain the same. We no longer need to compute the ensemble mean analysis in this job, since it can be outputted the the JEDI local ensemble DA application in the enkfgdas_atmensanlsol job and just staged for recentering. The variational increment and deterministic backgrounds are also staged to compute the ensemble-resolution variational analysis. The output of this job is no longer the recentered ensemble increments, but rather the "correction increment", which when added to ensemble increments becomes the recentered increments. The prefix for the "correction increment" is catminc.

The enkfgdas_fcst job now stages both the ensemble increments and the correction increment. They are added together with ncbo in forecast_postdet.sh to generate the recentered increment.

All forecast increments, both deterministic and ensemble, are now on the native cubed-sphere grid

Resolves #3248

Type of change

  • Bug fix (fixes something broken)
  • New feature (adds functionality)
  • Maintenance (code refactor, clean-up, new CI test, etc.)

Change characteristics

  • Is this a breaking change (a change in existing functionality)? YES
  • Does this change require a documentation update? IDK
  • Does this change require an update to any of the following submodules? YES
    • EMC verif-global
    • GDAS #1488
    • GFS-utils
    • GSI
    • GSI-monitor
    • GSI-utils
    • UFS-utils
    • UFS-weather-model
    • wxflow

How has this been tested?

  • Clone and build on Hera
  • Run C96C48_ufs_hybatmDA

Checklist

  • Any dependent changes have been merged and published
  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have documented my code, including function, input, and output descriptions
  • My changes generate no new warnings
  • New and existing tests pass with my changes
  • This change is covered by an existing CI test or a new one has been added
  • Any new scripts have been added to the .github/CODEOWNERS file with owners
  • I have made corresponding changes to the system documentation if necessary

@DavidNew-NOAA
Initial-ish commit (manual rebase)
6848443
@DavidNew-NOAA
Update gdas hash
a93f906
@DavidNew-NOAA
Missed one file from manual rebase
43cce97
@DavidNew-NOAA
Merge branch 'develop' into feature/calcanl
fbed521
@DavidNew-NOAA
Save progress
457518c
@DavidNew-NOAA
Cleanup whitespace and update GDAS hash
bef05e9
@DavidNew-NOAA
Merge branch 'develop' into feature/calcanl
6e9080a
@DavidNew-NOAA
Save progress
6bcbc12
@DavidNew-NOAA
Merge branch 'develop' into feature/calcanl
d0638c8
@DavidNew-NOAA
Checkpoint
d6302a9
@DavidNew-NOAA
Debug
0e46196
@DavidNew-NOAA
Merge branch 'develop' into feature/calcanl
76d52a3
@DavidNew-NOAA
Update
1b4fbb7
@DavidNew-NOAA
Merge branch 'develop' into feature/calcanl
5936ba0
@DavidNew-NOAA
Separate ensemble centering for analysis calc job
aaafaf9
@DavidNew-NOAA
Small update
b518f2e
@DavidNew-NOAA
Merge branch 'develop' into feature/calcanl
202d192
@DavidNew-NOAA
Update GDAS hash
dff7e54
@DavidNew-NOAA
Update gdas hash
0c29953
@DavidNew-NOAA
Save progress before redoing some stuff
f548376
@DavidNew-NOAA
Update GDAS hash
4e597b5
@DavidNew-NOAA
Use JEDI converstate in analcalc_fv3jedi
fc2f7e0
@DavidNew-NOAA
Add snow and aero to analcalc_fv3jedi
397d06c
@DavidNew-NOAA
Add aero and snow dependency to analcalc_fv3jedi
ee3c227
@DavidNew-NOAA
Change ecen_fv3jedi from gdas and enkfgdas
124197f
@DavidNew-NOAA
Update gdas hash to revert oops hash
d61533c
@DavidNew-NOAA
Debug
1403c94
@DavidNew-NOAA
Add environments for different machines and debug some task dependencies
607e23b
@DavidNew-NOAA
Coding norms
4e712b6
@DavidNew-NOAA
Some cleanup
e201675
@emcbot emcbot added the CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera label Mar 13, 2025
@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor

RussTreadon-NOAA commented Mar 13, 2025

WCOSS2 g-w CI

Ran g-w CI on WCOSS2 (Dogwood) using DavidNew-NOAA:feature/calcanl at 70b9a69 with the following results

/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48_ATM_pr3312
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Mar 13 2025 12:06:47    Mar 13 2025 13:15:21
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48mx500_3DVarAOWCDA_pr3312
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Mar 13 2025 12:06:48    Mar 13 2025 12:25:14
202103250000        Done    Mar 13 2025 12:06:48    Mar 13 2025 14:10:13
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48mx500_hybAOWCDA_pr3312
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Mar 13 2025 12:06:50    Mar 13 2025 12:25:27
202103250000        Done    Mar 13 2025 12:06:50    Mar 13 2025 13:30:27
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48_S2SWA_gefs_pr3312
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Mar 13 2025 12:06:52    Mar 13 2025 14:05:22
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C48_S2SW_pr3312
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Mar 13 2025 12:06:55    Mar 13 2025 13:25:34
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96_atm3DVar_pr3312
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Mar 13 2025 12:06:57    Mar 13 2025 12:25:38
202112210000        Done    Mar 13 2025 12:06:57    Mar 13 2025 14:25:30
202112210600        Done    Mar 13 2025 12:06:57    Mar 13 2025 14:15:26
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96C48_hybatmaerosnowDA_pr3312
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Mar 13 2025 12:07:00    Mar 13 2025 12:25:42
202112201800        Done    Mar 13 2025 12:07:00    Mar 13 2025 14:20:25
202112210000        Done    Mar 13 2025 12:07:00    Mar 13 2025 14:15:30
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96C48_hybatmDA_pr3312
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Mar 13 2025 12:07:01    Mar 13 2025 12:25:45
202112210000        Done    Mar 13 2025 12:07:01    Mar 13 2025 14:05:34
202112210600        Done    Mar 13 2025 12:07:01    Mar 13 2025 14:05:34
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96C48_ufs_hybatmDA_pr3312
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202402231800        Done    Mar 13 2025 12:07:03    Mar 13 2025 12:25:48
202402240000        Done    Mar 13 2025 12:07:03    Mar 13 2025 14:54:22
202402240600        Done    Mar 13 2025 12:07:03    Mar 13 2025 14:53:31
 
/lfs/h2/emc/ptmp/russ.treadon/EXPDIR/C96mx100_S2S_pr3312
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
199405010000        Done    Mar 13 2025 12:07:05    Mar 13 2025 12:50:48

All jobs in each configuration ran to completion.

@RussTreadon-NOAA RussTreadon-NOAA self-requested a review March 13, 2025 14:57
RussTreadon-NOAA
RussTreadon-NOAA previously approved these changes Mar 13, 2025
View reviewed changes
Copy link
Copy Markdown
Contributor

@RussTreadon-NOAA RussTreadon-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

WCOSS2 g-w CI passed. Approve pending successful g-w CI on other machines.

@emcbot emcbot added CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress and removed CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera labels Mar 13, 2025
@emcbot
Copy link
Copy Markdown

emcbot commented Mar 13, 2025

Experiment C96C48_ufs_hybatmDA FAILED on Hera in Build# 1 with error logs:

/scratch1/NCEPDEV/global/glopara/CI/3312/RUNTESTS/COMROOT/C96C48_ufs_hybatmDA_70b9a69c/logs/2024022400/gfs_arch_tars.log

Follow link here to view the contents of the above file(s): (link)

@emcbot emcbot added CI-Hera-Failed **Bot use only** CI testing on Hera for this PR has failed and removed CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress labels Mar 13, 2025
@emcbot
Copy link
Copy Markdown

emcbot commented Mar 13, 2025

Experiment C96C48_ufs_hybatmDA FAILED on Hera in Build# 1 in
/scratch1/NCEPDEV/global/glopara/CI/3312/RUNTESTS/EXPDIR/C96C48_ufs_hybatmDA_70b9a69c

@DavidNew-NOAA
Copy link
Copy Markdown
Contributor Author

DavidNew-NOAA commented Mar 13, 2025

I see the error. Will fix now

@DavidNew-NOAA
Copy link
Copy Markdown
Contributor Author

DavidNew-NOAA commented Mar 13, 2025

@aerorahul Apologies. I should have let my experiment run to completion. I just reviewed it, and indeed the gfs_arch_tars failed. My commit, 46e3a10, fixed the error and gfs_arch_tars ran to completion.

@emcbot emcbot added CI-Hera-Failed **Bot use only** CI testing on Hera for this PR has failed and removed CI-Hera-Failed **Bot use only** CI testing on Hera for this PR has failed labels Mar 13, 2025
@emcbot
Copy link
Copy Markdown

emcbot commented Mar 13, 2025

CI Failed on Hera in Build# 1
Built and ran in directory /scratch1/NCEPDEV/global/glopara/CI/3312


Experiment C96mx100_S2S_70b9a69c Completed 1 Cycles: *SUCCESS* at Thu Mar 13 16:03:09 UTC 2025
Experiment C48_ATM_70b9a69c Completed 1 Cycles: *SUCCESS* at Thu Mar 13 16:39:31 UTC 2025
Experiment C48mx500_hybAOWCDA_70b9a69c Completed 2 Cycles: *SUCCESS* at Thu Mar 13 16:51:56 UTC 2025
Experiment C96C48_hybatmDA_70b9a69c Completed 3 Cycles: *SUCCESS* at Thu Mar 13 17:40:41 UTC 2025
Experiment C96_atm3DVar_70b9a69c Completed 3 Cycles: *SUCCESS* at Thu Mar 13 17:52:41 UTC 2025
Experiment C96C48_hybatmaerosnowDA_70b9a69c Completed 3 Cycles: *SUCCESS* at Thu Mar 13 18:05:07 UTC 2025
Experiment C48_S2SW_70b9a69c Completed 1 Cycles: *SUCCESS* at Thu Mar 13 18:29:15 UTC 2025
Experiment C96C48_ufs_hybatmDA_70b9a69c Terminated with 0
FAIL
FAIL tasks failed and 1 dead at Thu Mar 13 18:29:21 UTC 2025
Experiment C96C48_ufs_hybatmDA_70b9a69c Terminated: *FAIL*
Error logs:
/scratch1/NCEPDEV/global/glopara/CI/3312/RUNTESTS/COMROOT/C96C48_ufs_hybatmDA_70b9a69c/logs/2024022400/gfs_arch_tars.log
Experiment C48_S2SWA_gefs_70b9a69c Completed 1 Cycles: *SUCCESS* at Thu Mar 13 18:29:49 UTC 2025
Experiment C48mx500_3DVarAOWCDA_70b9a69c Completed 2 Cycles: *SUCCESS* at Thu Mar 13 19:18:05 UTC 2025

@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor

RussTreadon-NOAA commented Mar 14, 2025

Will my manually running g-w CI on Orion, Hercules, or Hera help this PR move forward? Please advise.

@aerorahul aerorahul merged commit f744a8f into NOAA-EMC:develop Mar 14, 2025
@DavidNew-NOAA DavidNew-NOAA deleted the feature/calcanl branch March 14, 2025 13:22
@CoryMartin-NOAA CoryMartin-NOAA mentioned this pull request Mar 14, 2025
Closed
danholdaway added a commit to danholdaway/global-workflow that referenced this pull request Mar 26, 2025
@danholdaway
Merge branch 'develop' into feature/remove_var_name_aliasing
9a20019 
* develop:
  Delete DATAROOT when running generate_workflows.sh (NOAA-EMC#3504)
  Fix 3244 garbled change (NOAA-EMC#3492)
  Enable ensemble archiving via Globus (NOAA-EMC#3479)
  Update MSU FIX_DIR paths (NOAA-EMC#3488)
  Updates for AOWCDA and hybatmaerosnowDA cases on Gaea C6 (NOAA-EMC#3487)
  Update GOCART path for GDAS/GFS/GCAFS implementations  (NOAA-EMC#3455)
  Make RUN Variables Explicit in `config.resources` (NOAA-EMC#3478)
  Remove unused key from enkfgdas_earc_vrfy (NOAA-EMC#3473)
  Bug fix to the failing early cycle marine DA ensemble re-centering (NOAA-EMC#3454)
  Make marine LETKF optional (NOAA-EMC#3462)
  When sourcing for RUN=enkf*, use CASE_ENS (NOAA-EMC#3475)
  Updates for Gaea: verif-global tag, tracker tag, Fit2Obs tag, and C768 analysis resources (NOAA-EMC#3463)
  Update gefswave glo_025 mesh file with new mask (NOAA-EMC#3457)
  Update MSU glopara paths to new role-global space (NOAA-EMC#3443)
  Enable CI testing on AWS (NOAA-EMC#3459)
  Enable Gaea C5 Jenkins CI (NOAA-EMC#3447)
  Job reference removal from WMO product names (NOAA-EMC#3460)
  Turn off aerosol prognostic radiative feedback for GDAS NOAA-EMC#2926 (NOAA-EMC#3445)
  Add DO_GEMPAK check to postsnd subtask (NOAA-EMC#3451)
  Add a force option to setup_xml to ignore unwritable directories (NOAA-EMC#3448)
  Remove the eomg job (NOAA-EMC#3331)
  Migration to role account for Jenkins on Orion (NOAA-EMC#3440)
  Eliminate `_gfs`, `_gdas`, etc, variables and add necessary if blocks (NOAA-EMC#3420)
  Update workflow staging for sfcanl tiles and waveinit (NOAA-EMC#3429)
  Improve messaging to display clear warning when missing snogrb file (NOAA-EMC#3317)
  JEDI-based ensemble recentering and analysis calculation (NOAA-EMC#3312)
  Enable HPSS archiving on C5/6 (NOAA-EMC#3437)
  Check if HOMEDIR STMP and PTMP are writable (NOAA-EMC#3430)
  Update UFS_Utils and GFS-utils hashes to update Gaea support and ocean/ice post products (NOAA-EMC#3433)
  Enable C1152 forecasts on gaea C6 (NOAA-EMC#3438)
  Migration to role account for Jenkins on Hercules (NOAA-EMC#3423)
  Remove Direct Linking to COM from DATA for `extractvars` Job (NOAA-EMC#3379)
  Enable HPSS via Globus on Hercules and Orion
  Remove job name from product files & update GEMPAK module. (NOAA-EMC#3415)
  `link` instead of `copy` in staging jobs (NOAA-EMC#3410)
  Migrate CI Jenkins to role account on Hera (NOAA-EMC#3414)
  Add rocotorc documentation when using scrontab (NOAA-EMC#3417)
  Update jgdas atmos verfozn and verfrad with COMIN/COMOUT prefix instead of COM (NOAA-EMC#3342)
  Add configuration for empirically-corrected ozone parameters (NOAA-EMC#3386)
  Enable global-workflow to run C768C384 GSI on Gaea-C6 (NOAA-EMC#3412)
  Move logical checks into if blocks (NOAA-EMC#3339)
  Adding Jenkins CI to GaeaC6 using role account (NOAA-EMC#3389)
  Enable GDASApp g-w CI cases to run on wcoss2 (NOAA-EMC#3399)
  CI/CD Test on Gaea C5- And update config.gaea under ci/platform (NOAA-EMC#3280)
  Enable cycling support for Gaea C6 (NOAA-EMC#3323)
  Update enkf archive jobs to use COMIN/COMOUT (NOAA-EMC#3393)
  Copy marine ensemble output observation diags and spread (NOAA-EMC#3407)
  Ci testing on aws 2 (NOAA-EMC#3408)
  Disable METplus jobs on Hera (NOAA-EMC#3403)
  Add the mean EnKF soil increment to the deterministic member (NOAA-EMC#3295)
  Add mpich/8.1.19 to the WCOSS2 LD_LIBRARY_PATH for GDASApp jobs (NOAA-EMC#3396)
  Change order of RUNs (NOAA-EMC#3335)
  CI testing on aws (NOAA-EMC#3391)
  Rename Gulf of Mexico in bufr station list in GFSv17 (NOAA-EMC#3384)
  Enabling AWS CI/testing (NOAA-EMC#3383)
  Update issue templates to use new issue type field (NOAA-EMC#3369)
  Replace WAVECUR_DID variable with "rtofs" (NOAA-EMC#3337)
  Allow for C1152 ATM-Aero cycled DA to run on WCOSS2 (NOAA-EMC#3309)
  Remove Direct Linking to COM from DATA for `wavepostsbs` Job (NOAA-EMC#3303)
  Update jgdas enkf update job with COMIN or COMOUT prefix instead of COM (NOAA-EMC#3333)
  Add capability to run diff resolutions for marine anl and background (NOAA-EMC#3238)
  Update high resolution tests and fix minor wave issues  (NOAA-EMC#3289)
  Add sfs as valid system (NOAA-EMC#3243)
  Add missing arch_tars dependencies (NOAA-EMC#3319)
  Fix the empty aerosol DA aerostat tar file issue (NOAA-EMC#3332)
  Add missing file safeguard for IMS prep in snow analysis tasks (NOAA-EMC#3329)
jspsl pushed a commit to NOAA-EMC/GDASApp that referenced this pull request Mar 26, 2025
@DavidNew-NOAA @RussTreadon-NOAA @jspsl
JEDI-based ensemble recentering and analysis calculation (#1488)
6ce84da 
# Description

This PR creates a JEDI-based ensemble recentering application. It
computes a "correction increment", which when added the the ensemble
increments, yields the recentered increments. Some miscellaneous JCB
parameters are also created.

# Companion PRs

Global Workflow PR
[#3312](NOAA-EMC/global-workflow#3312)
JCB-GDAS PR [#72](NOAA-EMC/jcb-gdas#72)

# Issues

Global Workflow Issue
[#3248](NOAA-EMC/global-workflow#3248)

# Automated CI tests to run in Global Workflow
<!-- Which Global Workflow CI tests are required to adequately test this
PR? -->
- [ ] atm_jjob <!-- JEDI atm single cycle DA !-->
- [X] C96C48_ufs_hybatmDA <!-- JEDI atm cycled DA !-->
- [ ] C96C48_hybatmaerosnowDA  <!-- JEDI aero/snow cycled DA !-->
- [ ] C48mx500_3DVarAOWCDA <!-- JEDI low-res marine 3DVar cycled DA !-->
- [ ] C48mx500_hybAOWCDA <!-- JEDI marine hybrid envar cycled DA !-->
- [ ] C96C48_hybatmDA <!-- GSI atm cycled DA !-->

---------

Co-authored-by: RussTreadon-NOAA <Russ.Treadon@noaa.gov>
Co-authored-by: RussTreadon-NOAA <26926959+RussTreadon-NOAA@users.noreply.github.com>
Co-authored-by: Anna Shlyaeva <anna.v.shlyaeva@noaa.gov>
jspsl pushed a commit to NOAA-EMC/GDASApp that referenced this pull request Mar 26, 2025
@DavidNew-NOAA @jspsl
Fix GW-CI CTest dependencies (#1534)
de3b29a 
# Description

This PR revises the GW-CI CTest dependencies based on changes created in
NOAA-EMC/global-workflow#3312. This PR was
tested by running GW-CI tests for `C96C48_hybatmDA`,
`C96C48_ufs_hybatmDA`, and `C96C48_hybatmaerosnowDA`

# Companion PRs

NOAA-EMC/global-workflow#3312

# Issues

Resolves #1533 

# Automated CI tests to run in Global Workflow

N/A
tsga added a commit to tsga/global-workflow that referenced this pull request May 1, 2025
@tsga
Merge branch 'develop' into feature/land_iau
ad208da 
* develop:
  Update GSI hash and GSI fix version to resolve bugs (NOAA-EMC#3626)
  Add missing marine DA files to archiving  (NOAA-EMC#3596)
  Add a low resolution test to mimic GFSv17 cycling as much as possible (NOAA-EMC#3617)
  Add the setting to use the reject list for station t/q observations in GSI based soil DA (NOAA-EMC#3599)
  GitLab CI Framework for schedule PR cases and ctests on multi hosts (NOAA-EMC#3603)
  Avoid parallel restart I/O on WCOSS2 (NOAA-EMC#3615)
  Enables user toggling of GDASApp g-w ctests (NOAA-EMC#3587)
  COM variable updates for prep and some external downstream jobs (NOAA-EMC#3608)
  Remove MOS from system (NOAA-EMC#3612)
  Updates to enable soil DA  (NOAA-EMC#3452)
  Unexport SHELLOPTS when running htar (NOAA-EMC#3601)
  Fix check for netcdf wave restart (NOAA-EMC#3594)
  Call err_chk/err_exit for fatal errors in post JJobs/ex-scripts (NOAA-EMC#3571)
  Remove support for Jet and S4 (NOAA-EMC#3572)
  Hotfix in GitLab pipline for Nightly (env MACHINE breaks build on head node) (NOAA-EMC#3578)
  [hotfix] Missed a path during merging develop (NOAA-EMC#3577)
  Prepare for ops readiness - part 1 (NOAA-EMC#3557)
  Update UFS weather-model to 20250328 hash (NOAA-EMC#3528)
  Fix SFS fcst config (NOAA-EMC#3574)
  Use err_chk in GDAS j-jobs (NOAA-EMC#3570)
  Perform compute builds on Gaea head nodes (NOAA-EMC#3560)
  Add initial capability to produce JEDI-based observation space summary stat files (NOAA-EMC#3471)
  Spread epos over more nodes on Hera to increase allocated memory (NOAA-EMC#3567)
  Create separate gists when multiple files are published on GitHub (NOAA-EMC#3551)
  Use err_chk in GSI J-Jobs and scripts (NOAA-EMC#3549)
  Add unified jinja obs list to marine DA (NOAA-EMC#3530)
  Save snow and aerosol analysis increments (and logs and YAMLs) every cycle (NOAA-EMC#3537)
  Add Dependencies to SFS Cleanup Job (NOAA-EMC#3559)
  Updates archiving to reflect current naming of marine anl output (NOAA-EMC#3541)
  Temporarily disable compute builds on C6 (NOAA-EMC#3558)
  Update gdas.cd hash to resolve msu prod_util failure (NOAA-EMC#3556)
  COMIN/COMOUT updates for enkf chgres and downstream product jobs (NOAA-EMC#3518)
  Call err_chk in forecast scripts for fatal errors (NOAA-EMC#3515)
  Add Rocoto Jobs for the Missing Products of GEFS (NOAA-EMC#3466)
  Download subset fix data with python script (NOAA-EMC#3400)
  Check that partition should be set (NOAA-EMC#3543)
  Rename wave output and refactor some wave scripts to use MPMD, and fix some bugzillas along the way (NOAA-EMC#3517)
  Add support for dual batch partitions on AWS NOAA-EMC#3483
  Update CI build and run directories for GitLab Nightlies on C6 and added GitLab support on Hera (NOAA-EMC#3536)
  Hotfix path for CI in Jenkins on Gaea C6 to it's world-share path (NOAA-EMC#3532)
  Create single ocean grib2 product file (NOAA-EMC#3529)
  Scheduled Nightly CI/CD Pipeline Script in GitLab on Gaea C6 (NOAA-EMC#3493)
  make sure cold starts are handled correctly when DOIAU=YES (issue NOAA-EMC#3516) (NOAA-EMC#3520)
  Add check for DO_AERO_FCST before copying fv_tracer files (NOAA-EMC#3485)
  Use jinja templates instead of `@VARNAME@` in config files (NOAA-EMC#3411)
  Replace "status" (or comparable) with "err" in preparation for moving to err_chk/err_exit (NOAA-EMC#3507)
  Error in Java launch script for CI (NOAA-EMC#3465)
  Delete DATAROOT when running generate_workflows.sh (NOAA-EMC#3504)
  Fix 3244 garbled change (NOAA-EMC#3492)
  Enable ensemble archiving via Globus (NOAA-EMC#3479)
  Update MSU FIX_DIR paths (NOAA-EMC#3488)
  Updates for AOWCDA and hybatmaerosnowDA cases on Gaea C6 (NOAA-EMC#3487)
  Update GOCART path for GDAS/GFS/GCAFS implementations  (NOAA-EMC#3455)
  Make RUN Variables Explicit in `config.resources` (NOAA-EMC#3478)
  Remove unused key from enkfgdas_earc_vrfy (NOAA-EMC#3473)
  Bug fix to the failing early cycle marine DA ensemble re-centering (NOAA-EMC#3454)
  Make marine LETKF optional (NOAA-EMC#3462)
  When sourcing for RUN=enkf*, use CASE_ENS (NOAA-EMC#3475)
  Updates for Gaea: verif-global tag, tracker tag, Fit2Obs tag, and C768 analysis resources (NOAA-EMC#3463)
  Update gefswave glo_025 mesh file with new mask (NOAA-EMC#3457)
  Update MSU glopara paths to new role-global space (NOAA-EMC#3443)
  Enable CI testing on AWS (NOAA-EMC#3459)
  Enable Gaea C5 Jenkins CI (NOAA-EMC#3447)
  Job reference removal from WMO product names (NOAA-EMC#3460)
  Turn off aerosol prognostic radiative feedback for GDAS NOAA-EMC#2926 (NOAA-EMC#3445)
  Add DO_GEMPAK check to postsnd subtask (NOAA-EMC#3451)
  Add a force option to setup_xml to ignore unwritable directories (NOAA-EMC#3448)
  Remove the eomg job (NOAA-EMC#3331)
  Migration to role account for Jenkins on Orion (NOAA-EMC#3440)
  Eliminate `_gfs`, `_gdas`, etc, variables and add necessary if blocks (NOAA-EMC#3420)
  Update workflow staging for sfcanl tiles and waveinit (NOAA-EMC#3429)
  Improve messaging to display clear warning when missing snogrb file (NOAA-EMC#3317)
  JEDI-based ensemble recentering and analysis calculation (NOAA-EMC#3312)
  Enable HPSS archiving on C5/6 (NOAA-EMC#3437)
  Check if HOMEDIR STMP and PTMP are writable (NOAA-EMC#3430)
  Update UFS_Utils and GFS-utils hashes to update Gaea support and ocean/ice post products (NOAA-EMC#3433)
  Enable C1152 forecasts on gaea C6 (NOAA-EMC#3438)
  Migration to role account for Jenkins on Hercules (NOAA-EMC#3423)
  Remove Direct Linking to COM from DATA for `extractvars` Job (NOAA-EMC#3379)
  Enable HPSS via Globus on Hercules and Orion
  Remove job name from product files & update GEMPAK module. (NOAA-EMC#3415)
  `link` instead of `copy` in staging jobs (NOAA-EMC#3410)
  Migrate CI Jenkins to role account on Hera (NOAA-EMC#3414)
  Add rocotorc documentation when using scrontab (NOAA-EMC#3417)
  Update jgdas atmos verfozn and verfrad with COMIN/COMOUT prefix instead of COM (NOAA-EMC#3342)
  Add configuration for empirically-corrected ozone parameters (NOAA-EMC#3386)
  Enable global-workflow to run C768C384 GSI on Gaea-C6 (NOAA-EMC#3412)
  Move logical checks into if blocks (NOAA-EMC#3339)
  Adding Jenkins CI to GaeaC6 using role account (NOAA-EMC#3389)
  Enable GDASApp g-w CI cases to run on wcoss2 (NOAA-EMC#3399)
  CI/CD Test on Gaea C5- And update config.gaea under ci/platform (NOAA-EMC#3280)
  Enable cycling support for Gaea C6 (NOAA-EMC#3323)
  Update enkf archive jobs to use COMIN/COMOUT (NOAA-EMC#3393)
  Copy marine ensemble output observation diags and spread (NOAA-EMC#3407)
  Ci testing on aws 2 (NOAA-EMC#3408)
  Disable METplus jobs on Hera (NOAA-EMC#3403)
  Add the mean EnKF soil increment to the deterministic member (NOAA-EMC#3295)
  Add mpich/8.1.19 to the WCOSS2 LD_LIBRARY_PATH for GDASApp jobs (NOAA-EMC#3396)
  Change order of RUNs (NOAA-EMC#3335)
  CI testing on aws (NOAA-EMC#3391)
  Rename Gulf of Mexico in bufr station list in GFSv17 (NOAA-EMC#3384)
  Enabling AWS CI/testing (NOAA-EMC#3383)
  Update issue templates to use new issue type field (NOAA-EMC#3369)
  Replace WAVECUR_DID variable with "rtofs" (NOAA-EMC#3337)
  Allow for C1152 ATM-Aero cycled DA to run on WCOSS2 (NOAA-EMC#3309)
  Remove Direct Linking to COM from DATA for `wavepostsbs` Job (NOAA-EMC#3303)
  Update jgdas enkf update job with COMIN or COMOUT prefix instead of COM (NOAA-EMC#3333)
  Add capability to run diff resolutions for marine anl and background (NOAA-EMC#3238)
  Update high resolution tests and fix minor wave issues  (NOAA-EMC#3289)
  Add sfs as valid system (NOAA-EMC#3243)
  Add missing arch_tars dependencies (NOAA-EMC#3319)
  Fix the empty aerosol DA aerostat tar file issue (NOAA-EMC#3332)
  Add missing file safeguard for IMS prep in snow analysis tasks (NOAA-EMC#3329)
  Fix memory unsetting on Gaea (NOAA-EMC#3325)
  Fix error log parsing in compute build CI (NOAA-EMC#3301)
  Remove marineanlvrfy task from global-workflow (NOAA-EMC#3314)
  Add `gfs_wavepostpnt` dependencies to gfs_cleanup (NOAA-EMC#3313)
  Increase the GDASApp build wallclock (NOAA-EMC#3298)
  Capture build fail in Jenkins pipeline when no error logs are produced (NOAA-EMC#3297)
  Add/update config files for Gaea and check existence before sourcing config files in generate_workflows.sh (NOAA-EMC#3286)
  Fix ocean restarts when cold starting with DOIAU=YES (NOAA-EMC#3278)
  Splitting up the archive task (NOAA-EMC#3242)
  CTests extended validation for C48_ATM and staged C48_S2SW for gfs_fcst and gfs_atmos (NOAA-EMC#3256)
  Add esnowanl to enkfgfs cycle (NOAA-EMC#3283)
  Add gfs cycles to C48mx500_3DVarAOWCDA (NOAA-EMC#3249)
  Add fetch job and update stage_ic to work with fetched ICs (NOAA-EMC#3141)
  Remove WAFS files and references from `develop` (NOAA-EMC#3263)
  fix intel stack version number on c5 (NOAA-EMC#3258)
  Update gsi_monitor and ufs_utils hashes to recent hashes for C5/C6 build and run (NOAA-EMC#3252)
  Enable DA cycling on gaea C5/C6 (NOAA-EMC#3255)
  Copy post-processed sea ice increment for diagnostics (NOAA-EMC#3235)
DavidNew-NOAA added a commit to NOAA-EMC/GDASApp that referenced this pull request Jan 6, 2026
@DavidNew-NOAA @danholdaway
@jiaruidong2017 @CoryMartin-NOAA
JEDI-based ensemble recentering and analysis calculation and native g…
6eaed23 
…rid increments (#72)

This PR is a companion to GDASApp PR
[#1488](#1488) and Global
Workflow PR
[#3312](NOAA-EMC/global-workflow#3312).

It creates YAMLs for the JEDI-based ensemble recentering application and
the `convertstate` applications used for analysis calculation. It also
alters certain YAMLs to implement native-grid increments in the Global
Workflow.

Some miscellaneous changes to the naming convention of increments and
backgrounds in run directories are also implemented for overall
consistency and simplicity across JEDI-based Global Workflow jobs.

---------

Co-authored-by: danholdaway <danholdaway@users.noreply.github.com>
Co-authored-by: Jiarui Dong <Jiarui.Dong@noaa.gov>
Co-authored-by: Cory Martin <cory.r.martin@noaa.gov>
DavidNew-NOAA added a commit to NOAA-EMC/GDASApp that referenced this pull request Jan 16, 2026
@DavidNew-NOAA @RussTreadon-NOAA
JEDI-based ensemble recentering and analysis calculation (#1488)
b3225a7 
# Description

This PR creates a JEDI-based ensemble recentering application. It
computes a "correction increment", which when added the the ensemble
increments, yields the recentered increments. Some miscellaneous JCB
parameters are also created.

# Companion PRs

Global Workflow PR
[#3312](NOAA-EMC/global-workflow#3312)
JCB-GDAS PR [#72](NOAA-EMC/jcb-gdas#72)

# Issues

Global Workflow Issue
[#3248](NOAA-EMC/global-workflow#3248)

# Automated CI tests to run in Global Workflow
<!-- Which Global Workflow CI tests are required to adequately test this
PR? -->
- [ ] atm_jjob <!-- JEDI atm single cycle DA !-->
- [X] C96C48_ufs_hybatmDA <!-- JEDI atm cycled DA !-->
- [ ] C96C48_hybatmaerosnowDA  <!-- JEDI aero/snow cycled DA !-->
- [ ] C48mx500_3DVarAOWCDA <!-- JEDI low-res marine 3DVar cycled DA !-->
- [ ] C48mx500_hybAOWCDA <!-- JEDI marine hybrid envar cycled DA !-->
- [ ] C96C48_hybatmDA <!-- GSI atm cycled DA !-->

---------

Co-authored-by: RussTreadon-NOAA <Russ.Treadon@noaa.gov>
Co-authored-by: RussTreadon-NOAA <26926959+RussTreadon-NOAA@users.noreply.github.com>
Co-authored-by: Anna Shlyaeva <anna.v.shlyaeva@noaa.gov>
DavidNew-NOAA added a commit to NOAA-EMC/GDASApp that referenced this pull request Jan 16, 2026
@DavidNew-NOAA
Fix GW-CI CTest dependencies (#1534)
17238ac 
# Description

This PR revises the GW-CI CTest dependencies based on changes created in
NOAA-EMC/global-workflow#3312. This PR was
tested by running GW-CI tests for `C96C48_hybatmDA`,
`C96C48_ufs_hybatmDA`, and `C96C48_hybatmaerosnowDA`

# Companion PRs

NOAA-EMC/global-workflow#3312

# Issues

Resolves #1533 

# Automated CI tests to run in Global Workflow

N/A
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@CoryMartin-NOAA CoryMartin-NOAA CoryMartin-NOAA left review comments

@aerorahul aerorahul aerorahul approved these changes

@RussTreadon-NOAA RussTreadon-NOAA RussTreadon-NOAA left review comments

@DavidHuber-NOAA DavidHuber-NOAA DavidHuber-NOAA left review comments

@danholdaway danholdaway Awaiting requested review from danholdaway

@WalterKolczynski-NOAA WalterKolczynski-NOAA Awaiting requested review from WalterKolczynski-NOAA

@junwang-noaa junwang-noaa Awaiting requested review from junwang-noaa

@KateFriedman-NOAA KateFriedman-NOAA Awaiting requested review from KateFriedman-NOAA

@CatherineThomas-NOAA CatherineThomas-NOAA Awaiting requested review from CatherineThomas-NOAA

@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA Awaiting requested review from TerrenceMcGuinness-NOAA

Assignees

No one assigned

Labels

CI-Hera-Failed **Bot use only** CI testing on Hera for this PR has failed JEDI Feature development to support JEDI-based DA

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Create JEDI-based ensemble recentering and analysis calculation job