Skip to content

Add options to inflate the ensemble while recentering#1501

Merged
guillaumevernieres merged 3 commits into
developfrom
feature/marine_ens_inflation
Feb 21, 2025
Merged

Add options to inflate the ensemble while recentering#1501
guillaumevernieres merged 3 commits into
developfrom
feature/marine_ens_inflation

Conversation

@shlyaeva
Copy link
Copy Markdown
Collaborator

@shlyaeva shlyaeva commented Feb 14, 2025

Description

Adds code to the ensemble recentering to optionally inflate/deflate the ensemble variance by either a scalar (same for all variables) or a field from the file (has to be specified for all variables).

This is not exercised yet, since we don't know the parameters of inflation/deflation yet, but I tested with both options to check whether it behaves as expected.

Note: in the future refactoring we should switch to oops::Inflation that provides several different inflation options.

Issues

Related to #1496 (doesn't fix yet since we need to decide what parameters to use this with)

Automated CI tests to run in Global Workflow

  • atm_jjob
  • C96C48_ufs_hybatmDA
  • C96C48_hybatmaerosnowDA
  • C48mx500_3DVarAOWCDA
  • C48mx500_hybAOWCDA
  • C96C48_hybatmDA

Copy link
Copy Markdown
Contributor

@guillaumevernieres guillaumevernieres left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @shlyaeva

Copy link
Copy Markdown
Contributor

@RussTreadon-NOAA RussTreadon-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me ... as I learn C++

@RussTreadon-NOAA RussTreadon-NOAA added the hera-GW-RT Queue for automated testing with global-workflow on Hera label Feb 14, 2025
@emcbot emcbot added hera-GW-RT-Running Automated testing with global-workflow running on Hera and removed hera-GW-RT Queue for automated testing with global-workflow on Hera labels Feb 14, 2025
@emcbot
Copy link
Copy Markdown

emcbot commented Feb 14, 2025

Automated GW-GDASApp Testing Results:
Machine: hera

Start: Fri Feb 14 18:58:07 UTC 2025 on hfe08
---------------------------------------------------
Build:                                 *SUCCESS*
Build: Completed at Fri Feb 14 19:42:23 UTC 2025
---------------------------------------------------
Tests: ctest -j12 -R gdasapp -E atm_jjob|C96C48_ufs_hybatmDA|C96C48_hybatmaerosnowDA|C48mx500_3DVarAOWCDA|C96C48_hybatmDA
Tests:                                  *Failed*
Tests: Failed at Fri Feb 14 20:02:06 UTC 2025
Tests: 85% tests passed, 7 tests failed out of 46
	2054 - test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlletkf_202103250000 (Failed)
	2055 - test_gdasapp_C48mx500_hybAOWCDA_gdas_marinebmat_202103250000 (Failed)
	2056 - test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlinit_202103250000 (Failed)
	2057 - test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlvar_202103250000 (Failed)
	2058 - test_gdasapp_C48mx500_hybAOWCDA_gdas_ocnanalecen_202103250000 (Failed)
	2059 - test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlchkpt_202103250000 (Failed)
	2060 - test_gdasapp_C48mx500_hybAOWCDA_gdas_marineanlfinal_202103250000 (Failed)
Tests: see output at /scratch1/NCEPDEV/da/role.jedipara/CI/GDASApp/workflow/PR/1501/global-workflow/sorc/gdas.cd/build/log.ctest

@emcbot emcbot added hera-GW-RT-Failed Automated testing with global-workflow failed on Hera and removed hera-GW-RT-Running Automated testing with global-workflow running on Hera labels Feb 14, 2025
@RussTreadon-NOAA
Copy link
Copy Markdown
Contributor

CI built this PR inside g-w develop. I forgot that g-w PR #3238 remains in review and has not yet been merged into g-w develop. I think GDASApp based g-w CI for marine DA is broken until g-w PR #3238 is merged into g-w develop.

Is this your understanding @guillaumevernieres ?

@guillaumevernieres
Copy link
Copy Markdown
Contributor

CI built this PR inside g-w develop. I forgot that g-w PR #3238 remains in review and has not yet been merged into g-w develop. I think GDASApp based g-w CI for marine DA is broken until g-w PR #3238 is merged into g-w develop.

Is this your understanding @guillaumevernieres ?

Correct @RussTreadon-NOAA . We need to wait for #3238 ... I keep forgetting.

@guillaumevernieres guillaumevernieres added hera-GW-RT Queue for automated testing with global-workflow on Hera and removed hera-GW-RT-Failed Automated testing with global-workflow failed on Hera labels Feb 20, 2025
@emcbot emcbot added hera-GW-RT-Running Automated testing with global-workflow running on Hera and removed hera-GW-RT Queue for automated testing with global-workflow on Hera labels Feb 20, 2025
@emcbot
Copy link
Copy Markdown

emcbot commented Feb 20, 2025

Automated GW-GDASApp Testing Results:
Machine: hera

Start: Thu Feb 20 16:45:47 UTC 2025 on hfe03
---------------------------------------------------
Build:                                 *SUCCESS*
Build: Completed at Thu Feb 20 17:34:05 UTC 2025
---------------------------------------------------
Tests: ctest -j12 -R gdasapp -E atm_jjob|C96C48_ufs_hybatmDA|C96C48_hybatmaerosnowDA|C48mx500_3DVarAOWCDA|C96C48_hybatmDA
Tests:                                 *SUCCESS*
Tests: Completed at Thu Feb 20 20:08:58 UTC 2025
Tests: 100% tests passed, 0 tests failed out of 46

@emcbot emcbot added hera-GW-RT-Passed Automated testing with global-workflow successful on Hera and removed hera-GW-RT-Running Automated testing with global-workflow running on Hera labels Feb 20, 2025
@guillaumevernieres guillaumevernieres merged commit 46b37ba into develop Feb 21, 2025
@guillaumevernieres guillaumevernieres deleted the feature/marine_ens_inflation branch February 21, 2025 12:52
danholdaway added a commit that referenced this pull request Mar 26, 2025
* develop:
  added original date (#1570)
  Update OCEAN_BASIN_FILE_ORION path for marine ctest (#1569)
  Fixing window_begin and end in yaml for redating ADT (#1565)
  Save LETKF mean analysis and mean increment for verification (#1566)
  Update JEDI hashes (20250324) (#1567)
  Removes obsolete json files from marine bufr2ioda (#1564)
  Add hybrid 4denvar as a phase3 validation configuration (#1552)
  Bugfix/ocn ecen (#1550)
  Bugfix SSS obs for LETKF (#1560)
  Bugfix ocean ensemble recentering (#1558)
  apply ci path patch only when running g-w ctests (#1554)
  Update JEDI hashes (20250317)  (#1531)
  add option to create_experiment.py in create_exp.sh  (#1546)
  Update jcb hashes and support initial IODA stats capability (#1547)
  Fix GW-CI CTest dependencies (#1534)
  Converts prepoceanobs to use JCB-style obs list and config files (#1527)
  JEDI-based ensemble recentering and analysis calculation (#1488)
  tools for phase3 validation (#1526)
  Update JEDI hashes (20250306) (#1520)
  New jcb-gdas # and insitu obs prep bug fix  (#1523)
  Marine in situ obs update (SSS, moorings, drifters) (#1511)
  Save marine background and analysis spread (#1517)
  Minor build and install updates and ctest cleanup (#1512)
  correct logic for upper loop limit in chem_diagb (#1516)
  Incorporate multi-cycle concatination and separation of variables in post-BUFR observations (#1504)
  Update JEDI hashes (20250225) (#1475)
  Add a depth dependent e-fold scale (#1494)
  Update jcb and da-utils hashes to support land DA. (#1509)
  Add options to inflate the ensemble while recentering (#1501)
  Add components to use jcb yamls for marine letkf job (#1486)
  Add GNSSRO bufr2ioda and json files (#1448)
  Removal of the marine verification tools (#1499)
  update logic to identify MSU machine (#1498)
  IODA Converter with In-Situ Observations Concatenation and ObsError Inflation (#1472)
  Add sea ice recentering (#1478)
  marine vrfy bugfix (#1483)
  add LD_LIBRARY_PATH patch for wcoss2 build (#1484)
  Bugfix for ensemble recenter + add a test (#1477)
  Add code changes for the implementation of the  low-resolution B (#1441)
  update spack-stack path in Hera modulefiles (#1471)
  fixed glider output filename (#1469)
  add gdas_waveinit to C48mx500_3DVarAOWCDA ctest suite (#1470)
  update jcb-gdas hash 20250128 (#1466)
  Time series of omb stats and html doc (#1463)
  Update marine vrfy HTML codes (#1464)
  Automate the verify tools to submit from start pdy to end pdy (#1458)
  Update an offline marine vrfy tool (#1447)
  Update JEDI hashes (20250127) (#1460)
DavidNew-NOAA pushed a commit that referenced this pull request Jan 16, 2026
# Description

Adds code to the ensemble recentering to optionally inflate/deflate the
ensemble variance by either a scalar (same for all variables) or a field
from the file (has to be specified for all variables).

This is not exercised yet, since we don't know the parameters of
inflation/deflation yet, but I tested with both options to check whether
it behaves as expected.

Note: in the future refactoring we should switch to oops::Inflation that
provides several different inflation options.

# Issues

Related to #1496 (doesn't fix yet since we need to decide what
parameters to use this with)

# Automated CI tests to run in Global Workflow
<!-- Which Global Workflow CI tests are required to adequately test this
PR? -->
- [ ] atm_jjob <!-- JEDI atm single cycle DA !-->
- [ ] C96C48_ufs_hybatmDA <!-- JEDI atm cycled DA !-->
- [ ] C96C48_hybatmaerosnowDA  <!-- JEDI aero/snow cycled DA !-->
- [ ] C48mx500_3DVarAOWCDA <!-- JEDI low-res marine 3DVar cycled DA !-->
- [x] C48mx500_hybAOWCDA <!-- JEDI marine hybrid envar cycled DA !-->
- [ ] C96C48_hybatmDA <!-- GSI atm cycled DA !-->

---------

Co-authored-by: Anna Shlyaeva <anna.v.shlyaeva@noaa.gov>
Co-authored-by: Guillaume Vernieres <guillaume.vernieres@noaa.gov>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

hera-GW-RT-Passed Automated testing with global-workflow successful on Hera

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants