Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
60 commits
Select commit Hold shift + click to select a range
9de5a3d
Initial commit
DavidNew-NOAA Sep 11, 2025
1b3361a
Merge branch 'develop' into feature/atm-parm
DavidNew-NOAA Sep 11, 2025
6819212
Save changes
DavidNew-NOAA Sep 11, 2025
2192a0c
Merge branch 'develop' into feature/atm-parm
DavidNew-NOAA Sep 11, 2025
feefae1
Save changes
DavidNew-NOAA Sep 16, 2025
e53614e
templatize jedi testing
DavidNew-NOAA Sep 16, 2025
d37b409
Update gdas hash
DavidNew-NOAA Sep 16, 2025
7fae2a2
Merge branch 'develop' into feature/atm-parm
DavidNew-NOAA Sep 16, 2025
f9f29a7
Remove ATM_ from window vars
DavidNew-NOAA Sep 16, 2025
c010b2e
Separate obs list for different tests
DavidNew-NOAA Sep 16, 2025
c774f78
Merge branch 'develop' into feature/atm-parm
DavidNew-NOAA Sep 16, 2025
31b2bbc
pynorms
DavidNew-NOAA Sep 16, 2025
2451bc7
pynorms
DavidNew-NOAA Sep 16, 2025
0e78550
bugfix
DavidNew-NOAA Sep 16, 2025
8d8e4b1
Debugging and refactor analysis calc job
DavidNew-NOAA Sep 17, 2025
8d98498
Merge branch 'develop' into feature/atm-parm
DavidNew-NOAA Sep 17, 2025
51a0a9f
Debug
DavidNew-NOAA Sep 17, 2025
8fe4c2f
Create methods to tar and compress diag files and bias corrections
DavidNew-NOAA Sep 18, 2025
c65221e
Delete old analysis class
DavidNew-NOAA Sep 18, 2025
fb90bbc
FV3Analysis -> Analysis
DavidNew-NOAA Sep 18, 2025
af8b820
tweaks
DavidNew-NOAA Sep 18, 2025
bb9ce43
Merge branch 'develop' into feature/atm-parm
DavidNew-NOAA Sep 18, 2025
3dc6220
Update
DavidNew-NOAA Sep 18, 2025
d201d8b
Each task reads its own TASK_CONFIG_YAML
DavidNew-NOAA Sep 19, 2025
a51dff8
Merge branch 'develop' into feature/atm-parm
DavidNew-NOAA Sep 19, 2025
d833fdb
Refactor snow
DavidNew-NOAA Sep 22, 2025
1fe4677
Merge branch 'develop' into feature/atm-parm
DavidNew-NOAA Sep 22, 2025
8392ba7
Finish snow refactor
DavidNew-NOAA Sep 24, 2025
e9a1994
Finish snow refactor
DavidNew-NOAA Sep 24, 2025
7d2243f
debug
DavidNew-NOAA Sep 24, 2025
d5978c6
First draft of aero refactor
DavidNew-NOAA Sep 25, 2025
8a9fa9c
Merge branch 'develop' into feature/atm-parm
DavidNew-NOAA Sep 25, 2025
74bc706
Debug
DavidNew-NOAA Sep 26, 2025
84b39f3
Merge branch 'develop' into feature/atm-parm
DavidNew-NOAA Sep 26, 2025
5d991a3
Revert some stuff
DavidNew-NOAA Sep 26, 2025
e5b37d1
pynorms
DavidNew-NOAA Sep 26, 2025
0e82fc5
pynorms and shellnorms
DavidNew-NOAA Sep 26, 2025
77e567c
debug
DavidNew-NOAA Sep 26, 2025
e6caa86
debug
DavidNew-NOAA Sep 26, 2025
3efc23a
Update gdas hash
DavidNew-NOAA Sep 29, 2025
4123b1e
Merge branch 'develop' into feature/atm-parm
DavidNew-NOAA Sep 29, 2025
82b77a5
update gdas hash
DavidNew-NOAA Sep 29, 2025
60b3770
bugfixes
DavidNew-NOAA Sep 30, 2025
def1428
Merge branch 'develop' into feature/atm-parm
DavidNew-NOAA Sep 30, 2025
2f54294
Make no JEDI obs a warning, not an exception
DavidNew-NOAA Sep 30, 2025
b2284ab
Update comments
DavidNew-NOAA Oct 1, 2025
d894cab
update gdas hash
DavidNew-NOAA Oct 1, 2025
22eb769
pynorms
DavidNew-NOAA Oct 1, 2025
b0c3c4e
Merge branch 'develop' into feature/atm-parm
DavidNew-NOAA Oct 1, 2025
5b6caf1
Bugfix
DavidNew-NOAA Oct 3, 2025
f1185c8
pynorms
DavidNew-NOAA Oct 3, 2025
d5ee55c
Update gdas hash
DavidNew-NOAA Oct 7, 2025
9a38f0e
Merge branch 'develop' into feature/atm-parm
DavidNew-NOAA Oct 7, 2025
c132905
confict
DavidNew-NOAA Oct 7, 2025
23c63c5
Update gdas hash
DavidNew-NOAA Oct 7, 2025
cf011f7
Update obs list
DavidNew-NOAA Oct 7, 2025
cb02a94
Warn on missing bias correction files
DavidNew-NOAA Oct 8, 2025
894a3bf
pynorms
DavidNew-NOAA Oct 8, 2025
4e7e2d0
Update gdas hash to develop
DavidNew-NOAA Oct 8, 2025
5f1d7e3
Merge branch 'develop' into feature/atm-parm
DavidNew-NOAA Oct 8, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 7 additions & 7 deletions .github/CODEOWNERS
Original file line number Diff line number Diff line change
Expand Up @@ -210,19 +210,19 @@ ush/python/pygfs/task/aero_bmatrix.py @DavidNew-NOAA @CoryMartin-NOAA
ush/python/pygfs/task/aero_emissions.py @bbakernoaa
ush/python/pygfs/task/aero_prepobs.py @CoryMartin-NOAA
ush/python/pygfs/task/analysis.py @DavidNew-NOAA @RussTreadon-NOAA
ush/python/pygfs/task/analysis_stats.py @CoryMartin-NOAA
ush/python/pygfs/task/analysis_stats.py @CoryMartin-NOAA @DavidNew-NOAA
ush/python/pygfs/task/archive.py @DavidHuber-NOAA
ush/python/pygfs/task/atm_analysis.py @DavidNew-NOAA @RussTreadon-NOAA
ush/python/pygfs/task/atmens_analysis.py @DavidNew-NOAA @RussTreadon-NOAA
ush/python/pygfs/task/bmatrix.py @DavidNew-NOAA
ush/python/pygfs/task/gfs_forecast.py @aerorahul
ush/python/pygfs/task/marine_analysis.py @guillaumevernieres @AndrewEichmann-NOAA
ush/python/pygfs/task/marine_bmat.py @guillaumevernieres @AndrewEichmann-NOAA
ush/python/pygfs/task/marine_letkf.py @guillaumevernieres @AndrewEichmann-NOAA
ush/python/pygfs/task/oceanice_products.py @aerorahul @JesseMeng-NOAA @ChristopherHill-NOAA
ush/python/pygfs/task/marine_analysis.py @guillaumevernieres @AndrewEichmann-NOAA @DavidNew-NOAA
ush/python/pygfs/task/marine_bmat.py @guillaumevernieres @AndrewEichmann-NOAA @DavidNew-NOAA
ush/python/pygfs/task/marine_letkf.py @guillaumevernieres @AndrewEichmann-NOAA @DavidNew-NOAA
ush/python/pygfs/task/oceanice_products.py @aerorahul @JesseMeng-NOAA @ChristopherHill-NOAA @DavidNew-NOAA
ush/python/pygfs/task/offline_analysis.py @CoryMartin-NOAA
ush/python/pygfs/task/snow_analysis.py @jiaruidong2017
ush/python/pygfs/task/snowens_analysis.py @jiaruidong2017
ush/python/pygfs/task/snow_analysis.py @jiaruidong2017 @DavidNew-NOAA
ush/python/pygfs/task/snowens_analysis.py @jiaruidong2017 @DavidNew-NOAA
ush/python/pygfs/task/stage_ic.py @DavidHuber-NOAA @aerorahul
ush/python/pygfs/task/upp.py @aerorahul @WenMeng-NOAA
ush/python/pygfs/ufswm/__init__.py @aerorahul
Expand Down
14 changes: 8 additions & 6 deletions dev/ci/cases/yamls/ufs_hybatmDA_defaults.ci.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -6,17 +6,19 @@ base:
DO_JEDIATMENS: "YES"
DO_TEST_MODE: "NO"
atmanl:
JCB_ALGO_YAML_VAR: "${HOMEgfs}/sorc/gdas.cd/test/gw-ci/atm/jcb-prototype_3dvar_ufs_hybatmDA.yaml.j2"
JCB_ALGO_YAML_FV3INC: "${HOMEgfs}/sorc/gdas.cd/test/gw-ci/atm/jcb-prototype_3dvar-fv3inc_ufs_hybatmDA.yaml.j2"
LAYOUT_X_ATMANL: 4
LAYOUT_Y_ATMANL: 4
OBS_LIST_YAML: "${HOMEgfs}/sorc/gdas.cd/test/gw-ci/atm/atm_obs_list_ufs_hybatmDA.yaml.j2"
VAR_JEDI_TEST_YAML: "${HOMEgfs}/sorc/gdas.cd/test/gw-ci/atm/jedi-test_3dvar_ufs_hybatmDA.yaml.j2"
FV3INC_JEDI_TEST_YAML: "${HOMEgfs}/sorc/gdas.cd/test/gw-ci/atm/jedi-test_3dvar-fv3inc_ufs_hybatmDA.yaml.j2"
atmensanl:
JCB_ALGO_YAML_LETKF: "${HOMEgfs}/sorc/gdas.cd/test/gw-ci/atm/jcb-prototype_lgetkf_ufs_hybatmDA.yaml.j2"
JCB_ALGO_YAML_OBS: "${HOMEgfs}/sorc/gdas.cd/test/gw-ci/atm/jcb-prototype_lgetkf_observer_ufs_hybatmDA.yaml.j2"
JCB_ALGO_YAML_SOL: "${HOMEgfs}/sorc/gdas.cd/test/gw-ci/atm/jcb-prototype_lgetkf_solver_ufs_hybatmDA.yaml.j2"
JCB_ALGO_YAML_FV3INC: "${HOMEgfs}/sorc/gdas.cd/test/gw-ci/atm/jcb-prototype_lgetkf-fv3inc_ufs_hybatmDA.yaml.j2"
LAYOUT_X_ATMENSANL: 4
LAYOUT_Y_ATMENSANL: 4
OBS_LIST_YAML: "${HOMEgfs}/sorc/gdas.cd/test/gw-ci/atm/atm_obs_list_ufs_hybatmDA.yaml.j2"
LETKF_JEDI_TEST_YAML: "${HOMEgfs}/sorc/gdas.cd/test/gw-ci/atm/jedi-test_lgetkf_ufs_hybatmDA.yaml.j2"
OBS_JEDI_TEST_YAML: "${HOMEgfs}/sorc/gdas.cd/test/gw-ci/atm/jedi-test_lgetkf-observer_ufs_hybatmDA.yaml.j2"
SOL_JEDI_TEST_YAML: "${HOMEgfs}/sorc/gdas.cd/test/gw-ci/atm/jedi-test_lgetkf-solver_ufs_hybatmDA.yaml.j2"
FV3INC_JEDI_TEST_YAML: "${HOMEgfs}/sorc/gdas.cd/test/gw-ci/atm/jedi-test_lgetkf-fv3inc_ufs_hybatmDA.yaml.j2"
esfc:
DONST: "NO"
nsst:
Expand Down
14 changes: 4 additions & 10 deletions dev/parm/config/gcafs/config.aeroanl.j2
Original file line number Diff line number Diff line change
Expand Up @@ -18,18 +18,12 @@ case ${CASE} in
exit 4
esac
export CASE_ANL
export JCB_ALGO_YAML_VAR=${PARMgfs}/gdas/aero/jcb-prototype_3dvar.yaml.j2
export STATICB_TYPE='diffusion'
export BERROR_YAML="aero_background_error_static_${STATICB_TYPE}"
export BERROR_DATA_DIR="${FIXgfs}/gdas/aero/clim_b"

export JEDI_CONFIG_YAML="${PARMgfs}/gdas/aero/aero_det_jedi_config.yaml.j2"
export STAGE_CRTM_COEFF_YAML="${PARMgfs}/gdas/aero/aero_stage_crtm_coeff.yaml.j2"
export STAGE_JEDI_FIX_YAML="${PARMgfs}/gdas/aero/aero_stage_jedi_fix.yaml.j2"
export STAGE_YAML="${PARMgfs}/gdas/aero/aero_det_stage.yaml.j2"
export SAVE_YAML="${PARMgfs}/gdas/aero/aero_det_save.yaml.j2"
export STATICB_TYPE='diffusion'

export AERO_BMATRIX_RESCALE_YAML="aero_gen_bmatrix_rescale_default.yaml.j2"
export TASK_CONFIG_YAML="${PARMgfs}/gdas/aero/aero_det_config.yaml.j2"
export OBS_LIST_YAML="${PARMgfs}/gdas/aero/aero_obs_list.yaml.j2"
export BIAS_FILES_YAML="${PARMgfs}/gdas/aero/aero_bias_files.yaml.j2"

export io_layout_x="{{ IO_LAYOUT_X }}"
export io_layout_y="{{ IO_LAYOUT_Y }}"
Expand Down
7 changes: 3 additions & 4 deletions dev/parm/config/gcafs/config.aeroanlgenb
Original file line number Diff line number Diff line change
Expand Up @@ -8,11 +8,10 @@ echo "BEGIN: config.aeroanlgenb"
# Get task specific resources
source "${EXPDIR}/config.resources" aeroanlgenb

export JEDI_CONFIG_YAML="${PARMgfs}/gdas/aero/aero_bmat_jedi_config.yaml.j2"
export STAGE_YAML="${PARMgfs}/gdas/aero/aero_bmat_stage.yaml.j2"
export SAVE_YAML="${PARMgfs}/gdas/aero/aero_bmat_save.yaml.j2"
export TASK_CONFIG_YAML="${PARMgfs}/gdas/aero/aero_bmat_config.yaml.j2"
export OBS_LIST_YAML="${PARMgfs}/gdas/aero/aero_obs_list.yaml.j2"
export BIAS_FILES_YAML="${PARMgfs}/gdas/aero/aero_bias_files.yaml.j2"

export RESCALE_YAML="${PARMgfs}/gdas/jcb-gdas/aero/algorithm/aero_gen_bmatrix_rescale_default.yaml.j2"
export aero_diffusion_iter=200
export aero_diffusion_horiz_len=300e3
export aero_diffusion_fixed_val=20.0
Expand Down
14 changes: 8 additions & 6 deletions dev/parm/config/gcafs/yaml/defaults.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -37,23 +37,25 @@ base:
FHOUT_AERO: 3

atmanl:
JCB_ALGO_YAML_VAR: "${PARMgfs}/gdas/atm/jcb-prototype_3dvar.yaml.j2"
JCB_ALGO_YAML_FV3INC: "${PARMgfs}/gdas/atm/jcb-prototype_3dvar-fv3inc.yaml.j2"
STATICB_TYPE: "gsibec"
LAYOUT_X_ATMANL: 8
LAYOUT_Y_ATMANL: 8
IO_LAYOUT_X: 1
IO_LAYOUT_Y: 1
OBS_LIST_YAML: "${PARMgfs}/gdas/atm/atm_obs_list.yaml.j2"
VAR_JEDI_TEST_YAML: ""
FV3INC_JEDI_TEST_YAML: ""

atmensanl:
JCB_ALGO_YAML_LETKF: "${PARMgfs}/gdas/atm/jcb-prototype_lgetkf.yaml.j2"
JCB_ALGO_YAML_OBS: "${PARMgfs}/gdas/atm/jcb-prototype_lgetkf_observer.yaml.j2"
JCB_ALGO_YAML_SOL: "${PARMgfs}/gdas/atm/jcb-prototype_lgetkf_solver.yaml.j2"
JCB_ALGO_YAML_FV3INC: "${PARMgfs}/gdas/atm/jcb-prototype_lgetkf-fv3inc.yaml.j2"
LAYOUT_X_ATMENSANL: 8
LAYOUT_Y_ATMENSANL: 8
IO_LAYOUT_X: 1
IO_LAYOUT_Y: 1
OBS_LIST_YAML: "${PARMgfs}/gdas/atm/atm_obs_list.yaml.j2"
LETKF_JEDI_TEST_YAML: ""
OBS_JEDI_TEST_YAML: ""
SOL_JEDI_TEST_YAML: ""
FV3INC_JEDI_TEST_YAML: ""

aeroanl:
IO_LAYOUT_X: 1
Expand Down
14 changes: 5 additions & 9 deletions dev/parm/config/gfs/config.aeroanl.j2
Original file line number Diff line number Diff line change
Expand Up @@ -18,16 +18,12 @@ case ${CASE} in
exit 4
esac
export CASE_ANL
export JCB_ALGO_YAML_VAR=${PARMgfs}/gdas/aero/jcb-prototype_3dvar.yaml.j2

export STATICB_TYPE='diffusion'
export BERROR_YAML="aero_background_error_static_${STATICB_TYPE}"
export BERROR_DATA_DIR="${FIXgfs}/gdas/aero/clim_b"

export JEDI_CONFIG_YAML="${PARMgfs}/gdas/aero/aero_det_jedi_config.yaml.j2"
export STAGE_CRTM_COEFF_YAML="${PARMgfs}/gdas/aero/aero_stage_crtm_coeff.yaml.j2"
export STAGE_JEDI_FIX_YAML="${PARMgfs}/gdas/aero/aero_stage_jedi_fix.yaml.j2"
export STAGE_YAML="${PARMgfs}/gdas/aero/aero_det_stage.yaml.j2"
export SAVE_YAML="${PARMgfs}/gdas/aero/aero_det_save.yaml.j2"

export TASK_CONFIG_YAML="${PARMgfs}/gdas/aero/aero_det_config.yaml.j2"
export OBS_LIST_YAML="${PARMgfs}/gdas/aero/aero_obs_list.yaml.j2"
export BIAS_FILES_YAML="${PARMgfs}/gdas/aero/aero_bias_files.yaml.j2"

export io_layout_x="{{ IO_LAYOUT_X }}"
export io_layout_y="{{ IO_LAYOUT_Y }}"
Expand Down
6 changes: 3 additions & 3 deletions dev/parm/config/gfs/config.aeroanlgenb
Original file line number Diff line number Diff line change
Expand Up @@ -8,9 +8,9 @@ echo "BEGIN: config.aeroanlgenb"
# Get task specific resources
source "${EXPDIR}/config.resources" aeroanlgenb

export JEDI_CONFIG_YAML"${PARMgfs}/gdas/aero/aero_bmat_jedi_config.yaml.j2"
export STAGE_YAML"${PARMgfs}/gdas/aero/aero_bmat_stage.yaml.j2"
export SAVE_YAML"${PARMgfs}/gdas/aero/aero_bmat_save.yaml.j2"
export TASK_CONFIG_YAML="${PARMgfs}/gdas/aero/aero_bmat_config.yaml.j2"
export OBS_LIST_YAML="${PARMgfs}/gdas/aero/aero_obs_list.yaml.j2"
export BIAS_FILES_YAML="${PARMgfs}/gdas/aero/aero_bias_files.yaml.j2"

export aero_diffusion_iter=200
export aero_diffusion_horiz_len=300e3
Expand Down
4 changes: 1 addition & 3 deletions dev/parm/config/gfs/config.analcalc_fv3jedi
Original file line number Diff line number Diff line change
Expand Up @@ -14,9 +14,7 @@ export layout_y_analcalc_fv3jedi=2
# Get task specific resources
source "${EXPDIR}/config.resources" analcalc_fv3jedi

export STAGE_JEDI_FIX_YAML="${PARMgfs}/gdas/atm/atm_stage_jedi_fix.yaml.j2"
export STAGE_YAML="${PARMgfs}/gdas/analcalc/analcalc_stage.yaml.j2"
export JEDI_CONFIG_YAML="${PARMgfs}/gdas/analcalc/analcalc_jedi_config.yaml.j2"
export TASK_CONFIG_YAML="${PARMgfs}/gdas/analcalc/analcalc_config.yaml.j2"

if [[ ${DOHYBVAR} = "YES" ]]; then
export CASE_ANL=${CASE_ENS}
Expand Down
30 changes: 11 additions & 19 deletions dev/parm/config/gfs/config.atmanl.j2
Original file line number Diff line number Diff line change
Expand Up @@ -5,33 +5,25 @@

echo "BEGIN: config.atmanl"

export JCB_ALGO_YAML_VAR="{{ JCB_ALGO_YAML_VAR }}"
export JCB_ALGO_YAML_FV3INC="{{ JCB_ALGO_YAML_FV3INC }}"

export OBS_LIST_YAML="{{ OBS_LIST_YAML }}"
export VAR_JEDI_TEST_YAML="{{ VAR_JEDI_TEST_YAML }}"
export FV3INC_JEDI_TEST_YAML="{{ FV3INC_JEDI_TEST_YAML }}"
export STATICB_TYPE="{{ STATICB_TYPE }}"
export layout_x_atmanl="{{ LAYOUT_X_ATMANL }}"
export layout_y_atmanl="{{ LAYOUT_Y_ATMANL }}"
export io_layout_x="{{ IO_LAYOUT_X }}"
export io_layout_y="{{ IO_LAYOUT_Y }}"

export TASK_CONFIG_YAML="${PARMgfs}/gdas/atm/atm_det_config.yaml.j2"
export BIAS_FILES_YAML="${PARMgfs}/gdas/atm/atm_bias_files.yaml.j2"

export LOCALIZATION_TYPE="bump"
export INTERP_METHOD='barycentric'

if [[ ${DOHYBVAR} = "YES" ]]; then
# shellcheck disable=SC2153
export CASE_ANL=${CASE_ENS}
export BERROR_YAML="atmosphere_background_error_hybrid_${STATICB_TYPE}_${LOCALIZATION_TYPE}"
else
export CASE_ANL=${CASE}
export BERROR_YAML="atmosphere_background_error_static_${STATICB_TYPE}"
fi

export JEDI_CONFIG_YAML="${PARMgfs}/gdas/atm/atm_det_jedi_config.yaml.j2"
export STAGE_CRTM_COEFF_YAML="${PARMgfs}/gdas/atm/atm_stage_crtm_coeff.yaml.j2"
export STAGE_JEDI_FIX_YAML="${PARMgfs}/gdas/atm/atm_stage_jedi_fix.yaml.j2"
export STAGE_BKG_YAML="${PARMgfs}/gdas/atm/atm_det_stage_bkg.yaml.j2"
export STAGE_BERROR_YAML="${PARMgfs}/gdas/atm/atm_det_stage_berror_${STATICB_TYPE}.yaml.j2"
export STAGE_FV3ENS_YAML="${PARMgfs}/gdas/atm/atm_det_stage_fv3ens.yaml.j2"

export layout_x_atmanl="{{ LAYOUT_X_ATMANL }}"
export layout_y_atmanl="{{ LAYOUT_Y_ATMANL }}"

export io_layout_x="{{ IO_LAYOUT_X }}"
export io_layout_y="{{ IO_LAYOUT_Y }}"

echo "END: config.atmanl"
21 changes: 8 additions & 13 deletions dev/parm/config/gfs/config.atmensanl.j2
Original file line number Diff line number Diff line change
Expand Up @@ -5,22 +5,17 @@

echo "BEGIN: config.atmensanl"

export JCB_ALGO_YAML_LETKF="{{ JCB_ALGO_YAML_LETKF }}"
export JCB_ALGO_YAML_OBS="{{ JCB_ALGO_YAML_OBS }}"
export JCB_ALGO_YAML_SOL="{{ JCB_ALGO_YAML_SOL }}"
export JCB_ALGO_YAML_FV3INC="{{ JCB_ALGO_YAML_FV3INC }}"

export INTERP_METHOD='barycentric'

export JEDI_CONFIG_YAML="${PARMgfs}/gdas/atm/atm_ens_jedi_config.yaml.j2"
export STAGE_CRTM_COEFF_YAML="${PARMgfs}/gdas/atm/atm_stage_crtm_coeff.yaml.j2"
export STAGE_JEDI_FIX_YAML="${PARMgfs}/gdas/atm/atm_stage_jedi_fix.yaml.j2"
export STAGE_BKG_YAML="${PARMgfs}/gdas/atm/atm_ens_stage_bkg.yaml.j2"

export OBS_LIST_YAML="{{ OBS_LIST_YAML }}"
export LETKF_JEDI_TEST_YAML="{{ LETKF_JEDI_TEST_YAML }}"
export OBS_JEDI_TEST_YAML="{{ OBS_JEDI_TEST_YAML }}"
export SOL_JEDI_TEST_YAML="{{ SOL_JEDI_TEST_YAML }}"
export FV3INC_JEDI_TEST_YAML="{{ FV3INC_JEDI_TEST_YAML }}"
export layout_x_atmensanl="{{ LAYOUT_X_ATMENSANL }}"
export layout_y_atmensanl="{{ LAYOUT_Y_ATMENSANL }}"

export io_layout_x="{{ IO_LAYOUT_X }}"
export io_layout_y="{{ IO_LAYOUT_Y }}"

export TASK_CONFIG_YAML="${PARMgfs}/gdas/atm/atm_ens_config.yaml.j2"
export BIAS_FILES_YAML="${PARMgfs}/gdas/atm/atm_bias_files.yaml.j2"

echo "END: config.atmensanl"
4 changes: 1 addition & 3 deletions dev/parm/config/gfs/config.ecen_fv3jedi
Original file line number Diff line number Diff line change
Expand Up @@ -14,9 +14,7 @@ export layout_y_ecen_fv3jedi=1
# Get task specific resources
source "${EXPDIR}/config.resources" ecen_fv3jedi

export JEDI_CONFIG_YAML="${PARMgfs}/gdas/atm/atm_ecen_jedi_config.yaml.j2"
export STAGE_JEDI_FIX_YAML="${PARMgfs}/gdas/atm/atm_stage_jedi_fix.yaml.j2"
export STAGE_YAML="${PARMgfs}/gdas/atm/atm_ecen_stage.yaml.j2"
export TASK_CONFIG_YAML="${PARMgfs}/gdas/atm/atm_ecen_config.yaml.j2"

if [[ ${DOHYBVAR} = "YES" ]]; then
export CASE_ANL=${CASE_ENS}
Expand Down
12 changes: 2 additions & 10 deletions dev/parm/config/gfs/config.esnowanl.j2
Original file line number Diff line number Diff line change
Expand Up @@ -8,21 +8,13 @@ echo "BEGIN: config.esnowanl"
# Get task specific resources
source "${EXPDIR}/config.resources" esnowanl

export JEDI_CONFIG_YAML="${PARMgfs}/gdas/snow/snow_ens_jedi_config.yaml.j2"
export STAGE_JEDI_FIX_YAML="${PARMgfs}/gdas/snow/snow_stage_jedi_fix.yaml.j2"
export STAGE_OROG_YAML="${PARMgfs}/gdas/snow/snow_stage_orog.yaml.j2"
export STAGE_BERROR_YAML="${PARMgfs}/gdas/snow/snow_stage_berror.yaml.j2"
export STAGE_BKG_YAML="${PARMgfs}/gdas/snow/snow_ens_stage_bkg.yaml.j2"
export STAGE_IMS_SCF2IODA_YAML="${PARMgfs}/gdas/snow/snow_stage_ims_scf2ioda.yaml.j2"
export STAGE_GTS_YAML="${PARMgfs}/gdas/snow/obs/config/bufr2ioda_mapping.yaml.j2"
export SAVE_YAML="${PARMgfs}/gdas/snow/snow_ens_save.yaml.j2"
export TASK_CONFIG_YAML="${PARMgfs}/gdas/snow/snow_ens_config.yaml.j2"
export OBS_LIST_YAML="${PARMgfs}/gdas/snow/snow_obs_list.yaml.j2"

# Name of the executable that applies increment to bkg and its namelist template
export APPLY_INCR_EXE="${EXECgfs}/gdas_apply_incr.x"
export ENS_APPLY_INCR_NML_TMPL="${PARMgfs}/gdas/snow/ens_apply_incr_nml.j2"

export JEDI_CONFIG_YAML="${PARMgfs}/gdas/snow/snow_ens_jedi_config.yaml.j2"

export io_layout_x="{{ IO_LAYOUT_X }}"
export io_layout_y="{{ IO_LAYOUT_Y }}"

Expand Down
8 changes: 2 additions & 6 deletions dev/parm/config/gfs/config.snowanl.j2
Original file line number Diff line number Diff line change
Expand Up @@ -12,12 +12,8 @@ source "${EXPDIR}/config.resources" snowanl
export APPLY_INCR_EXE="${EXECgfs}/gdas_apply_incr.x"
export APPLY_INCR_NML_TMPL="${PARMgfs}/gdas/snow/apply_incr_nml.j2"

export JEDI_CONFIG_YAML="${PARMgfs}/gdas/snow/snow_det_jedi_config.yaml.j2"
export STAGE_JEDI_FIX_YAML="${PARMgfs}/gdas/snow/snow_stage_jedi_fix.yaml.j2"
export STAGE_BKG_YAML="${PARMgfs}/gdas/snow/snow_det_stage_bkg.yaml.j2"
export STAGE_BERROR_YAML="${PARMgfs}/gdas/snow/snow_stage_berror.yaml.j2"
export STAGE_GTS_YAML="${PARMgfs}/gdas/snow/obs/config/bufr2ioda_mapping.yaml.j2"
export STAGE_IMS_SCF2IODA_YAML="${PARMgfs}/gdas/snow/snow_stage_ims_scf2ioda.yaml.j2"
export TASK_CONFIG_YAML="${PARMgfs}/gdas/snow/snow_det_config.yaml.j2"
export OBS_LIST_YAML="${PARMgfs}/gdas/snow/snow_obs_list.yaml.j2"

export io_layout_x="{{ IO_LAYOUT_X }}"
export io_layout_y="{{ IO_LAYOUT_Y }}"
Expand Down
14 changes: 8 additions & 6 deletions dev/parm/config/gfs/yaml/defaults.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -29,23 +29,25 @@ base:
NMEM_ENS_GFS_OFFSET: 20

atmanl:
JCB_ALGO_YAML_VAR: "${PARMgfs}/gdas/atm/jcb-prototype_3dvar.yaml.j2"
JCB_ALGO_YAML_FV3INC: "${PARMgfs}/gdas/atm/jcb-prototype_3dvar-fv3inc.yaml.j2"
STATICB_TYPE: "gsibec"
LAYOUT_X_ATMANL: 8
LAYOUT_Y_ATMANL: 8
IO_LAYOUT_X: 1
IO_LAYOUT_Y: 1
OBS_LIST_YAML: "${PARMgfs}/gdas/atm/atm_obs_list.yaml.j2"
VAR_JEDI_TEST_YAML: ""
FV3INC_JEDI_TEST_YAML: ""

atmensanl:
JCB_ALGO_YAML_LETKF: "${PARMgfs}/gdas/atm/jcb-prototype_lgetkf.yaml.j2"
JCB_ALGO_YAML_OBS: "${PARMgfs}/gdas/atm/jcb-prototype_lgetkf_observer.yaml.j2"
JCB_ALGO_YAML_SOL: "${PARMgfs}/gdas/atm/jcb-prototype_lgetkf_solver.yaml.j2"
JCB_ALGO_YAML_FV3INC: "${PARMgfs}/gdas/atm/jcb-prototype_lgetkf-fv3inc.yaml.j2"
LAYOUT_X_ATMENSANL: 8
LAYOUT_Y_ATMENSANL: 8
IO_LAYOUT_X: 1
IO_LAYOUT_Y: 1
OBS_LIST_YAML: "${PARMgfs}/gdas/atm/atm_obs_list.yaml.j2"
LETKF_JEDI_TEST_YAML: ""
OBS_JEDI_TEST_YAML: ""
SOL_JEDI_TEST_YAML: ""
FV3INC_JEDI_TEST_YAML: ""

aeroanl:
IO_LAYOUT_X: 1
Expand Down
5 changes: 4 additions & 1 deletion jobs/JGDAS_AERO_ANALYSIS_GENERATE_BMATRIX
Original file line number Diff line number Diff line change
Expand Up @@ -13,9 +13,12 @@ source "${HOMEgfs}/ush/jjob_header.sh" -e "aeroanlgenb" -c "base aeroanl aeroanl
# Generate COM variables from templates
YMD=${PDY} HH=${cyc} declare_from_tmpl -rx COMIN_OBS:COM_OBS_TMPL \
COMOUT_CHEM_BMAT:COM_CHEM_BMAT_TMPL \
COMIN_ATMOS_RESTART:COM_ATMOS_RESTART_TMPL
COMIN_ATMOS_RESTART:COM_ATMOS_RESTART_TMPL \
COMOUT_CONF:COM_CONF_TMPL


mkdir -p "${COMOUT_CHEM_BMAT}"
mkdir -p "${COMOUT_CONF}"

###############################################################
# Run relevant script
Expand Down
4 changes: 4 additions & 0 deletions jobs/JGLOBAL_AERO_ANALYSIS_FINALIZE
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,10 @@ YMD=${PDY} HH=${cyc} declare_from_tmpl -rx \
COMOUT_CONF:COM_CONF_TMPL \
COMOUT_ATMOS_RESTART:COM_ATMOS_RESTART_TMPL

mkdir -m 755 -p "${COMOUT_CHEM_ANALYSIS}"
mkdir -m 755 -p "${COMOUT_ATMOS_RESTART}"
mkdir -m 755 -p "${COMOUT_CONF}"

###############################################################
# Run relevant script

Expand Down
6 changes: 5 additions & 1 deletion jobs/JGLOBAL_ATMOS_ANALYSIS_CALC_FV3JEDI
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,11 @@ YMD=${PDY} HH=${cyc} RUN=${RUN} declare_from_tmpl -rx \
YMD=${PDY} HH=${cyc} RUN=${RUN} declare_from_tmpl -rx \
COMOUT_ATMOS_ANALYSIS:COM_ATMOS_ANALYSIS_TMPL
RUN=${GDUMP} YMD=${gPDY} HH=${gcyc} declare_from_tmpl -rx \
COMIN_ATMOS_HISTORY_PREV:COM_ATMOS_HISTORY_TMPL
COMIN_ATMOS_HISTORY_PREV:COM_ATMOS_HISTORY_TMPL
YMD=${PDY} HH=${cyc} declare_from_tmpl -rx \
COMOUT_CONF:COM_CONF_TMPL

mkdir -m 775 -p "${COMOUT_CONF}"

##############################################
# Run relevant script
Expand Down
2 changes: 0 additions & 2 deletions jobs/JGLOBAL_ATM_ANALYSIS_INITIALIZE
Original file line number Diff line number Diff line change
Expand Up @@ -24,8 +24,6 @@ RUN=${GDUMP} YMD=${gPDY} HH=${gcyc} declare_from_tmpl -rx \
COMIN_ATMOS_ANALYSIS_PREV:COM_ATMOS_ANALYSIS_TMPL \
COMIN_ATMOS_HISTORY_PREV:COM_ATMOS_HISTORY_TMPL

mkdir -m 775 -p "${COMIN_ATMOS_ANALYSIS_PREV}"

###############################################################
# Run relevant script

Expand Down
2 changes: 1 addition & 1 deletion sorc/gdas.cd
Submodule gdas.cd updated 90 files
+4 −0 parm/aero/aero_bias_files.yaml.j2
+101 −0 parm/aero/aero_bmat_config.yaml.j2
+0 −19 parm/aero/aero_bmat_jedi_config.yaml.j2
+0 −19 parm/aero/aero_bmat_save.yaml.j2
+0 −46 parm/aero/aero_bmat_stage.yaml.j2
+0 −15 parm/aero/aero_crtm_coeff.yaml.j2
+107 −0 parm/aero/aero_det_config.yaml.j2
+0 −7 parm/aero/aero_det_jedi_config.yaml.j2
+0 −25 parm/aero/aero_det_save.yaml.j2
+0 −50 parm/aero/aero_det_stage.yaml.j2
+0 −6 parm/aero/aero_jedi_fix.yaml.j2
+4 −0 parm/aero/aero_obs_list.yaml.j2
+0 −3 parm/aero/aero_stage_crtm_coeff.yaml.j2
+0 −3 parm/aero/aero_stage_jedi_fix.yaml.j2
+6 −0 parm/aero/aero_stage_obs.yaml.j2
+5 −5 parm/aero/jcb-base.yaml.j2
+1 −4 parm/aero/jcb-prototype_3dvar.yaml.j2
+61 −0 parm/analcalc/analcalc_config.yaml.j2
+0 −25 parm/analcalc/analcalc_jedi_config.yaml.j2
+0 −14 parm/analcalc/analcalc_stage.yaml.j2
+10 −0 parm/atm/atm_bias_files.yaml.j2
+72 −0 parm/atm/atm_det_config.yaml.j2
+0 −13 parm/atm/atm_det_jedi_config.yaml.j2
+2 −8 parm/atm/atm_det_stage_berror_gsibec.yaml.j2
+0 −5 parm/atm/atm_det_stage_bkg.yaml.j2
+0 −15 parm/atm/atm_det_stage_fv3ens.yaml.j2
+92 −0 parm/atm/atm_ecen_config.yaml.j2
+0 −12 parm/atm/atm_ecen_jedi_config.yaml.j2
+0 −36 parm/atm/atm_ecen_stage.yaml.j2
+87 −0 parm/atm/atm_ens_config.yaml.j2
+0 −27 parm/atm/atm_ens_jedi_config.yaml.j2
+0 −23 parm/atm/atm_ens_stage_bkg.yaml.j2
+45 −0 parm/atm/atm_obs_list.yaml.j2
+0 −3 parm/atm/atm_stage_crtm_coeff.yaml.j2
+0 −3 parm/atm/atm_stage_jedi_fix.yaml.j2
+6 −0 parm/atm/atm_stage_obs.yaml.j2
+5 −16 parm/atm/jcb-base.yaml.j2
+6 −0 parm/atm/jcb-prototype_3dvar-fv3inc.yaml.j2
+7 −45 parm/atm/jcb-prototype_3dvar.yaml.j2
+1 −15 parm/atm/jcb-prototype_4d.yaml.j2
+6 −0 parm/atm/jcb-prototype_lgetkf-fv3inc.yaml.j2
+7 −27 parm/atm/jcb-prototype_lgetkf.yaml.j2
+10 −30 parm/atm/jcb-prototype_lgetkf_observer.yaml.j2
+11 −31 parm/atm/jcb-prototype_lgetkf_solver.yaml.j2
+1 −1 parm/jcb-gdas
+5 −5 parm/snow/jcb-base.yaml.j2
+1 −7 parm/snow/jcb-prototype_2dvar.yaml.j2
+0 −5 parm/snow/obs/config/bufr_sfcsno_mapping.yaml
+0 −5 parm/snow/obs/config/bufr_snocvr_mapping.yaml
+72 −0 parm/snow/obs/config/bufr_snomad_mapping.yaml
+11 −0 parm/snow/prep/prep_snocvr_snomad.yaml.j2
+84 −0 parm/snow/snow_det_config.yaml.j2
+0 −13 parm/snow/snow_det_jedi_config.yaml.j2
+0 −8 parm/snow/snow_det_stage_bkg.yaml.j2
+167 −0 parm/snow/snow_ens_config.yaml.j2
+0 −20 parm/snow/snow_ens_jedi_config.yaml.j2
+0 −43 parm/snow/snow_ens_save.yaml.j2
+0 −52 parm/snow/snow_ens_stage_bkg.yaml.j2
+0 −6 parm/snow/snow_jedi_fix.yaml.j2
+7 −0 parm/snow/snow_obs_list.yaml.j2
+0 −3 parm/snow/snow_stage_berror.yaml.j2
+1 −3 parm/snow/snow_stage_bufr2ioda_mapping.yaml.j2
+1 −2 parm/snow/snow_stage_ims_scf2ioda.yaml.j2
+0 −3 parm/snow/snow_stage_jedi_fix.yaml.j2
+11 −0 parm/snow/snow_stage_obs.yaml.j2
+0 −8 parm/snow/snow_stage_orog.yaml.j2
+3 −0 test/atm/global-workflow/atm_obs_list.yaml.j2
+10 −8 test/atm/global-workflow/config.yaml
+0 −26 test/atm/global-workflow/jcb-prototype_3dvar.yaml.j2
+0 −31 test/atm/global-workflow/jcb-prototype_lgetkf.yaml.j2
+0 −37 test/atm/global-workflow/jcb-prototype_lgetkf_observer.yaml.j2
+0 −37 test/atm/global-workflow/jcb-prototype_lgetkf_solver.yaml.j2
+1 −7 test/atm/global-workflow/jedi-test_3dvar-fv3inc.yaml.j2
+7 −0 test/atm/global-workflow/jedi-test_3dvar.yaml.j2
+1 −7 test/atm/global-workflow/jedi-test_lgetkf-fv3inc.yaml.j2
+7 −0 test/atm/global-workflow/jedi-test_lgetkf-observer.yaml.j2
+7 −0 test/atm/global-workflow/jedi-test_lgetkf-solver.yaml.j2
+7 −0 test/atm/global-workflow/jedi-test_lgetkf.yaml.j2
+8 −0 test/gw-ci/atm/atm_obs_list_ufs_hybatmDA.yaml.j2
+0 −24 test/gw-ci/atm/jcb-prototype_3dvar_ufs_hybatmDA.yaml.j2
+0 −39 test/gw-ci/atm/jcb-prototype_lgetkf_observer_ufs_hybatmDA.yaml.j2
+0 −42 test/gw-ci/atm/jcb-prototype_lgetkf_solver_ufs_hybatmDA.yaml.j2
+0 −38 test/gw-ci/atm/jcb-prototype_lgetkf_ufs_hybatmDA.yaml.j2
+1 −7 test/gw-ci/atm/jedi-test_3dvar-fv3inc_ufs_hybatmDA.yaml.j2
+7 −0 test/gw-ci/atm/jedi-test_3dvar_ufs_hybatmDA.yaml.j2
+1 −7 test/gw-ci/atm/jedi-test_lgetkf-fv3inc_ufs_hybatmDA.yaml.j2
+7 −0 test/gw-ci/atm/jedi-test_lgetkf-observer_ufs_hybatmDA.yaml.j2
+7 −0 test/gw-ci/atm/jedi-test_lgetkf-solver_ufs_hybatmDA.yaml.j2
+7 −0 test/gw-ci/atm/jedi-test_lgetkf_ufs_hybatmDA.yaml.j2
+109 −0 ush/snow/bufr_snocvr_snomad.py
Loading