Skip to content

Updates for Gaea: verif-global tag, tracker tag, Fit2Obs tag, and C768 analysis resources #3463

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
DavidHuber-NOAA merged 37 commits into from
Mar 19, 2025
Merged

Updates for Gaea: verif-global tag, tracker tag, Fit2Obs tag, and C768 analysis resources #3463

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
bd0b835
Update tracker version to 1.2.0
DavidHuber-NOAA Mar 7, 2025
8deda29
Re-enable tracker/genesis on Orion and Hercules
DavidHuber-NOAA Mar 10, 2025
3c392be
Merge remote-tracking branch 'emc/develop' into feature/tracker_120
DavidHuber-NOAA Mar 10, 2025
89930d1
Update git paths on MSU
DavidHuber-NOAA Mar 10, 2025
2c93211
Update glopara paths to new role-global space
KateFriedman-NOAA Mar 10, 2025
69d86c4
Enable HPSS on C5/6; add constaint option to tasks.py
DavidHuber-NOAA Mar 11, 2025
3583745
Remove obsolete note about scrontab on gaea
DavidHuber-NOAA Mar 11, 2025
22f70c7
Fix arch_tars dependency to prevent early cleanup
DavidHuber-NOAA Mar 11, 2025
b3bf2ef
Merge branch 'develop' into feature/gaea_hpss
DavidHuber-NOAA Mar 12, 2025
f580d20
Merge remote-tracking branch 'origin/develop' into feature/gaea_hpss
DavidHuber-NOAA Mar 12, 2025
ae7385c
Correct location of lmod init script on C6
DavidHuber-NOAA Mar 12, 2025
85637db
Merge remote-tracking branch 'origin/develop' into feature/gaea_hpss
DavidHuber-NOAA Mar 13, 2025
5df36b2
Remove debug print statement
DavidHuber-NOAA Mar 13, 2025
8f8c481
Update prepobs and fit2obs paths for role-global
KateFriedman-NOAA Mar 13, 2025
3fad66c
Merge remote-tracking branch 'origin/develop' into feature/role-globa…
KateFriedman-NOAA Mar 13, 2025
89c9485
Merge branch 'NOAA-EMC:develop' into feature/role-global-msu
KateFriedman-NOAA Mar 13, 2025
a6d45f6
Merge branch 'NOAA-EMC:develop' into feature/role-global-msu
KateFriedman-NOAA Mar 14, 2025
5e585d9
Merge branch 'develop' into feature/role-global-msu
KateFriedman-NOAA Mar 14, 2025
177b2ed
Increase C768 analysis resources for C6
DavidHuber-NOAA Mar 14, 2025
edc4ee4
Merge branch 'develop' into feature/role-global-msu
KateFriedman-NOAA Mar 14, 2025
30e9128
Merge branch 'develop' into feature/role-global-msu
KateFriedman-NOAA Mar 14, 2025
b808a22
Merge remote-tracking branch 'origin/feature/gaea_hpss' into feature/…
DavidHuber-NOAA Mar 18, 2025
6f30dff
Merge remote-tracking branch 'emc/develop' into feature/tracker_120
DavidHuber-NOAA Mar 18, 2025
869e3d8
Merge branch 'feature/gaea_hpss' of github.com:davidhuber-noaa/global…
DavidHuber-NOAA Mar 18, 2025
cbb8e92
Merge remote-tracking branch 'origin/feature/gaea_hpss' into feature/…
DavidHuber-NOAA Mar 18, 2025
d94f00e
Merge remote-tracking branch 'origin/feature/768anl_c6' into feature/…
DavidHuber-NOAA Mar 18, 2025
c17f905
Update the fit2obs version
DavidHuber-NOAA Mar 18, 2025
2127602
Update verif-global tag to include Gaea support
DavidHuber-NOAA Mar 18, 2025
d50b6d1
Reenable METplus on Hera
DavidHuber-NOAA Mar 18, 2025
99a803b
Let gaeac6 inherit the default fit2obs version
DavidHuber-NOAA Mar 18, 2025
6c3f8fc
Update capabilities matrix for C5/6.
DavidHuber-NOAA Mar 18, 2025
96da150
Update GIT path in module_base for hercules
DavidHuber-NOAA Mar 18, 2025
43a48a9
Update paths for hercules and orion
DavidHuber-NOAA Mar 18, 2025
784d946
Update tracker/fit2obs versions on WCOSS2
DavidHuber-NOAA Mar 18, 2025
e00bce8
Merge remote-tracking branch 'emc/develop' into feature/tracker_120
DavidHuber-NOAA Mar 18, 2025
a8c694b
Use if block instead of _RUN for C6 analysis tasks
DavidHuber-NOAA Mar 18, 2025
e4a57ec
Merge branch 'develop' into feature/tracker_120
DavidHuber-NOAA Mar 19, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions docs/source/hpc.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -144,7 +144,7 @@ The Global Workflow provides capabilities for deterministic and ensemble forecas
-
-
-
-
- X
- X
* - Gaea C6
- 1
Expand All @@ -158,7 +158,7 @@ The Global Workflow provides capabilities for deterministic and ensemble forecas
-
-
- X
-
- X
- X
* - AWS (PW)
- 3
Expand Down
14 changes: 14 additions & 0 deletions parm/config/gfs/config.resources.GAEAC6
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,20 @@ case ${step} in
esac
export tasks_per_node=$(( max_tasks_per_node / threads_per_task ))
;;

"anal")
if [[ "${CASE}" == "C768" || "${CASE}" == "C1152" ]]; then
export threads_per_task=8
# Make ntasks a multiple of 16
if [[ "${RUN}" == "gdas" ]]; then
export ntasks=784
elif [[ "${RUN}" == "gfs" ]]; then
export ntasks=832
fi
export tasks_per_node=$(( max_tasks_per_node / threads_per_task ))
fi
;;
*)

;;
esac
2 changes: 1 addition & 1 deletion sorc/verif-global.fd
Open in desktop
Submodule verif-global.fd updated 29 files
+2 −0 README.md
+38 −0 modulefiles/emc_verif_global_gaeac5.lua
+38 −0 modulefiles/emc_verif_global_gaeac6.lua
+1 −1 scripts/exgrid2grid_step1.sh
+1 −1 scripts/exgrid2grid_step2.sh
+1 −1 scripts/exgrid2obs_step1.sh
+1 −1 scripts/exgrid2obs_step2.sh
+1 −1 scripts/exmaps2d.sh
+1 −1 scripts/exmapsda.sh
+1 −1 scripts/exprecip_step1.sh
+1 −1 scripts/exprecip_step2.sh
+1 −1 scripts/exsatellite_step1.sh
+1 −1 scripts/exsatellite_step2.sh
+2 −2 scripts/extropcyc.sh
+11 −1 ush/build_webpage.py
+3 −3 ush/create_METplus_job_scripts.py
+3 −3 ush/get_data_files.py
+7 −1 ush/get_machine.py
+37 −1 ush/load_modules.sh
+1 −1 ush/load_to_METviewer_AWS.py
+9 −5 ush/plotting_scripts/plot_maps2d_lat_lon_errors.py
+7 −3 ush/plotting_scripts/plot_maps2d_model2obs_calc_vars_lat_lon_errors.py
+8 −4 ush/plotting_scripts/plot_mapsda_lat_lon_errors.py
+1 −1 ush/plotting_scripts/plot_scorecard.py
+1 −1 ush/plotting_scripts/plot_title.py
+21 −1 ush/run_batch.py
+9 −1 ush/run_verif_global_in_global_workflow.sh
+56 −11 ush/set_up_verif_global.sh
+ − ush/webpage.tar
4 changes: 0 additions & 4 deletions versions/run.gaeac6.ver
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,8 +9,4 @@ export hsi_ver=9.3

source "${HOMEgfs:-}/versions/spack.ver"

# Gaea uses a newer version of Fit2Obs
export fit2obs_ver=1.1.5
# Gaea uses a newer version of the ensemble tracker as well
export ens_tracker_ver=v1.2.0
export spack_mod_path="/ncrc/proj/epic/spack-stack/c6/spack-stack-${spack_stack_ver}/envs/${spack_env}/install/modulefiles/Core"
4 changes: 2 additions & 2 deletions versions/run.wcoss2.ver
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@ export metplus_ver=3.1.1
export obsproc_run_ver=1.2.0
export prepobs_run_ver=1.1.0

export ens_tracker_ver=feature-GFSv17_com_reorg
export fit2obs_ver=1.1.4
export ens_tracker_ver=v1.2.0
export fit2obs_ver=1.1.5
export mos_ver=5.4.3
export mos_shared_ver=2.7.2
4 changes: 2 additions & 2 deletions versions/spack.ver
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -43,5 +43,5 @@ export py_xarray_ver=2023.7.0
export obsproc_run_ver=1.2.0
export prepobs_run_ver=1.1.0

export ens_tracker_ver=feature-GFSv17_com_reorg
export fit2obs_ver=1.1.4
export ens_tracker_ver=v1.2.0
export fit2obs_ver=1.1.5
2 changes: 0 additions & 2 deletions workflow/hosts/hera.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,5 +27,3 @@ COMINecmwf: /scratch1/NCEPDEV/global/glopara/data/external_gempak/ecmwf
COMINnam: /scratch1/NCEPDEV/global/glopara/data/external_gempak/nam
COMINukmet: /scratch1/NCEPDEV/global/glopara/data/external_gempak/ukmet
AERO_INPUTS_DIR: /scratch1/NCEPDEV/global/glopara/data/gocart_emissions
# TODO Reenable when RDHPCS#2025022654000078 is resolved
DO_METP: 'NO'
2 changes: 0 additions & 2 deletions workflow/hosts/hercules.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,8 +22,6 @@ ARCHCOM_TO: 'globus_hpss'
ATARDIR: '/NCEPDEV/${HPSS_PROJECT}/1year/${USER}/${machine}/scratch/${PSLOT}'
MAKE_NSSTBUFR: 'NO'
MAKE_ACFTBUFR: 'NO'
DO_TRACKER: 'NO'
DO_GENESIS: 'NO'
DO_AWIPS: 'NO'
SUPPORTED_RESOLUTIONS: ['C1152', 'C768', 'C384', 'C192', 'C96', 'C48']
COMINecmwf: '/work2/noaa/global/role-global/data/external_gempak/ecmwf'
Expand Down
2 changes: 0 additions & 2 deletions workflow/hosts/orion.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,8 +22,6 @@ ARCHCOM_TO: 'globus_hpss'
ATARDIR: '/NCEPDEV/${HPSS_PROJECT}/1year/${USER}/${machine}/scratch/${PSLOT}'
MAKE_NSSTBUFR: 'NO'
MAKE_ACFTBUFR: 'NO'
DO_TRACKER: 'NO'
DO_GENESIS: 'NO'
DO_AWIPS: 'NO'
SUPPORTED_RESOLUTIONS: ['C1152', 'C768', 'C384', 'C192', 'C96', 'C48']
COMINecmwf: '/work2/noaa/global/role-global/data/external_gempak/ecmwf'
Expand Down