Skip to content

updates to run C1152 on gaea #3438

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
DavidHuber-NOAA merged 3 commits into from
Mar 12, 2025
Merged

updates to run C1152 on gaea #3438

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
e4259c0
updates to run C1152 on gaea, also used more task/node for upp but not
JessicaMeixner-NOAA Mar 11, 2025
02990d7
Merge branch 'NOAA-EMC:develop' into gaea_1152
JessicaMeixner-NOAA Mar 11, 2025
ca74109
update based on review comments
JessicaMeixner-NOAA Mar 11, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 8 additions & 1 deletion env/GAEAC6.env
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -227,7 +227,14 @@ case ${step} in
;;
"fcst" | "efcs")

export OMP_STACKSIZE=512M
export OMP_STACKSIZE=1024M

export MPICH_COLL_SYNC=MPI_Bcast
export FI_VERBS_PREFER_XRC=0
export FI_CXI_RX_MATCH_MODE=hybrid
export COMEX_EAGER_THRESHOLD=65536
export FI_CXI_RDZV_THRESHOLD=65536
export FI_CXI_DEFAULT_CQ_SIZE=1048576

(( nnodes = (ntasks+tasks_per_node-1)/tasks_per_node ))
(( ufs_ntasks = nnodes*tasks_per_node ))
Expand Down
2 changes: 1 addition & 1 deletion parm/config/gfs/config.resources.GAEAC6
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ case ${step} in
export tasks_per_node=144
;;
"C1152")
#TODO set tasks_per_node after investigating a safe threshold
export tasks_per_node=144
;;
*)
# Nothing to do for other resolutions
Expand Down
12 changes: 4 additions & 8 deletions parm/config/gfs/config.ufs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -299,8 +299,8 @@ case "${fv3_res}" in
export DELTIM=150
export layout_x_gdas=8
export layout_y_gdas=16
export layout_x_gfs=8
export layout_y_gfs=16
export layout_x_gfs=16
export layout_y_gfs=24
Comment on lines +302 to +303
Copy link
Copy Markdown
Contributor

@DavidHuber-NOAA DavidHuber-NOAA Mar 12, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@AntonMFernando-NOAA FYI in reference to #3420 the GFS portion of C1152 will be changing to this layout.

export nthreads_fv3_gdas=4
export nthreads_fv3_gfs=4
export nthreads_ufs_gdas=4
Expand Down Expand Up @@ -605,7 +605,7 @@ if [[ "${skip_ww3}" == "false" ]]; then
export cplwav=".true."
export cplwav2atm=".true."
model_list="${model_list}.wave"
nthreads_ww3=2
nthreads_ww3=1
case "${ww3_res}" in
"gnh_10m;aoc_9km;gsh_15m")
ntasks_ww3=140
Expand All @@ -618,26 +618,22 @@ if [[ "${skip_ww3}" == "false" ]]; then
;;
"glo_100")
ntasks_ww3=20
nthreads_ww3=1
;;
"glo_200")
ntasks_ww3=30
nthreads_ww3=1
;;
"glo_500")
ntasks_ww3=12
nthreads_ww3=1
;;
"mx025")
ntasks_ww3=80
;;
"uglo_15km")
ntasks_ww3=1000
nthreads_ww3=1
nthreads_ww3=2
;;
"uglo_100km")
ntasks_ww3=40
nthreads_ww3=1
;;
*)
echo "FATAL ERROR: Unsupported WW3 resolution = ${ww3_res}, ABORT!"
Expand Down
2 changes: 1 addition & 1 deletion workflow/hosts/gaeac6.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,6 @@ MAKE_ACFTBUFR: 'NO'
DO_TRACKER: 'YES'
DO_GENESIS: 'YES'
DO_METP: 'NO'
SUPPORTED_RESOLUTIONS: ['C768', 'C384', 'C192', 'C96', 'C48']
SUPPORTED_RESOLUTIONS: ['C1152', 'C768', 'C384', 'C192', 'C96', 'C48']
AERO_INPUTS_DIR: '/gpfs/f6/drsa-precip3/world-shared/role.glopara/data/gocart_emissions'
USE_SCRONTAB: 'YES'