Skip to content

Issue 694: Upgrade/refactoring for U and V write-out sub for FV3REG GSI failure … #698

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ShunLiu-NOAA merged 52 commits into from
Mar 20, 2024
Merged

Issue 694: Upgrade/refactoring for U and V write-out sub for FV3REG GSI failure … #698

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
52 commits
Select commit Hold shift + click to select a range
1ef6000
Upgrade/refactoring for U and V write-out sub for FV3REG GSI failure …
TingLei-daprediction Feb 14, 2024
f12245e
Upgrade/refactoring for U and V write-out sub for FV3REG GSI failure …
TingLei-daprediction Feb 14, 2024
76b061f
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Feb 15, 2024
2d8d61f
Merge branch 'develop' into feature/fv3reg_parallel_io_upgrade
TingLei-daprediction Feb 15, 2024
b929e66
Merge branch 'develop' into feature/fv3reg_parallel_io_upgrade
TingLei-daprediction Feb 15, 2024
9265ef8
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
Feb 15, 2024
558979d
update feature/fv3reg_parallel_io_upgrade with changes to writeuv_v1 …
TingLei-daprediction Feb 16, 2024
1563c39
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Feb 16, 2024
41c6ae4
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Feb 16, 2024
e0dc8d0
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Feb 18, 2024
2c90f1e
Now,for fv3reg cold start files, only mpi processes acctually particp…
TingLei-daprediction Feb 22, 2024
837a665
Co-authored by: Ming Hu at Ming.Hu@noaa.gov
TingLei-daprediction Feb 22, 2024
f33685e
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Feb 22, 2024
9bf9dbc
Sleaning of print-out lines for debugging
TingLei-daprediction Feb 23, 2024
c95a4bb
Sleaning of print-out lines for debugging
TingLei-daprediction Feb 23, 2024
bbfbf5d
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Feb 24, 2024
54e9798
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Feb 24, 2024
ea73030
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Feb 24, 2024
6a184ac
Merge branch 'develop' into feature/fv3reg_parallel_io_upgrade
Feb 25, 2024
a1627d3
modification in regress scripts for setup for fv3reg GSI
TingLei-daprediction Feb 26, 2024
57f1839
modification in regress scripts for setup for fv3reg GSI
TingLei-daprediction Feb 26, 2024
ddb9f46
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Feb 26, 2024
3d1010b
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Feb 26, 2024
e81a543
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Feb 26, 2024
39046a3
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Feb 26, 2024
bfcc7be
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Feb 27, 2024
c0cc247
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Feb 27, 2024
d85c25c
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Feb 27, 2024
c6dee34
tunning of mpi task layout in regression tests on Hercules
TingLei-daprediction Feb 27, 2024
ca5ae10
tunning of mpi task layout in regression tests on Hercules
TingLei-daprediction Feb 27, 2024
23206bf
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Feb 27, 2024
c069533
adding nf90_independent for non-wind variables IO in Fv3reg GSI
TingLei-daprediction Feb 27, 2024
480d3db
tunning of mpi task layout in regression tests on Hercules
TingLei-daprediction Feb 27, 2024
9b5610d
corrected use of '--mem=0, --recursive' in sbatch job on Herclues
TingLei-daprediction Feb 29, 2024
cccbd63
tuning of mpi task layout
TingLei-daprediction Feb 29, 2024
0c8c285
tuning of sbatch parameters for fv3reg tests on hera
TingLei-daprediction Mar 1, 2024
aae5ea6
tuning of slurm paramters for FV3REG GSI regression tests on orion
TingLei-daprediction Mar 1, 2024
1e1c3da
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Mar 1, 2024
6796e0e
revert to a larger requested nodes number for hafs_4denvar_glbens_hip…
TingLei-daprediction Mar 1, 2024
f8f8d20
tuning slurm parameters for hafs tests on orion
TingLei-daprediction Mar 1, 2024
dbc63fb
put back disabled I_MPI_EXTRA_FILESYSTEM for regression tests on Herc…
TingLei-daprediction Mar 5, 2024
f8ddae5
Merge branch 'NOAA-EMC:develop' into feature/fv3reg_parallel_io_upgrade
TingLei-daprediction Mar 5, 2024
476d321
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Mar 5, 2024
72c3009
removed 'call fush(6)' in gsi_rfv3io_mod.f90 and a change in sub_jet
TingLei-daprediction Mar 6, 2024
46f270b
fix for undefined mpi parameters complained by gcc
TingLei-daprediction Mar 6, 2024
d58c431
Merge branch 'feature/fv3reg_parallel_io_upgrade' of https://github.c…
TingLei-daprediction Mar 6, 2024
281b57f
re-correction of a few slurm parameters for regression tests on hera…
TingLei-daprediction Mar 17, 2024
3e63b20
fix of potps on jet to match that on hera for rrfs_3denvar_glbens re…
TingLei-daprediction Mar 18, 2024
928af48
fix of potps on jet to match that on hera for rrfs_3denvar_glbens re…
TingLei-daprediction Mar 18, 2024
9e0431f
Merge branch 'NOAA-EMC:develop' into feature/fv3reg_parallel_io_upgrade
TingLei-daprediction Mar 18, 2024
216b67a
unanimously assign 4 nodes for regression tests on RDHPCS machines
TingLei-daprediction Mar 18, 2024
ddfef7e
Merge branch 'NOAA-EMC:develop' into feature/fv3reg_parallel_io_upgrade
TingLei-daprediction Mar 19, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions regression/regression_driver.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -36,10 +36,12 @@ for jn in `seq ${RSTART} ${REND}`; do
export scripts=${scripts_updat:-$scripts}
export fixgsi=${fixgsi_updat:-$fixgsi}
export modulefiles=${modulefiles_updat:-$modulefiles}
export ush=${ush_update:-$ush}
Comment thread
RussTreadon-NOAA marked this conversation as resolved.
else
export scripts=${scripts_contrl:-$scripts}
export fixgsi=${fixgsi_contrl:-$fixgsi}
export modulefiles=${modulefiles_contrl:-$modulefiles}
export ush=${ush_cntrl:-$ush}
fi
rm -f ${job[$jn]}.out

Expand Down
48 changes: 24 additions & 24 deletions regression/regression_param.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -87,17 +87,17 @@ case $regtest in
rrfs_3denvar_glbens)

if [[ "$machine" = "Hera" ]]; then
topts[1]="0:15:00" ; popts[1]="20/1/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="20/2/" ; ropts[2]="/1"
topts[1]="0:15:00" ; popts[1]="5/4/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="10/4/" ; ropts[2]="/1"
elif [[ "$machine" = "Orion" ]]; then
topts[1]="0:15:00" ; popts[1]="20/1/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="20/2/" ; ropts[2]="/2"
topts[1]="0:15:00" ; popts[1]="5/4/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="10/4/" ; ropts[2]="/2"
elif [[ "$machine" = "Hercules" ]]; then
topts[1]="0:15:00" ; popts[1]="20/1/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="20/2/" ; ropts[2]="/2"
topts[1]="0:15:00" ; popts[1]="5/4/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="10/4/" ; ropts[2]="/2"
elif [[ "$machine" = "Jet" ]]; then
topts[1]="0:15:00" ; popts[1]="20/1/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="20/2/" ; ropts[2]="/1"
topts[1]="0:15:00" ; popts[1]="5/4/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="10/4/" ; ropts[2]="/1"
elif [[ "$machine" = "Gaea" ]]; then
topts[1]="0:15:00" ; popts[1]="18/1/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="18/2/" ; ropts[2]="/1"
Expand All @@ -117,17 +117,17 @@ case $regtest in
hafs_3denvar_hybens)

if [[ "$machine" = "Hera" ]]; then
topts[1]="0:15:00" ; popts[1]="20/1/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="20/2/" ; ropts[2]="/1"
topts[1]="0:15:00" ; popts[1]="5/4/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="10/4/" ; ropts[2]="/1"
elif [[ "$machine" = "Orion" ]]; then
topts[1]="0:15:00" ; popts[1]="20/1/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="20/2/" ; ropts[2]="/2"
topts[1]="0:15:00" ; popts[1]="5/4/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="10/4/" ; ropts[2]="/2"
elif [[ "$machine" = "Hercules" ]]; then
topts[1]="0:15:00" ; popts[1]="20/1/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="20/2/" ; ropts[2]="/2"
topts[2]="0:15:00" ; popts[2]="5/8/" ; ropts[2]="/2"
elif [[ "$machine" = "Jet" ]]; then
topts[1]="0:15:00" ; popts[1]="20/1/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="20/2/" ; ropts[2]="/1"
topts[1]="0:15:00" ; popts[1]="5/4/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="10/4/" ; ropts[2]="/1"
elif [[ "$machine" = "Gaea" ]]; then
topts[1]="0:15:00" ; popts[1]="18/1/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="18/2/" ; ropts[2]="/1"
Expand All @@ -146,17 +146,17 @@ case $regtest in

hafs_4denvar_glbens)
if [[ "$machine" = "Hera" ]]; then
topts[1]="0:15:00" ; popts[1]="20/1/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="20/2/" ; ropts[2]="/1"
topts[1]="0:15:00" ; popts[1]="5/4/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="10/4/" ; ropts[2]="/1"
elif [[ "$machine" = "Orion" ]]; then
topts[1]="0:20:00" ; popts[1]="20/1/" ; ropts[1]="/1"
topts[1]="0:20:00" ; popts[1]="5/4/" ; ropts[1]="/1"
topts[2]="0:20:00" ; popts[2]="20/2/" ; ropts[2]="/1"
elif [[ "$machine" = "Hercules" ]]; then
topts[1]="0:20:00" ; popts[1]="20/1/" ; ropts[1]="/1"
topts[2]="0:20:00" ; popts[2]="20/2/" ; ropts[2]="/1"
topts[1]="0:20:00" ; popts[1]="5/4/" ; ropts[1]="/1"
topts[2]="0:20:00" ; popts[2]="10/4/" ; ropts[2]="/1"
elif [[ "$machine" = "Jet" ]]; then
topts[1]="0:15:00" ; popts[1]="20/1/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="20/2/" ; ropts[2]="/1"
topts[1]="0:15:00" ; popts[1]="5/4/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="10/4/" ; ropts[2]="/1"
elif [[ "$machine" = "Gaea" ]]; then
topts[1]="0:15:00" ; popts[1]="18/1/" ; ropts[1]="/1"
topts[2]="0:15:00" ; popts[2]="18/2/" ; ropts[2]="/1"
Expand Down Expand Up @@ -300,10 +300,10 @@ if [[ "$machine" = "Hera" ]]; then
export APRUN="srun"
elif [[ "$machine" = "Orion" ]]; then
export OMP_STACKSIZE=2048M
export APRUN="srun -n \$ntasks --cpus-per-task=\$threads"
export APRUN="srun -n \$ntasks --mem=0 --cpus-per-task=\$threads"
elif [[ "$machine" = "Hercules" ]]; then
export OMP_STACKSIZE=2048M
export APRUN="srun -n \$ntasks --cpus-per-task=\$threads"
export APRUN="srun -n \$ntasks --mem=0 --cpus-per-task=\$threads"
Comment thread
RussTreadon-NOAA marked this conversation as resolved.
elif [[ "$machine" = "Jet" ]]; then
export OMP_STACKSIZE=1024M
export MPI_BUFS_PER_PROC=256
Expand Down
Loading