-
Notifications
You must be signed in to change notification settings - Fork 217
Add in initial 3DVar aerosol DA cycling capability #1106
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from 93 commits
5848a84
801b0a5
7a6dc92
353cd79
dd84394
81858d7
91c37cd
7d9bae2
2bad09a
8ce5031
0858f13
98504d0
d86fd99
33fe3e2
a232856
616b86c
6afb8a7
dfd2bab
82f5d90
520a871
fcc1d4c
9e6fc64
2150ed5
ae1fca7
197cfa8
bed58e7
bc2015c
f643ffd
1e60ef7
69d5dd9
37b5dbf
d47defb
ddf6541
33ae03b
28c2321
c2774fd
54af10d
593f3ea
f05ed7e
5571459
1e2a30f
08ec8c2
a8dac5d
f4ffba9
4442243
ade7c36
b904215
7931a8a
16ea583
85218b9
7204c87
cd3068a
47bd8b4
f554b1d
1536029
0e24cba
c80c86f
3887616
cd26d7a
8007a2d
05ce283
44a5e02
21e5d61
6f7a6fa
c71da55
9339d60
7292b68
c472fef
c743d1d
0b9f2e6
d49e612
3868d5a
2d8cbcf
12b7f9a
76a643c
4e99947
5ec625a
c3d8866
023d50c
b816f9d
cb77783
fdb6bd8
999baea
af61a18
26acb44
a7b0d26
9ea9e9f
eb915d0
27f3383
4855ec7
08e0428
79af76f
bae934f
6e9c953
175648f
2383214
d309030
8706ef8
5af46f8
54b6432
27a104a
a43a428
15e7e74
635501a
725a833
57a8a84
db9193b
f038793
065ccba
b70cfe4
904f1eb
b48383a
c43684f
fd4aca9
7bc3d2b
4a1518b
4cb8ab7
3c23875
32aef20
8e69275
7581bec
9c988bf
6c5ae54
186bf79
ecd0cca
fdf4139
46e6319
58c4c71
8ec0457
6d65542
51e070f
68d5ca5
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change | ||||
|---|---|---|---|---|---|---|
| @@ -0,0 +1,106 @@ | ||||||
| #! /usr/bin/env bash | ||||||
|
|
||||||
| export STRICT="NO" | ||||||
| source "${HOMEgfs}/ush/preamble.sh" | ||||||
|
|
||||||
| ############################################## | ||||||
| # Enter temp directory | ||||||
| ############################################## | ||||||
| export DATA=${DATA:-${DATAROOT}/${RUN}aeroanl_${cyc}} | ||||||
| cd "${DATA}" || (echo "${DATA} does not exist. ABORT!"; exit 1) | ||||||
|
|
||||||
|
|
||||||
| ############################################## | ||||||
| # Run setpdy and initialize PDY variables | ||||||
| ############################################## | ||||||
| export cycle="t${cyc}z" | ||||||
| setpdy.sh | ||||||
| . ./PDY | ||||||
|
|
||||||
|
|
||||||
| ############################################## | ||||||
| # Determine Job Output Name on System | ||||||
| ############################################## | ||||||
| export pid=${pid:-$$} | ||||||
| export pgmout="OUTPUT.${pid}" | ||||||
| export pgmerr=errfile | ||||||
|
|
||||||
|
|
||||||
| ############################# | ||||||
|
aerorahul marked this conversation as resolved.
Outdated
|
||||||
| # Source relevant config files | ||||||
| ############################# | ||||||
| export EXPDIR=${EXPDIR:-${HOMEgfs}/parm/config} | ||||||
| configs="base aeroanl aeroanlfinal" | ||||||
| for config in ${configs}; do | ||||||
| . "${EXPDIR}/config.${config}" | ||||||
| status=$? | ||||||
| [[ ${status} -ne 0 ]] && exit "${status}" | ||||||
| done | ||||||
|
|
||||||
|
|
||||||
| ########################################## | ||||||
| # Source machine runtime environment | ||||||
| ########################################## | ||||||
| . "${HOMEgfs}/env/${machine}.env" aeroanlfinal | ||||||
| status=$? | ||||||
| [[ ${status} -ne 0 ]] && exit "${status}" | ||||||
|
|
||||||
|
|
||||||
| ############################################## | ||||||
| # Set variables used in the script | ||||||
| ############################################## | ||||||
| export CDATE=${CDATE:-${PDY}${cyc}} | ||||||
| export CDUMP=${CDUMP:-${RUN:-"gfs"}} | ||||||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. As the name of this script suggests, it will only run in
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Got it, will fix these to be |
||||||
| export COMPONENT="chem" | ||||||
|
|
||||||
|
|
||||||
| ############################################## | ||||||
| # Begin JOB SPECIFIC work | ||||||
| ############################################## | ||||||
|
|
||||||
| GDATE=$(date +%Y%m%d%H -d "${CDATE:0:8} ${CDATE:8:2} - ${assim_freq} hours") | ||||||
| export GDATE | ||||||
| gPDY=${GDATE:0:8} | ||||||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Does this not need an
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. it does to be usable by the python ex-script, I guess the question is 'is it used'? |
||||||
| export gcyc=${GDATE:8:2} | ||||||
| export GDUMP=${GDUMP:-"gdas"} | ||||||
|
|
||||||
| export OPREFIX="${CDUMP}.t${cyc}z." | ||||||
| export GPREFIX="${GDUMP}.t${gcyc}z." | ||||||
| export APREFIX="${CDUMP}.t${cyc}z." | ||||||
| export GSUFFIX=${GSUFFIX:-${SUFFIX}} | ||||||
| export ASUFFIX=${ASUFFIX:-${SUFFIX}} | ||||||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Recent PR removed the need for
Suggested change
|
||||||
|
|
||||||
| export COMOUT=${COMOUT:-${ROTDIR}/${CDUMP}.${PDY}/${cyc}/${COMPONENT}} | ||||||
|
CoryMartin-NOAA marked this conversation as resolved.
Outdated
|
||||||
|
|
||||||
| mkdir -p "${COMOUT}" | ||||||
|
|
||||||
| # COMIN_GES and COMIN_GES_ENS are used in script | ||||||
| export COMIN_GES="${ROTDIR}/${GDUMP}.${gPDY}/${gcyc}/${COMPONENT}" | ||||||
| export COMIN_GES_ENS="${ROTDIR}/enkf${GDUMP}.${gPDY}/${gcyc}/${COMPONENT}" | ||||||
|
|
||||||
| ############################################################### | ||||||
| # Run relevant script | ||||||
|
|
||||||
| EXSCRIPT=${GDASAEROFINALPY:-${HOMEgfs}/scripts/exgdas_global_aero_analysis_finalize.py} | ||||||
| ${EXSCRIPT} | ||||||
| status=$? | ||||||
| [[ ${status} -ne 0 ]] && exit "${status}" | ||||||
|
|
||||||
| ############################################## | ||||||
| # End JOB SPECIFIC work | ||||||
| ############################################## | ||||||
|
|
||||||
| ############################################## | ||||||
| # Final processing | ||||||
| ############################################## | ||||||
| if [[ -e "${pgmout}" ]] ; then | ||||||
| cat "${pgmout}" | ||||||
| fi | ||||||
|
|
||||||
| ########################################## | ||||||
| # Remove the Temporary working directory | ||||||
| ########################################## | ||||||
| cd "${DATAROOT}" || exit 1 | ||||||
| [[ ${KEEPDATA} = "NO" ]] && rm -rf "${DATA}" | ||||||
|
|
||||||
| exit 0 | ||||||
| Original file line number | Diff line number | Diff line change | ||||
|---|---|---|---|---|---|---|
| @@ -0,0 +1,102 @@ | ||||||
| #! /usr/bin/env bash | ||||||
|
|
||||||
| export STRICT="NO" | ||||||
|
CoryMartin-NOAA marked this conversation as resolved.
Outdated
|
||||||
| source "${HOMEgfs}/ush/preamble.sh" | ||||||
|
|
||||||
| ############################################## | ||||||
| # Make temp directory | ||||||
| ############################################## | ||||||
| export DATA=${DATA:-${DATAROOT}/${RUN}aeroanl_${cyc}} | ||||||
|
CoryMartin-NOAA marked this conversation as resolved.
Outdated
CoryMartin-NOAA marked this conversation as resolved.
Outdated
|
||||||
| [[ -d "${DATA}" ]] && rm -rf "${DATA}" | ||||||
| mkdir -p "${DATA}" | ||||||
| cd "${DATA}" || (echo "${DATA} does not exist. ABORT!"; exit 1) | ||||||
|
|
||||||
|
|
||||||
| ############################################## | ||||||
| # Run setpdy and initialize PDY variables | ||||||
| ############################################## | ||||||
| export cycle="t${cyc}z" | ||||||
| setpdy.sh | ||||||
| . ./PDY | ||||||
|
|
||||||
|
|
||||||
| ############################################## | ||||||
| # Determine Job Output Name on System | ||||||
| ############################################## | ||||||
| export pid=${pid:-$$} | ||||||
| export pgmout="OUTPUT.${pid}" | ||||||
| export pgmerr=errfile | ||||||
|
|
||||||
|
|
||||||
| ############################# | ||||||
|
aerorahul marked this conversation as resolved.
Outdated
|
||||||
| # Source relevant config files | ||||||
| ############################# | ||||||
| export EXPDIR=${EXPDIR:-${HOMEgfs}/parm/config} | ||||||
| configs="base aeroanl aeroanlinit" | ||||||
| for config in ${configs}; do | ||||||
| . "${EXPDIR}/config.${config}" | ||||||
| status=$? | ||||||
| [[ ${status} -ne 0 ]] && exit "${status}" | ||||||
| done | ||||||
|
|
||||||
|
|
||||||
| ########################################## | ||||||
| # Source machine runtime environment | ||||||
| ########################################## | ||||||
| . "${HOMEgfs}/env/${machine}.env" aeroanlinit | ||||||
| status=$? | ||||||
| [[ ${status} -ne 0 ]] && exit "${status}" | ||||||
|
|
||||||
|
|
||||||
| ############################################## | ||||||
| # Set variables used in the script | ||||||
| ############################################## | ||||||
| export CDATE=${CDATE:-${PDY}${cyc}} | ||||||
| export CDUMP=${CDUMP:-${RUN:-"gfs"}} | ||||||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. See the comment in |
||||||
| export COMPONENT="chem" | ||||||
|
|
||||||
|
|
||||||
| ############################################## | ||||||
| # Begin JOB SPECIFIC work | ||||||
| ############################################## | ||||||
|
|
||||||
| GDATE=$(date +%Y%m%d%H -d "${CDATE:0:8} ${CDATE:8:2} - ${assim_freq} hours") | ||||||
| export GDATE | ||||||
| gPDY=${GDATE:0:8} | ||||||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. same as |
||||||
| export gcyc=${GDATE:8:2} | ||||||
| export GDUMP=${GDUMP:-"gdas"} | ||||||
|
|
||||||
| export OPREFIX="${CDUMP}.t${cyc}z." | ||||||
| export GPREFIX="${GDUMP}.t${gcyc}z." | ||||||
| export APREFIX="${CDUMP}.t${cyc}z." | ||||||
| export GSUFFIX=${GSUFFIX:-${SUFFIX}} | ||||||
| export ASUFFIX=${ASUFFIX:-${SUFFIX}} | ||||||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
|
||||||
| export COMOUT=${COMOUT:-${ROTDIR}/${CDUMP}.${PDY}/${cyc}/${COMPONENT}} | ||||||
|
|
||||||
| mkdir -p "${COMOUT}" | ||||||
|
|
||||||
| # COMIN_GES and COMIN_GES_ENS are used in script | ||||||
| export COMIN_GES="${ROTDIR}/${GDUMP}.${gPDY}/${gcyc}/${COMPONENT}" | ||||||
| export COMIN_GES_ENS="${ROTDIR}/enkf${GDUMP}.${gPDY}/${gcyc}/${COMPONENT}" | ||||||
|
|
||||||
| ############################################################### | ||||||
| # Run relevant script | ||||||
|
|
||||||
| EXSCRIPT=${GDASAEROINITPY:-${HOMEgfs}/scripts/exgdas_global_aero_analysis_initialize.py} | ||||||
| ${EXSCRIPT} | ||||||
| status=$? | ||||||
| [[ ${status} -ne 0 ]] && exit "${status}" | ||||||
|
|
||||||
| ############################################## | ||||||
| # End JOB SPECIFIC work | ||||||
| ############################################## | ||||||
|
|
||||||
| ############################################## | ||||||
| # Final processing | ||||||
| ############################################## | ||||||
| if [[ -e "${pgmout}" ]] ; then | ||||||
| cat "${pgmout}" | ||||||
| fi | ||||||
|
|
||||||
| exit 0 | ||||||
| Original file line number | Diff line number | Diff line change | ||||
|---|---|---|---|---|---|---|
| @@ -0,0 +1,100 @@ | ||||||
| #! /usr/bin/env bash | ||||||
|
|
||||||
| export STRICT="NO" | ||||||
|
CoryMartin-NOAA marked this conversation as resolved.
Outdated
|
||||||
| source "${HOMEgfs}/ush/preamble.sh" | ||||||
|
|
||||||
| ############################################## | ||||||
| # Enter temp directory | ||||||
| ############################################## | ||||||
| export DATA=${DATA:-${DATAROOT}/${RUN}aeroanl_${cyc}} | ||||||
| cd "${DATA}" || (echo "${DATA} does not exist. ABORT!"; exit 1) | ||||||
|
|
||||||
|
|
||||||
| ############################################## | ||||||
| # Run setpdy and initialize PDY variables | ||||||
| ############################################## | ||||||
| export cycle="t${cyc}z" | ||||||
| setpdy.sh | ||||||
| . ./PDY | ||||||
|
|
||||||
|
|
||||||
| ############################################## | ||||||
| # Determine Job Output Name on System | ||||||
| ############################################## | ||||||
| export pid=${pid:-$$} | ||||||
| export pgmout="OUTPUT.${pid}" | ||||||
| export pgmerr=errfile | ||||||
|
|
||||||
|
|
||||||
| ############################# | ||||||
|
aerorahul marked this conversation as resolved.
Outdated
|
||||||
| # Source relevant config files | ||||||
| ############################# | ||||||
| export EXPDIR=${EXPDIR:-${HOMEgfs}/parm/config} | ||||||
| configs="base aeroanl aeroanlrun" | ||||||
| for config in ${configs}; do | ||||||
| . "${EXPDIR}/config.${config}" | ||||||
| status=$? | ||||||
| [[ ${status} -ne 0 ]] && exit "${status}" | ||||||
| done | ||||||
|
|
||||||
|
|
||||||
| ########################################## | ||||||
| # Source machine runtime environment | ||||||
| ########################################## | ||||||
| . "${HOMEgfs}/env/${machine}.env" aeroanlrun | ||||||
| status=$? | ||||||
| [[ ${status} -ne 0 ]] && exit "${status}" | ||||||
|
|
||||||
|
|
||||||
| ############################################## | ||||||
| # Set variables used in the script | ||||||
| ############################################## | ||||||
| export CDATE=${CDATE:-${PDY}${cyc}} | ||||||
| export CDUMP=${CDUMP:-${RUN:-"gfs"}} | ||||||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. same as |
||||||
| export COMPONENT="chem" | ||||||
|
|
||||||
|
|
||||||
| ############################################## | ||||||
| # Begin JOB SPECIFIC work | ||||||
| ############################################## | ||||||
|
|
||||||
| GDATE=$(date +%Y%m%d%H -d "${CDATE:0:8} ${CDATE:8:2} - ${assim_freq} hours") | ||||||
| export GDATE | ||||||
| gPDY=${GDATE:0:8} | ||||||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. same as |
||||||
| export gcyc=${GDATE:8:2} | ||||||
| export GDUMP=${GDUMP:-"gdas"} | ||||||
|
|
||||||
| export OPREFIX="${CDUMP}.t${cyc}z." | ||||||
| export GPREFIX="${GDUMP}.t${gcyc}z." | ||||||
| export APREFIX="${CDUMP}.t${cyc}z." | ||||||
| export GSUFFIX=${GSUFFIX:-${SUFFIX}} | ||||||
| export ASUFFIX=${ASUFFIX:-${SUFFIX}} | ||||||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. same as
Suggested change
|
||||||
|
|
||||||
| export COMOUT=${COMOUT:-${ROTDIR}/${CDUMP}.${PDY}/${cyc}/${COMPONENT}} | ||||||
|
|
||||||
| mkdir -p "${COMOUT}" | ||||||
|
|
||||||
| # COMIN_GES and COMIN_GES_ENS are used in script | ||||||
| export COMIN_GES="${ROTDIR}/${GDUMP}.${gPDY}/${gcyc}/${COMPONENT}" | ||||||
| export COMIN_GES_ENS="${ROTDIR}/enkf${GDUMP}.${gPDY}/${gcyc}/${COMPONENT}" | ||||||
|
|
||||||
| ############################################################### | ||||||
| # Run relevant script | ||||||
|
|
||||||
| EXSCRIPT=${GDASAERORUNSH:-${HOMEgfs}/scripts/exgdas_global_aero_analysis_run.sh} | ||||||
| ${EXSCRIPT} | ||||||
| status=$? | ||||||
| [[ ${status} -ne 0 ]] && exit "${status}" | ||||||
|
|
||||||
| ############################################## | ||||||
| # End JOB SPECIFIC work | ||||||
| ############################################## | ||||||
|
|
||||||
| ############################################## | ||||||
| # Final processing | ||||||
| ############################################## | ||||||
| if [[ -e "${pgmout}" ]] ; then | ||||||
| cat "${pgmout}" | ||||||
| fi | ||||||
|
|
||||||
| exit 0 | ||||||
| Original file line number | Diff line number | Diff line change | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| @@ -1,15 +1,22 @@ | ||||||||||
| #! /usr/bin/env bash | ||||||||||
|
|
||||||||||
| source "$HOMEgfs/ush/preamble.sh" | ||||||||||
| export STRICT="NO" | ||||||||||
| source "${HOMEgfs}/ush/preamble.sh" | ||||||||||
|
|
||||||||||
| ############################################################### | ||||||||||
| # Source FV3GFS workflow modules | ||||||||||
| . $HOMEgfs/ush/load_fv3gfs_modules.sh | ||||||||||
| # Source UFSDA workflow modules | ||||||||||
| . "${HOMEgfs}/ush/load_ufsda_modules.sh" | ||||||||||
| status=$? | ||||||||||
| [[ $status -ne 0 ]] && exit $status | ||||||||||
| [[ ${status} -ne 0 ]] && exit "${status}" | ||||||||||
|
CoryMartin-NOAA marked this conversation as resolved.
|
||||||||||
|
|
||||||||||
| export STRICT="YES" | ||||||||||
|
CoryMartin-NOAA marked this conversation as resolved.
Outdated
|
||||||||||
| export job="aeroanlfinal" | ||||||||||
| export jobid="${job}.$$" | ||||||||||
|
|
||||||||||
| ############################################################### | ||||||||||
| echo "Do nothing for now" | ||||||||||
| # setup python path for workflow utilities and tasks | ||||||||||
| export PYTHONPATH="$PYTHONPATH:${HOMEgfs}/ush/python:${HOMEgfs}/ush/python/pygw/src" | ||||||||||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Is this syntax correct? Perhaps I'm suffering from brain fog but the second
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I believe so.
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Yup, Rahul's suggestion is correct. |
||||||||||
| ############################################################### | ||||||||||
| # Execute the JJOB | ||||||||||
| "${HOMEgfs}/jobs/JGDAS_GLOBAL_AERO_ANALYSIS_FINALIZE" | ||||||||||
| status=$? | ||||||||||
| exit "${status}" | ||||||||||
| Original file line number | Diff line number | Diff line change | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| @@ -1,15 +1,22 @@ | ||||||||||
| #! /usr/bin/env bash | ||||||||||
|
|
||||||||||
| source "$HOMEgfs/ush/preamble.sh" | ||||||||||
| export STRICT="NO" | ||||||||||
| source "${HOMEgfs}/ush/preamble.sh" | ||||||||||
|
|
||||||||||
| ############################################################### | ||||||||||
| # Source FV3GFS workflow modules | ||||||||||
| . $HOMEgfs/ush/load_fv3gfs_modules.sh | ||||||||||
| # Source UFSDA workflow modules | ||||||||||
| . "${HOMEgfs}/ush/load_ufsda_modules.sh" | ||||||||||
| status=$? | ||||||||||
| [[ $status -ne 0 ]] && exit $status | ||||||||||
| [[ ${status} -ne 0 ]] && exit "${status}" | ||||||||||
|
|
||||||||||
| export STRICT="YES" | ||||||||||
|
CoryMartin-NOAA marked this conversation as resolved.
Outdated
|
||||||||||
| export job="aeroanlinit" | ||||||||||
| export jobid="${job}.$$" | ||||||||||
|
|
||||||||||
| ############################################################### | ||||||||||
| echo "Do nothing for now" | ||||||||||
| # setup python path for workflow utilities and tasks | ||||||||||
| export PYTHONPATH="$PYTHONPATH:${HOMEgfs}/ush/python:${HOMEgfs}/ush/python/pygw/src" | ||||||||||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||||||
| ############################################################### | ||||||||||
| # Execute the JJOB | ||||||||||
| "${HOMEgfs}/jobs/JGDAS_GLOBAL_AERO_ANALYSIS_INITIALIZE" | ||||||||||
| status=$? | ||||||||||
| exit "${status}" | ||||||||||
Uh oh!
There was an error while loading. Please reload this page.