Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
77 commits
Select commit Hold shift + click to select a range
687e3b1
add Tutorial chapter
gspetro Sep 28, 2022
5ac3461
Merge branch 'ufs-community:develop' into text/tutorial
gspetro-NOAA Oct 11, 2022
ff01711
Merge branch 'ufs-community:develop' into text/tutorial
gspetro-NOAA Oct 25, 2022
62db58f
Merge branch 'ufs-community:develop' into text/tutorial
gspetro-NOAA Oct 28, 2022
b972c55
update build process img
gspetro Nov 16, 2022
2bcd36a
update img
gspetro Nov 16, 2022
7c9c0ec
Merge branch 'ufs-community:develop' into develop
gspetro-NOAA Nov 16, 2022
d25b5c2
Merge branch 'ufs-community:develop' into develop
gspetro-NOAA Nov 18, 2022
76d561c
Revert changes
gspetro Nov 18, 2022
0390cde
Merge branch 'develop' of github.com:gspetro-NOAA/ufs-srweather-app i…
gspetro Nov 18, 2022
5a58dd3
misc. changes
gspetro Nov 21, 2022
7f5d753
merge in recent release changes/fix conflicts
gspetro Nov 21, 2022
66a3976
resolve conflicts
gspetro Dec 22, 2022
7208de3
reconcile conflicts
gspetro Dec 22, 2022
d9b7415
Merge branch 'ufs-community:develop' into text/tutorial
gspetro-NOAA Jan 5, 2023
46b0802
minor edits
gspetro Jan 9, 2023
d2e2ed5
Merge branch 'ufs-community:develop' into text/tutorial
gspetro-NOAA Jan 9, 2023
a4ccbbf
Merge branch 'text/tutorial' of github.com:gspetro-NOAA/ufs-srweather…
gspetro Jan 9, 2023
d2cbce7
fix typo
gspetro Jan 10, 2023
d9bc705
data assimilation def
gspetro Jan 10, 2023
f690cc1
reformat headings
gspetro Jan 10, 2023
d737a35
add config info
gspetro Jan 10, 2023
2d715ea
make heading concise
gspetro Jan 10, 2023
012deaf
minor tutorial updates
gspetro Jan 10, 2023
d0e6f03
Merge branch 'ufs-community:develop' into text/tutorial
gspetro-NOAA Jan 10, 2023
843ba97
add radar images & some weather descriptions
gspetro Jan 10, 2023
846da09
add images
gspetro Jan 10, 2023
351bfe1
add weather descriptions
gspetro Jan 10, 2023
ed55057
add Winter Weather radar image
gspetro Jan 10, 2023
e62675b
fix img and update HRRR/RAP data info
gspetro Jan 10, 2023
11091c8
add gifs/storm reports for Cold Air Damming & Halloween Storm
gspetro Jan 11, 2023
45d21cd
minor edits
gspetro Jan 11, 2023
158513f
minor edits
gspetro Jan 11, 2023
1fc9572
fix typo
gspetro Jan 11, 2023
d9a66c4
add X-refs
gspetro Jan 11, 2023
2e3cb6b
update forecast length & minor details throughout
gspetro Jan 11, 2023
38b50cb
minor edits
gspetro Jan 12, 2023
d1cb532
fix minor variable def error
gspetro Jan 13, 2023
c8acad2
update imgs, minor fixes
gspetro Jan 13, 2023
36ccfd6
explain plotting script changes
gspetro Jan 19, 2023
9daf9b5
increase run_post wall time, minor edits
gspetro Jan 20, 2023
688cf7a
add introduction to SSH & Data Transfer
gspetro Jan 20, 2023
a20be67
add diff plot folder for tutorial images
gspetro Jan 20, 2023
dab7b02
Delete .DS_Store
gspetro-NOAA Jan 20, 2023
497fef5
update plotting/data transfer commands
gspetro Jan 20, 2023
5b2ae3f
Merge branch 'text/tutorial' of github.com:gspetro-NOAA/ufs-srweather…
gspetro Jan 20, 2023
77e3c10
clarify plotting instructions in RunSRW
gspetro Jan 20, 2023
c63cc28
add SLP comparison/analysis
gspetro Jan 21, 2023
dc61560
fix headings
gspetro Jan 21, 2023
bc7119b
add comp refc analysis
gspetro Jan 21, 2023
0b40ebd
add info on updraft helicity
gspetro Jan 21, 2023
377acc8
minor additions/formatting
gspetro Jan 21, 2023
36a47f7
update TemplateVars chapter
gspetro Jan 23, 2023
8af7df8
update ssh info
gspetro Jan 23, 2023
e7a3423
minor edits
gspetro Jan 23, 2023
d7c7591
add cape/cin info
gspetro Jan 23, 2023
e192255
add updraft helicity to glossary
gspetro Jan 23, 2023
2a9422a
expand CAPE/CIN analysis
gspetro Jan 23, 2023
7823a48
finish draft of cape/cin section
gspetro Jan 23, 2023
f0f8a22
minor edits for cape/cin
gspetro Jan 23, 2023
eb5d8e5
add NWS to glossary; minor tutorial edits
gspetro Jan 23, 2023
5a66e19
remove resolved comments
gspetro Jan 23, 2023
6018470
add Xlinks
gspetro Jan 23, 2023
b7a6941
add 12th hr comp refc info
gspetro Jan 23, 2023
3d7154d
reorder sections
gspetro Jan 23, 2023
6559564
Merge branch 'ufs-community:develop' into text/tutorial
gspetro-NOAA Jan 23, 2023
f116208
remove comments
gspetro Jan 23, 2023
9b62312
fix Halloween Storm desc
gspetro Jan 24, 2023
ede8d9f
edit comp refc descriptions
gspetro Jan 24, 2023
5ff9735
Update to reflect changes in PR #560 PLOT_DOMAINS option
gspetro Jan 25, 2023
8fed8f1
update Try It section
gspetro Jan 25, 2023
a2c4422
minor edits
gspetro Jan 26, 2023
599850d
add S3 data locations
gspetro Jan 30, 2023
1afb55b
add reference for COMOUT/NCO info
gspetro Jan 31, 2023
060e588
remove Try It #1
gspetro Jan 31, 2023
d078de6
fix PLOT_FCST_INC def
gspetro Jan 31, 2023
3404c79
add updated TryIt/plot section
gspetro Jan 31, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 11 additions & 3 deletions docs/UsersGuide/source/ConfigWorkflow.rst
Original file line number Diff line number Diff line change
Expand Up @@ -410,7 +410,7 @@ A standard set of environment variables has been established for *nco* mode to s
Only *community* mode is fully supported for this release. *nco* mode is used by those at the Environmental Modeling Center (EMC) and Global Systems Laboratory (GSL) who are working on pre-implementation operational testing. Other users should run the SRW App in *community* mode.

``envir, NET, model_ver, RUN``:
Standard environment variables defined in the NCEP Central Operations WCOSS Implementation Standards document. These variables are used in forming the path to various directories containing input, output, and workflow files. The variables are defined in the `WCOSS Implementation Standards <https://www.nco.ncep.noaa.gov/idsb/implementation_standards/ImplementationStandards.v11.0.0.pdf?>`__ document (pp. 4-5) as follows:
Standard environment variables defined in the NCEP Central Operations WCOSS Implementation Standards document. These variables are used in forming the path to various directories containing input, output, and workflow files. The variables are defined in the `WCOSS Implementation Standards <https://www.nco.ncep.noaa.gov/idsb/implementation_standards/ImplementationStandards.v11.0.0.pdf?>`__ document (pp. 4-5) as follows:

``envir``: (Default: "para")
Set to "test" during the initial testing phase, "para" when running in parallel (on a schedule), and "prod" in production.
Expand All @@ -427,6 +427,8 @@ A standard set of environment variables has been established for *nco* mode to s
``OPSROOT``: (Default: "")
The operations root directory in *nco* mode.

.. _workflow-switches:

WORKFLOW SWITCHES Configuration Parameters
=============================================

Expand Down Expand Up @@ -689,6 +691,8 @@ Non-default parameters for the ``make_sfc_climo`` task are set in the ``task_mak
``SFC_CLIMO_DIR``: (Default: "")
The directory containing pre-generated surface climatology files to use when ``MAKE_SFC_CLIMO_TN`` is set to false.

.. _task_get_extrn_ics:

GET_EXTRN_ICS Configuration Parameters
=========================================

Expand Down Expand Up @@ -770,6 +774,7 @@ Set parameters associated with NOMADS online data.
``NOMADS_file_type``: (Default: "nemsio")
Flag controlling the format of the data. Valid values: ``"GRIB2"`` | ``"grib2"`` | ``"NEMSIO"`` | ``"nemsio"``

.. _task_get_extrn_lbcs:

GET_EXTRN_LBCS Configuration Parameters
==========================================
Expand Down Expand Up @@ -1768,17 +1773,20 @@ Additional Parameters
Typically, the following parameters must be set explicitly by the user in the configuration file (``config.yaml``) when executing the plotting tasks.

``COMOUT_REF``: (Default: "")
The directory where the GRIB2 files from post-processing are located. In *community* mode (i.e., when ``RUN_ENVIR: "community"``), this directory will correspond to the location in the experiment directory where the post-processed output can be found (e.g., ``$EXPTDIR/$DATE_FIRST_CYCL/postprd``). In *nco* mode, this directory should be set to the location of the COMOUT directory and end with ``$PDY/$cyc``.
The directory where the GRIB2 files from post-processing are located. In *community* mode (i.e., when ``RUN_ENVIR: "community"``), this directory will correspond to the location in the experiment directory where the post-processed output can be found (e.g., ``$EXPTDIR/$DATE_FIRST_CYCL/postprd``). In *nco* mode, this directory should be set to the location of the ``COMOUT`` directory and end with ``$PDY/$cyc``. For more detail on *nco* standards and directory naming conventions, see `WCOSS Implementation Standards <https://www.nco.ncep.noaa.gov/idsb/implementation_standards/ImplementationStandards.v11.0.0.pdf?>`__ (particularly pp. 4-5).

``PLOT_FCST_START``: (Default: 0)
The starting forecast hour for the plotting task. For example, if a forecast starts at 18h/18z, this is considered the 0th forecast hour, so "starting forecast hour" should be 0, not 18. If a forecast starts at 18h/18z, but the user only wants plots from the 6th forecast hour on, "starting forecast hour" should be 6.

``PLOT_FCST_INC``: (Default: 3)
Forecast hour increment for the plotting task. This may be the same as ``INCR_CYCL_FREQ``, or it may be a multiple of ``INCR_CYCL_FREQ``. For example, if ``INCR_CYCL_FREQ`` is set to 3, there will be forecast output every three hours for the duration of the forecast. If the user wants plots of all of this output, they should set ``PLOT_FCST_INC: 3``. If the user only wants plots for some of the output (e.g., every 6 hours), they should set ``PLOT_FCST_INC: 6``. However, there must be forecast output available at the designated increments to produce the plots. In this example, setting ``PLOT_FCST_INC: 7`` would produce an error because there is only forecast output available for hours 3, 6, 9, ..., etc.
Forecast hour increment for the plotting task. For example, if the user wants plots for each forecast hour, they should set ``PLOT_FCST_INC: 1``. If the user only wants plots for some of the output (e.g., every 6 hours), they should set ``PLOT_FCST_INC: 6``.

``PLOT_FCST_END``: (Default: "")
The last forecast hour for the plotting task. For example, if a forecast run for 24 hours, and the user wants plots for each available hour of forecast output, they should set ``PLOT_FCST_END: 24``. If the user only wants plots from the first 12 hours of the forecast, the "last forecast hour" should be 12.

``PLOT_DOMAINS``: (Default: ["conus"])
Domains to plot. Currently supported options are ["conus"], ["regional"], or both (i.e., ["conus", "regional"]).

Global Configuration Parameters
===================================

Expand Down
9 changes: 9 additions & 0 deletions docs/UsersGuide/source/Glossary.rst
Original file line number Diff line number Diff line change
Expand Up @@ -67,6 +67,9 @@ Glossary
cycle-independent
Describes a workflow task that only needs to be run once per experiment, regardless of the number of cycles in the experiment.

data assimilation
One of the major sources of error in weather and climate forecasts is uncertainty related to the initial conditions that are used to generate future predictions. Even the most precise instruments have a small range of unavoidable measurement error, which means that tiny measurement errors (e.g., related to atmospheric conditions and instrument location) can compound over time. These small differences result in very similar forecasts in the short term (i.e., minutes, hours), but they cause widely divergent forecasts in the long term. Data assimilation systems seek to mitigate this problem by combining the most timely observational data with other sources of data, such as historical data, to provide an analysis of possible atmospheric states and the probabilities of each. Errors in weather and climate forecasts can also arise because models are imperfect representations of reality. Data assimilation systems can use techniques including stochastic physics, which applies randomized perturbations to the physical tendencies or the physical parameters of a model, to compensate for model uncertainty.

dycore
dynamical core
Global atmospheric model based on fluid dynamics principles, including Euler's equations of motion.
Expand Down Expand Up @@ -188,6 +191,9 @@ Glossary
NWP
Numerical Weather Prediction (NWP) takes current observations of weather and processes them with computer models to forecast the future state of the weather.

NWS
The `National Weather Service <https://www.weather.gov/>`__ (NWS) is an agency of the United States government that is tasked with providing weather forecasts, warnings of hazardous weather, and other weather-related products to organizations and the public for the purposes of protection, safety, and general information. It is a part of the National Oceanic and Atmospheric Administration (NOAA) branch of the Department of Commerce.

Orography
The branch of physical geography dealing with mountains.

Expand Down Expand Up @@ -229,6 +235,9 @@ Glossary
Umbrella repository
A repository that houses external code, or "externals," from additional repositories.

Updraft helicity
Helicity measures the rotation in a storm's updraft (rising) air. Significant rotation increases the probability that the storm will become a supercell thunderstorm or a tornado. See http://ww2010.atmos.uiuc.edu/(Gh)/guides/mtr/svr/modl/fcst/params/hel.rxml for more details on updraft helicity.

UPP
The `Unified Post Processor <https://dtcenter.org/community-code/unified-post-processor-upp>`__ is software developed at :term:`NCEP` and used operationally to
post-process raw output from a variety of :term:`NCEP`'s :term:`NWP` models, including the :term:`FV3`.
Expand Down
2 changes: 1 addition & 1 deletion docs/UsersGuide/source/InputOutputFiles.rst
Original file line number Diff line number Diff line change
Expand Up @@ -306,7 +306,7 @@ where:

For example, a forecast using FV3GFS GRIB2 data that starts at 18h00 UTC would have a {cycle} value of 18, which is the 000th forecast hour. The LBCS file for 21h00 UTC would be named ``gfs.t18z.pgrb2.0p25.f003``.

In some cases, it may be necessary to specify values for ``EXTRN_MDL_FILES_*CS``variables. This is often the case with HRRR and RAP data. An example ``config.yaml`` excerpt using HRRR and RAP data appears below:
In some cases, it may be necessary to specify values for ``EXTRN_MDL_FILES_*CS`` variables. This is often the case with HRRR and RAP data. An example ``config.yaml`` excerpt using HRRR and RAP data appears below:

.. code-block:: console

Expand Down
16 changes: 8 additions & 8 deletions docs/UsersGuide/source/RunSRW.rst
Original file line number Diff line number Diff line change
Expand Up @@ -537,8 +537,8 @@ To configure an experiment and python environment for a general Linux or Mac sys

.. _PlotOutput:

Plot the Output
-----------------
Plotting Configuration (optional)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

An optional Python plotting task (PLOT_ALLVARS) can be activated in the workflow to generate plots for the :term:`FV3`-:term:`LAM` post-processed :term:`GRIB2`
output over the :term:`CONUS`. It generates graphics plots for a number of variables, including:
Expand All @@ -561,12 +561,12 @@ the same cycle starting date/time and forecast hours. Other parameters may diffe
.. _Cartopy:

Cartopy Shapefiles
^^^^^^^^^^^^^^^^^^^^^
`````````````````````

The Python plotting tasks require a path to the directory where the Cartopy Natural Earth shapefiles are located. The medium scale (1:50m) cultural and physical shapefiles are used to create coastlines and other geopolitical borders on the map. On `Level 1 <https://github.com/ufs-community/ufs-srweather-app/wiki/Supported-Platforms-and-Compilers>`__ systems, this path is already set in the system's machine file using the variable ``FIXshp``. Users on other systems will need to download the shapefiles and update the path of ``$FIXshp`` in the machine file they are using (e.g., ``$SRW/ush/machine/macos.yaml`` for a generic MacOS system, where ``$SRW`` is the path to the ``ufs-srweather-app`` directory). The subset of shapefiles required for the plotting task can be obtained from the `SRW Data Bucket <https://noaa-ufs-srw-pds.s3.amazonaws.com/NaturalEarth/NaturalEarth.tgz>`__. The full set of medium-scale (1:50m) Cartopy shapefiles can be downloaded `here <https://www.naturalearthdata.com/downloads/>`__.

Task Configuration
^^^^^^^^^^^^^^^^^^^^^
`````````````````````

Users will need to add or modify certain variables in ``config.yaml`` to run the plotting task(s). At a minimum, users must set ``RUN_TASK_PLOT_ALLVARS`` to true in the ``workflow_switches:`` section:

Expand All @@ -593,16 +593,16 @@ When plotting output from a single experiment, no further adjustments are necess
corresponds to the cycle date and hour in YYYYMMDDHH format (e.g., ``2019061518``).

Plotting the Difference Between Two Experiments
```````````````````````````````````````````````````
""""""""""""""""""""""""""""""""""""""""""""""""""

When plotting the difference between two experiments, users must set the baseline experiment directory using the ``COMOUT_REF`` template variable. For example, in *community* mode, users can set:
When plotting the difference between two experiments (``expt1`` and ``expt2``), users must set the ``COMOUT_REF`` template variable in ``expt2``'s ``config.yaml`` file to point at forecast output from the ``expt1`` directory. For example, in *community* mode, users can set ``COMOUT_REF`` as follows in the ``expt2`` configuration file:

.. code-block:: console

task_plot_allvars:
COMOUT_REF: '${EXPT_BASEDIR}/${EXPT_SUBDIR}/${PDY}${cyc}/postprd'
COMOUT_REF: '${EXPT_BASEDIR}/expt1/${PDY}${cyc}/postprd'

In *community* mode, using default directory names and settings, ``$COMOUT_REF`` will resemble ``/path/to/expt_dirs/test_community/2019061518/postprd``. Additional details on the plotting variables are provided in :numref:`Section %s <PlotVars>`.
This will ensure that ``expt2`` can produce a difference plot comparing ``expt1`` and ``expt2``. In *community* mode, using default directory names and settings, ``$COMOUT_REF`` will resemble ``/path/to/expt_dirs/test_community/2019061518/postprd``. Additional details on the plotting variables are provided in :numref:`Section %s <PlotVars>`.

The output files (in ``.png`` format) will be located in the ``postprd`` directory for the experiment.

Expand Down
23 changes: 14 additions & 9 deletions docs/UsersGuide/source/TemplateVars.rst
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
.. _TemplateVars:

===============================================================
Using Template Variables in the Experiment Configuration Files
===============================================================
======================
Template Variables
======================

The SRW App's experiment configuration system supports the use of template variables
in ``config_defaults.yaml`` and ``config.yaml``. A template variable --- or "template" --- is an experiment configuration variable that contains references to values of other variables.
Expand Down Expand Up @@ -54,17 +54,22 @@ To generate difference plots, users must use the template variable ``COMOUT_REF`
to indicate where the :term:`GRIB2` files from post-processing are located.

In *community* mode (i.e., when ``RUN_ENVIR: "community"``), this directory will
take the form ``/path/to/exptdir/$PDY$cyc/postprd``, where ``$PDY`` refers to the
cycle date in YYYYMMDD format, and ``$cyc`` refers to the starting hour of the cycle.
take the form ``/path/to/expt_dirs/expt_name/$PDY$cyc/postprd``, where ``$PDY`` refers
to the cycle date in YYYYMMDD format, and ``$cyc`` refers to the starting hour of the cycle.
(These variables are set in previous tasks based on the value of ``DATE_FIRST_CYCL``.)
Concretely, users can set ``COMOUT_REF`` as follows:
Given two experiments, ``expt1`` and ``expt2``, users can generate difference plots by
setting ``COMOUT_REF`` in the ``expt2`` configuration file (``config.yaml``) as follows:

.. code-block:: console

COMOUT_REF: '${EXPT_BASEDIR}/${EXPT_SUBDIR}/${PDY}${cyc}/postprd'
COMOUT_REF: '${EXPT_BASEDIR}/expt1/${PDY}${cyc}/postprd'

In *nco* mode, this directory should be set to the location of the ``COMOUT`` directory
(``${COMOUT}`` in the example below) and end with ``${PDY}/${cyc}``. For example:
The ``expt2`` workflow already knows where to find its own post-processed output, so
``COMOUT_REF`` should point to post-processed output for the other experiment (``expt1``).

In *nco* mode, this directory should be set to the location of the first experiment's
``COMOUT`` directory (``${COMOUT}`` in the example below) and end with ``${PDY}/${cyc}``.
For example:

.. code-block:: console

Expand Down
Loading