-
Notifications
You must be signed in to change notification settings - Fork 25
Home
This toolbox contains a collection of Matlab functions for calculating the skill of model predictions against observations. It includes metrics such as root-mean-square-error (RMSE) difference, centered root-mean-square (RMS) difference, and skill score (SS), as well as a collection of functions for producing target and Taylor diagrams. The more valuable feature of the toolbox are the plotting functions for target and Taylor diagrams and the ability to easily customize the diagrams.
The target and Taylor diagrams produced by the several examples posted on this wiki can be viewed by following the links shown below. This is a useful starting point for users looking to identify the best example from which to begin creating a diagram for their specific need by modifying the accompanying Matlab program.
An easy tutorial is provided here in the form of a series of example scripts to illustrate how to produce target and Taylor diagrams in a variety of formats using the Skill Metrics package. For background information on target diagrams the reader is referred to Jolliff et al. (2009) and for Taylor diagrams to the primer. There are 7 examples for target diagrams and 11 examples for Taylor diagrams that successively progress from very simple to more customized figures. These series of examples provide an easy tutorial on how to use the various options of the target_diagram and taylor_diagram functions. They also provide a quick reference in future for how to produce the diagrams with specific features. The diagrams produced by each script are in Portable Network Graphics (PNG) format and have the same file name as the script with a "png" suffix. Examples of the diagrams produced can be found in the Examples folder with the same file name as the script and ending in '_example.png'. For example the diagram produced by target1.m is named target1_example.png. Follow the links below to navigate each of the target and Taylor diagram examples.
- Target Diagram Options
- Example 1 (target1.m, target1.png)
- Example 2 (target2.m, target2.png)
- Example 3 (target3.m, target3.png)
- Example 4 (target4.m, target4.png)
- Example 5 (target5.m, target5.png)
- Example 6 (target6.m, target6.png)
- Example 7 (target7.m, target7.png)
- Taylor Diagram Options
- Example 1 (taylor1.m, taylor1.png)
- Example 2 (taylor2.m, taylor2.png)
- Example 3 (taylor3.m, taylor3.png)
- Example 4 (taylor4.m, taylor4.png)
- Example 5 (taylor5.m, taylor5.png)
- Example 6 (taylor6.m, taylor6.png)
- Example 7 (taylor7.m, taylor7.png)
- Example 8 (taylor8.m, taylor8.png)
- Example 9 (taylor9.m, taylor9.png)
- Example 10 (taylor10.m, taylor10.png)
- Example 11 (taylor11.m, taylor11.png)
There is also a simple program in the Examples folder (all_stats.m) that provides examples of how to calculate the various skill metrics used or available in the toolbox. All the calculated skill metrics are written to an Excel file for easy viewing and manipulation.
- bias_skill : Calculate the bias between two variables
- brier_score : Calculate Brier score (BS) between two variables
- centered_rms_dev : Calculate centered root-mean-square difference (CRMSD, E') between two variables
- check_taylor_stats : Checks input statistics satisfy Taylor diagram relation to <1%.
- nash_sutcliffe_efficiency : Calculate Nash-Sutcliffe efficiency between two variables
- rms_dev : Calculate the root-mean-square deviation (RMSD) between two variables
- rmse : Calculate root-mean-square-error (RMSE) difference between two variables
- skill_score_brier : Calculate Brier skill score (BSS) between two variables
- skill_score_murphy : Calculate non-dimensional skill score (SS) between two variables
A list of the currently available plotting options for the diagrams can be found by following the links below:
For problems encountered using the package or explanations on how to change the font size of the diagrams, etc., refer to the FAQ page of the Wiki.
- Jolliff, J. K., J. C. Kindle, I. Shulman, B. Penta, M. Friedrichs, R. Helber, and R. Arnone (2009), Skill assessment for coupled biological/physical models of marine systems, J. Mar. Sys., 76(1-2), 64-82, doi:10.1016/j.jmarsys.2008.05.014
- Taylor, K. E. (2001) Summarizing multiple aspects of model performance in a single diagram, J. Geophys. Res., 106(D7), 7183–7192, doi:10.1029/2000JD900719.