Add METplus-based ensemble verification#575

Merged

michelleharrold merged 179 commits into

ufs-community:developfrom

michelleharrold:feature/add_metplus_gridpoint_ensvx

Sep 16, 2021

Commits on Mar 2, 2020

Fix to post flat file.
jwolff-ncar
committed

Commits on Mar 9, 2020

Merge remote-tracking branch 'upstream/community_develop' into community_develop
jwolff-ncar
committed
Create MET and METplus config files under ush/templates/parm
jwolff-ncar
committed

Commits on Mar 10, 2020

Added script to pull and reorg ccpa data. Added a script to run gridstat with METplus. Updated MET and METplus config files.
jwolff-ncar
committed

Commits on Mar 13, 2020

Commits on Mar 17, 2020

Moved some hard coded items out from the script to the XML
jwolff-ncar
committed

Commits on Mar 18, 2020

Commits on Mar 21, 2020

Commits on Mar 26, 2020

Commits on Mar 27, 2020

Add hera gridstat module file
jwolff-ncar
committed

Commits on Apr 1, 2020

Commits on Apr 2, 2020

Commits on Jun 17, 2020

Updated files to manually resolve conflicts so I can merge in new develop to this feature branch
jwolff-ncar
committed

Commits on Jun 18, 2020

Add METplus settings to config_defaults
jwolff-ncar
committed

Commits on Jun 23, 2020

Commits on Jul 1, 2020

Updated to include SCRIPTSDIR and other MET specific settings along with updates to FHR syntax
jwolff-ncar
committed

Commits on Jul 2, 2020

Commits on Jul 10, 2020

Added files to run grid_stat for a variety of accumulation intervals, including 3, 6, and 24h
jwolff-ncar
committed

Commits on Jul 15, 2020

Commits on Aug 5, 2020

Manually merged in conflicts. Mostly due to including ensemble settings.
jwolff-ncar
committed

Commits on Aug 27, 2020

Commits on Aug 28, 2020

Commits on Sep 1, 2020

Update for adding in reflectivity verification using MRMS analyses and updating name of model output to RRFS rather than HRRR
jwolff-ncar
committed

Commits on Sep 6, 2020

Merge remote-tracking branch 'upstream/develop' into feature/add_metplus
jwolff-ncar
committed

Commits on Sep 14, 2020

Commits on Sep 15, 2020

Merge remote-tracking branch 'upstream/develop' into feature/add_metplus
jwolff-ncar
committed

Commits on Oct 5, 2020

Updated fork with latest develop
jwolff-ncar
committed

Commits on Oct 14, 2020

Merge remote-tracking branch 'upstream/develop' into feature/add_metplus
jwolff-ncar
committed

Commits on Oct 26, 2020

Commits on Oct 29, 2020

Change cov_thresh for REFL to be a true max in nbrhood as SPC does.
jwolff-ncar
committed

Commits on Oct 30, 2020

Update fork
jwolff-ncar
committed

Commits on Nov 3, 2020

Job script for get_obs_ccpa
lindsayrblank
committed
Jobs script for get_obs_mrms
lindsayrblank
committed
Jobs script for get_obs_ndas
lindsayrblank
committed

Commits on Nov 23, 2020

Added external variables necessary to get_ccpa script
lindsayrblank
committed
Updated workflow template with separate get obs tasks
lindsayrblank
committed
Separated pull scripts from run scripts
lindsayrblank
committed

Commits on Nov 26, 2020

Added necessary defaults/values for defining pull tasks
lindsayrblank
committed

Commits on Nov 30, 2020

Commits on Dec 7, 2020

Added module files, default config.sh options, and changed dependencies for vx tasks
lindsayrblank
committed

Commits on Dec 8, 2020

Merge remote-tracking branch 'upstream/feature/add_metplus' into feature/add_metplus
lindsayrblank
committed
Changed name of new workflow to FV3LAM_wflow.xml
lindsayrblank
committed

Commits on Dec 10, 2020

Added task get_obs_tn, removed config.sh, updated config_defaults and config.community.sh
lindsayrblank
committed

Commits on Dec 14, 2020

Adjusted the community and default config files based on comments
lindsayrblank
committed

Commits on Dec 15, 2020

Updated FV3LAM workflow
lindsayrblank
committed
Fixed discrepancies in config.community.sh
lindsayrblank
committed
Fixed discrepancies in config_defaults.sh
lindsayrblank
committed
Fixed discrepancies in config_defaults.sh round 2
lindsayrblank
committed
Fixed discrepancies in config_defaults.sh round 3
lindsayrblank
committed
Fixed discrepancies in config_defaults.sh round 4
lindsayrblank
committed
Fixed discrepancies in config.community.sh round 2
lindsayrblank
committed
Fixed discrepancies in config.community.sh round 3
lindsayrblank
committed
Fixed discrepancies in generate_FV3LAM_wflow.sh
lindsayrblank
committed
Fixed discrepancies in generate_FV3LAM_wflow.sh round 2
lindsayrblank
committed
Fixed discrepancies in generate_FV3LAM_wflow.sh round 3
lindsayrblank
committed
Updated FV3LAM_wflow template
lindsayrblank
committed

Commits on Dec 16, 2020

Commits on Jan 4, 2021

Merge remote-tracking branch 'upstream/feature/add_metplus' into feature/add_metplus
lindsayrblank
committed
Fixed the dependencies of the vx tasks
lindsayrblank
committed

Commits on Jan 6, 2021

Fixed Vx Task Dependencies in Workflow: Feature/add metplus (#3)
Lindsay
authored

Commits on Jan 8, 2021

manual merge
jwolff-ncar
committed

Commits on Jan 11, 2021

Merge remote-tracking branch 'upstream/develop' into feature/add_metplus
jwolff-ncar
committed

Commits on Jan 13, 2021

Commits on Jan 25, 2021

Verification channges for obs. (#4)

michelleharrold
and
Michelle Harrold
authored

Commits on Feb 5, 2021

Initial METplus .confs and MET config files for EnsembleStat APCP
lindsayrblank
committed

Commits on Feb 6, 2021

J-Job script for running ensemble stat
lindsayrblank
committed
Exregional script for ensemble-stat
lindsayrblank
committed

Commits on Feb 8, 2021

Added EnsembleStat.conf for A6 and A24. Added PCPCombine to A3, A6, and A24.
lindsayrblank
committed
Added EnsembleStatConfig files for 6 and 24h
lindsayrblank
committed

Commits on Feb 9, 2021

Copy of workflow template with precipitation ensemble tasks added. Will become main template when testing is complete
lindsayrblank
committed
Added export statement for number of ensemble members
lindsayrblank
committed
Added necessary task definitions in ush
lindsayrblank
committed

Commits on Feb 10, 2021

Updated workflow to included ENTITY definitions for ensstat
lindsayrblank
committed

Commits on Feb 11, 2021

Merge remote-tracking branch 'upstream/feature/add_metplus' into feature/ensemble_stat
lindsayrblank
committed

Commits on Feb 12, 2021

Fixed typo
lindsayrblank
committed

Commits on Feb 15, 2021

manual merge with develop
jwolff-ncar
committed

Commits on Feb 16, 2021

Added ens vx configs

Michelle Harrold
authored and
Michelle Harrold
committed
Pull in updates from develop that were not merging properly. Small change to config.community to turn off vx tasks by default.
jwolff-ncar
committed
Added/mod files for point ens vx.

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Feb 17, 2021

Updated metplus conf files for ens point vx

Michelle Harrold
authored and
Michelle Harrold
committed
Did manual merge of these files because it was not handled properly automatically
jwolff-ncar
committed
Adding additional variables to METplus for regional workflow (#5)
PerryShafran-NOAA
authored

Commits on Feb 26, 2021

Changes made based on meeting with Michelle and Jamie
lindsayrblank
committed
Updating fork
lindsayrblank
committed
Cleanup after merge
lindsayrblank
committed

Commits on Mar 3, 2021

Added additional ens vx

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Mar 8, 2021

Merge remote-tracking branch 'upstream/feature/add_metplus' into feature/ensemble_stat
lindsayrblank
committed

Commits on Mar 10, 2021

Merge with jwolff-ncar feature/add_metplus branch

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Mar 16, 2021

Ensemble point vx mods

Michelle Harrold
authored and
Michelle Harrold
committed
Additional updates for ens and det vx

Michelle Harrold
authored and
Michelle Harrold
committed
ensgrid_mean and ensgrid_prob .conf files for APCP
lindsayrblank
committed

Commits on Mar 17, 2021

Updates for ensemble vx.

Michelle Harrold
authored and
Michelle Harrold
committed
Added mean and prob point-stat configs

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Mar 19, 2021

Updates to ensgrid_vx
lindsayrblank
committed

Commits on Mar 24, 2021

Updates for mean/prob vx.

Michelle Harrold
authored and
Michelle Harrold
committed
Updates to FV3LAM_wflow.xml

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Mar 25, 2021

Deterministic and ensembel vx updates.

Michelle Harrold
authored and
Michelle Harrold
committed
Ensgrid mean
lindsayrblank
committed
Update setup.sh
Lindsay
authored
Changed workflow template title
lindsayrblank
committed
Merge branch 'feature/ensemble_stat' of https://github.com/lindsayrblank/regional_workflow into feature/ensemble_stat
lindsayrblank
committed

Commits on Mar 26, 2021

Updates to deterministic and ensemble verification

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Mar 29, 2021

Merged Michelle's work into my branch
lindsayrblank
committed
Created EnsembleStat METplus conf and MET config files for REFC
lindsayrblank
committed

Commits on Apr 1, 2021

Commits on Apr 3, 2021

Updates to workflow to add ensgrid_vx
lindsayrblank
committed

Commits on Apr 13, 2021

Changes I made to account for runtime errors.
lindsayrblank
committed

Commits on Apr 15, 2021

Made changes to directory structures
lindsayrblank
committed
Made changes to directory structures and variables
lindsayrblank
committed

Commits on May 17, 2021

Merge pull request #2 from lindsayrblank/feature/ensemble_stat
michelleharrold
authored

Commits on May 18, 2021

Changed log files and stage dir.

Michelle Harrold
authored and
Michelle Harrold
committed
Changes for grid- and point-vx.

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Jul 6, 2021

Updated METplus ensemble precip conf files.

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Jul 9, 2021

Mods for ensemble and deterministic vx.

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Jul 11, 2021

Change to GridStatConfig_REFC_mean

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Jul 12, 2021

Updated EnsembleStat_REFC.conf

Michelle Harrold
authored and
Michelle Harrold
committed
Updated to METv10.0.0

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Jul 13, 2021

Updated conf files for paths.

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Jul 14, 2021

Updated FV3LAM_wflow.xml template.

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Jul 15, 2021

Mods for vx dependencies

Michelle Harrold
authored and
Michelle Harrold
committed
Changes due to sync with develop

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Jul 16, 2021

Updated for censor thresh in METplus conf files; changes to FV3LAM_wflow.xml after sync with develop.

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Jul 19, 2021

Updated exregional_run_fcst.sh generate_FV3LAM_wflow.sh to address merge with develop.

Michelle Harrold
authored and
Michelle Harrold
committed
Resync with develop mods.

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Jul 22, 2021

Merge remote-tracking branch 'upstream/develop' into feature/add_metplus_gridpoint_ensvx

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Jul 23, 2021

Merge remote-tracking branch 'upstream/develop' into feature/add_metplus_gridpoint_ensvx

Michelle Harrold
authored and
Michelle Harrold
committed

Commits on Jul 28, 2021

Mods for ensemble precip vx, handling padded/non-padded ensemble member names, fixes for python environment for obs pull.
michelleharrold
committed

Commits on Jul 29, 2021

Changes to RETOP (units) and REFC (naming and level) verification.
michelleharrold
committed

Commits on Aug 5, 2021

Fix OUTPUT_BASE for deterministic vx.
michelleharrold
committed

Commits on Aug 6, 2021

Commits on Aug 15, 2021

Changed comp. ref. variable name in GridStat_REFC_prob.conf
michelleharrold
committed

Commits on Aug 16, 2021

Changed comp. ref. level in GridStat_REFC_prob.conf
michelleharrold
committed

Commits on Aug 18, 2021

Commits on Aug 20, 2021

Modified location of obs to live outside cycle dir, allowing for obs to be shared across cycles.
michelleharrold
committed

Commits on Aug 27, 2021

Commits on Sep 10, 2021

Addessed comments in PR and mods for 10-m WIND.
michelleharrold
committed

Commits on Sep 14, 2021

Sync with develop.
michelleharrold
committed

Commits on Sep 16, 2021

Addressing final comments in PR.
michelleharrold
committed