Add an archive task to GEFS system to archive files locally#2816
Merged
WalterKolczynski-NOAA merged 93 commits intoSep 7, 2024
Merged
Conversation
AntonMFernando-NOAA
requested review from
DavidHuber-NOAA,
EricSinsky-NOAA,
WalterKolczynski-NOAA and
aerorahul
Contributor
DavidHuber-NOAA
left a comment
DavidHuber-NOAA
left a comment
There was a problem hiding this comment.
Has this been tested on any platforms yet? I don't think that this will run until there is an archiving template in place. Marking as draft for now.
Contributor
Author
@DavidHuber-NOAA Thanks. Yes. This is a draft. |
Contributor
|
@AntonMFernando-NOAA I can help construct the archiving templates for GEFS. |
Contributor
Author
@EricSinsky-NOAA I will set up a meeting next week to further discuss this. |
AntonMFernando-NOAA
force-pushed
the
feature/gefs-arch
branch
from
dc93c91 to
fe3254e
Compare
AntonMFernando-NOAA
force-pushed
the
feature/gefs-arch
branch
from
fe3254e to
876dfee
Compare
Contributor
Author
|
@DavidHuber-NOAA @EricSinsky-NOAA I was able to archive a test file locally. CI test passed on Hercules. |
Contributor
Author
|
@WalterKolczynski-NOAA @DavidHuber-NOAA Ready to go! |
AntonMFernando-NOAA
requested review from
DavidHuber-NOAA and
WalterKolczynski-NOAA
WalterKolczynski-NOAA
previously approved these changes
Sep 6, 2024
WalterKolczynski-NOAA
added
CI-Hera-Ready
DavidHuber-NOAA
previously approved these changes
Sep 6, 2024
Contributor
DavidHuber-NOAA
left a comment
DavidHuber-NOAA
left a comment
There was a problem hiding this comment.
Looks good! Just one comment suggestion.
|
|
||
| {% set COMIN_ATMOS_ENSSTAT_1p00 = COM_ATMOS_GRIB_GRID_TMPL | replace_tmpl(tmpl_dict) %} | ||
|
|
||
| # test files |
Contributor
There was a problem hiding this comment.
Suggested change
| # test files | |
| # Select ensstat files to copy to the arcdir |
emcbot
added
CI-Hera-Building
AntonMFernando-NOAA
dismissed stale reviews from DavidHuber-NOAA and WalterKolczynski-NOAA
via
18bc470
DavidHuber-NOAA
approved these changes
Sep 6, 2024
emcbot
added
CI-Hera-Running
|
CI Passed on Hera in Build# 4 |
7 tasks
DavidHuber-NOAA
added a commit
to DavidHuber-NOAA/global-workflow
that referenced
this pull request
Sep 9, 2024
* origin/develop: Create JEDI class (NOAA-EMC#2805) Restructure the bufr sounding job (NOAA-EMC#2853) Add an archive task to GEFS system to archive files locally (NOAA-EMC#2816) Reenable Orion Cycling Support (NOAA-EMC#2877) Eliminate race conditions and remove DATAROOT last in cleanup (NOAA-EMC#2893) Update aerosol climatology to 2013-2024 mean (NOAA-EMC#2888) Add ability to run CI test C96_atm3DVar.yaml to Gaea-C5 (NOAA-EMC#2885) Support global-workflow GEFS C48 on Google Cloud (NOAA-EMC#2861) Add 3 and 9 hr increment files to IC staging (NOAA-EMC#2876) Add diffusion/diag B for aerosol DA and some other needed changes (NOAA-EMC#2738) Correct ocean `MOM.res_#` stage copy (NOAA-EMC#2868) Support coupling on AWS (NOAA-EMC#2859) Add JEDI ATM lgetkf observer and solver jobs (NOAA-EMC#2833) Fix gdas build on Gaea and add Gaea to available CI list (NOAA-EMC#2857) Support ATM forecast only on Google (NOAA-EMC#2832) Add GEFS C48 support on AWS (NOAA-EMC#2818) Update omega calculation (NOAA-EMC#2751) Add snow DA update and recentering for the EnKF forecasts (NOAA-EMC#2690) support ATM forecast only on Azure (NOAA-EMC#2827) Convert staging job to python and yaml (NOAA-EMC#2651) Fixed test on UNAVAILBLE in python Rocoto check (NOAA-EMC#2842)
aerorahul
pushed a commit
that referenced
this pull request
Sep 25, 2024
- This task is an extension of the arch job previously merged that archives files in ROTDIR (#2816 AntonMFernando-NOAA@2816c3b) - This feature adds an archive task to GEFS system to archive files in HPSSARCH and LOCALARCH. Resolves #2698 Refs #2816 #2772 #832 --------- Co-authored-by: David Huber <david.huber@noaa.gov>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
6 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This task is an extension of the empty arch job previously merged.
This feature adds an archive task to GEFS system to archive files locally.
This feature archives files in ensstat directory.
Resolves Add archive task to GEFS workflow #2698
Refs Update archive to handle ensembles #832 Feature/get arch adds an empty archive job to GEFS system #2772
Type of change
Change characteristics
How has this been tested?
Checklist