Skip to content

Port tracker/genesis tasks to cloud; load wgrib2; add noaacloud to load_gw_gsi_modules#4111

Merged
DavidHuber-NOAA merged 10 commits into
NOAA-EMC:developfrom
TaylorRoper-NOAA:feature/port_tracker_cloud
Sep 30, 2025
Merged

Port tracker/genesis tasks to cloud; load wgrib2; add noaacloud to load_gw_gsi_modules#4111
DavidHuber-NOAA merged 10 commits into
NOAA-EMC:developfrom
TaylorRoper-NOAA:feature/port_tracker_cloud

Conversation

@TaylorRoper-NOAA
Copy link
Copy Markdown
Contributor

Description

This PR ports the tracker and genesis task to the cloud. The syndat directory has been staged (see #4012 (comment)). This PR also addresses minor issues discovered during testing. These changes include: 1) some needed updates to dev/workflow/hosts/awspw.yaml, 2) loading wgrib2 directly in gw_run.noaacloud.lua until loaded within gw_run.common.lua, and 3) adding noaacloud to possible machine in dev/ush/load_gw_gsi_modules.sh.

Resolves #4012

Type of change

  • Bug fix (fixes something broken)
  • New feature (adds functionality)
  • Maintenance (code refactor, clean-up, new CI test, etc.)

Change characteristics

  • Is this a breaking change (a change in existing functionality)? NO
  • Does this change require a documentation update? NO
  • Does this change require an update to any of the following submodules? NO

How has this been tested?

Tested by running C96_atm3DVar experiment on both AWS and Hera and compared outputted cyclone products. Logs and outputted data for the cloud can be found on Hera/Ursa at /scratch3/BMC/qosap/Taylor.Roper/shared/tracker_test_cloud.

Checklist

  • Any dependent changes have been merged and published
  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have documented my code, including function, input, and output descriptions
  • My changes generate no new warnings
  • New and existing tests pass with my changes
  • This change is covered by an existing CI test or a new one has been added
  • Any new scripts have been added to the .github/CODEOWNERS file with owners
  • I have made corresponding changes to the system documentation if necessary

@TaylorRoper-NOAA
Copy link
Copy Markdown
Contributor Author

TaylorRoper-NOAA commented Sep 29, 2025

@weihuang-jedi FYI this requires two things if you'd like to use this functionality:

  1. Stage the syndat data. I propose staging it at /bucket/syndat.
  2. Clone and install TC_tracker at tag TC_tracker.v1.2.1.2 into /contrib/git/TC_tracker/v1.2.1.2.

@TaylorRoper-NOAA TaylorRoper-NOAA changed the title Port tracker/genesis tasks to cloud Port tracker/genesis tasks to cloud; load wgrib2; add noaacloud to load_gw_gsi_modules Sep 30, 2025
Copy link
Copy Markdown
Contributor

@DavidHuber-NOAA DavidHuber-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good.

@DavidHuber-NOAA
Copy link
Copy Markdown
Contributor

All changes are just for extending cloud support. No CI testing is required. Merging.

@DavidHuber-NOAA DavidHuber-NOAA merged commit 388b1fe into NOAA-EMC:develop Sep 30, 2025
5 checks passed
@TaylorRoper-NOAA TaylorRoper-NOAA deleted the feature/port_tracker_cloud branch September 30, 2025 20:08
weihuang-jedi added a commit to NOAA-EPIC/global-workflow-cloud that referenced this pull request Oct 8, 2025
…into feature/adjust_tasks_per_node_layout

* 'develop' of github.com:NOAA-EPIC/global-workflow-cloud:
  Update CODEOWNERS for new oceanice_products assignments (NOAA-EMC#4134)
  Improve GW forecast timing of high-resolution runs with findings from containerized GW (NOAA-EMC#4123)
  Update CODEOWNERS to change job assignments (NOAA-EMC#4128)
  Update j-jobs to be bash linter compliant (NOAA-EMC#4124)
  Update the marine analysis archiving (NOAA-EMC#4082)
  Port tracker/genesis tasks to cloud; load wgrib2; add noaacloud to load_gw_gsi_modules (NOAA-EMC#4111)
  Only run wave bnd pnt for gfs (NOAA-EMC#4112)
weihuang-jedi added a commit to NOAA-EPIC/global-workflow-cloud that referenced this pull request Nov 5, 2025
…NOAA-EPIC/global-workflow-cloud into feature/use_container_spack-stack-1.9.2

* 'feature/use_container_spack-stack-1.9.2' of github.com:NOAA-EPIC/global-workflow-cloud:
  only double quota varaibles
  only double quota varaibles
  need run_mpmd.sh changes
  remove  config.resources.URSA from sfs
  recover ursa.yaml
  testing on ursa
  working on aws
  remove unused dir
  Update the marine analysis archiving (NOAA-EMC#4082)
  Port tracker/genesis tasks to cloud; load wgrib2; add noaacloud to load_gw_gsi_modules (NOAA-EMC#4111)
  Only run wave bnd pnt for gfs (NOAA-EMC#4112)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Port EMC TC_tracker to AWS

2 participants