Skip to content

Allow APP to differ between RUNs#2943

Merged
WalterKolczynski-NOAA merged 58 commits into
NOAA-EMC:developfrom
DavidHuber-NOAA:feature/multi-app
Nov 26, 2024
Merged

Allow APP to differ between RUNs#2943
WalterKolczynski-NOAA merged 58 commits into
NOAA-EMC:developfrom
DavidHuber-NOAA:feature/multi-app

Conversation

@DavidHuber-NOAA
Copy link
Copy Markdown
Contributor

@DavidHuber-NOAA DavidHuber-NOAA commented Sep 19, 2024

Description

This enables APP to be specified for each RUN. This also removes the need for a _no_run configuration dictionary and somewhat simplifies the _init_finalize method.

Resolves #2908
Resolves #2956

Type of change

  • New feature (adds functionality)

Change characteristics

  • Is this a breaking change (a change in existing functionality)? NO
  • Does this change require a documentation update? NO
  • Does this change require an update to any submodules? NO

How has this been tested?

  • Generated .xml files on Hera for all available CI tests and verified they were identical to develop.
  • Created an arbitrary APP configuration ({"gdas": "S2S", "gfs": "ATM"})

Checklist

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • My changes generate no new warnings
  • New and existing tests pass with my changes

@DavidHuber-NOAA

This comment was marked as resolved.

Comment thread workflow/applications/applications.py
@DavidHuber-NOAA DavidHuber-NOAA marked this pull request as ready for review October 1, 2024 19:24
@DavidHuber-NOAA
Copy link
Copy Markdown
Contributor Author

This PR now correctly generates identical CI XMLs as compared to develop (with the exception of the stage_ic and cleanup jobs which are now run on service partitions). An additional case was tested based on the C96C48_hybatmaerosnowDA case, but the APP was set to ATMA for RUN==gdas and ATM for RUN==gfs. In this case, the gfs tasks in the resultant XML did not include any aero-component jobs.

Marking ready for review.

Comment thread workflow/applications/applications.py Outdated
Comment thread workflow/applications/gfs_cycled.py
Comment thread workflow/applications/applications.py Outdated
Comment thread workflow/applications/gfs_cycled.py Outdated
Comment thread workflow/applications/gfs_cycled.py Outdated
Comment thread workflow/applications/gfs_forecast_only.py Outdated
Comment thread workflow/rocoto/gfs_tasks.py Outdated
Comment thread workflow/rocoto/gfs_tasks.py Outdated
@WalterKolczynski-NOAA WalterKolczynski-NOAA added CI-Wcoss2-Running CI testing on WCOSS for this PR is in-progress and removed CI-Wcoss2-Building CI testing is cloning/building on WCOSS2 labels Nov 23, 2024
@WalterKolczynski-NOAA
Copy link
Copy Markdown
Contributor

CI Tests set up to run in /lfs/h2/emc/ptmp/walter.kolczynski/PR/PR_2943/RUNTESTS on WCOSS

@WalterKolczynski-NOAA WalterKolczynski-NOAA added CI-Wcoss2-Passed CI testing on WCOSS for this PR has completed successfully CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera and removed CI-Wcoss2-Running CI testing on WCOSS for this PR is in-progress CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera labels Nov 24, 2024
@DavidHuber-NOAA
Copy link
Copy Markdown
Contributor Author

I'm going to try and relaunch CI on Hera.

@emcbot
Copy link
Copy Markdown

emcbot commented Nov 25, 2024

Experiment C96C48_hybatmaerosnowDA FAILED on Hera in Build# 8 with error logs:

/scratch1/NCEPDEV/global/CI_dh/2943/RUNTESTS/COMROOT/C96C48_hybatmaerosnowDA_74c08046/logs/2021122012/gdas_aeroanlgenb.log

Follow link here to view the contents of the above file(s): (link)

@emcbot
Copy link
Copy Markdown

emcbot commented Nov 25, 2024

Experiment C96C48_hybatmaerosnowDA FAILED on Hera in Build# 8 in
/scratch1/NCEPDEV/global/CI_dh/2943/RUNTESTS/EXPDIR/C96C48_hybatmaerosnowDA_74c08046

Comment thread parm/config/gfs/config.base Outdated
@DavidHuber-NOAA
Copy link
Copy Markdown
Contributor Author

The aerosol forecast failed to be included due to a typo in config.base. Killing the tests and relaunching on Hera.

@emcbot
Copy link
Copy Markdown

emcbot commented Nov 25, 2024

Experiment C48mx500_3DVarAOWCDA FAILED on Hera in Build# 8 in
/scratch1/NCEPDEV/global/CI_dh/2943/RUNTESTS/EXPDIR/C48mx500_3DVarAOWCDA_74c08046

@emcbot
Copy link
Copy Markdown

emcbot commented Nov 25, 2024

Experiment C48_S2SW FAILED on Hera in Build# 8 in
/scratch1/NCEPDEV/global/CI_dh/2943/RUNTESTS/EXPDIR/C48_S2SW_74c08046

@emcbot
Copy link
Copy Markdown

emcbot commented Nov 25, 2024

Experiment C96_atm3DVar FAILED on Hera in Build# 8 in
/scratch1/NCEPDEV/global/CI_dh/2943/RUNTESTS/EXPDIR/C96_atm3DVar_74c08046

@emcbot
Copy link
Copy Markdown

emcbot commented Nov 25, 2024

Experiment C96C48_ufs_hybatmDA FAILED on Hera in Build# 8 in
/scratch1/NCEPDEV/global/CI_dh/2943/RUNTESTS/EXPDIR/C96C48_ufs_hybatmDA_74c08046

@emcbot
Copy link
Copy Markdown

emcbot commented Nov 25, 2024

Experiment C96C48_hybatmDA FAILED on Hera in Build# 8 in
/scratch1/NCEPDEV/global/CI_dh/2943/RUNTESTS/EXPDIR/C96C48_hybatmDA_74c08046

@emcbot
Copy link
Copy Markdown

emcbot commented Nov 25, 2024

Experiment C48_ATM FAILED on Hera in Build# 8 in
/scratch1/NCEPDEV/global/CI_dh/2943/RUNTESTS/EXPDIR/C48_ATM_74c08046

@emcbot
Copy link
Copy Markdown

emcbot commented Nov 25, 2024

Experiment C48_S2SWA_gefs FAILED on Hera in Build# 8 in
/scratch1/NCEPDEV/global/CI_dh/2943/RUNTESTS/EXPDIR/C48_S2SWA_gefs_74c08046

@emcbot
Copy link
Copy Markdown

emcbot commented Nov 25, 2024

CI Failed on Hera in Build# 8
Built and ran in directory /scratch1/NCEPDEV/global/CI_dh/2943


Experiment C96C48_hybatmaerosnowDA_74c08046 Terminated with 0
FAIL
FAIL tasks failed and 1 dead at Mon Nov 25 15:23:28 UTC 2024
Experiment C96C48_hybatmaerosnowDA_74c08046 Terminated: *FAIL*
Error logs:
/scratch1/NCEPDEV/global/CI_dh/2943/RUNTESTS/COMROOT/C96C48_hybatmaerosnowDA_74c08046/logs/2021122012/gdas_aeroanlgenb.log
Experiment C96_S2SWA_gefs_replay_ics_74c08046 Completed 1 Cycles: *SUCCESS* at Mon Nov 25 16:18:11 UTC 2024

@emcbot
Copy link
Copy Markdown

emcbot commented Nov 25, 2024

CI Passed on Hera in Build# 9
Built and ran in directory /scratch1/NCEPDEV/global/CI_dh/2943


Experiment C96_S2SWA_gefs_replay_ics_e5becab5 Completed 1 Cycles: *SUCCESS* at Mon Nov 25 19:06:30 UTC 2024
Experiment C48mx500_3DVarAOWCDA_e5becab5 Completed 2 Cycles: *SUCCESS* at Mon Nov 25 19:18:37 UTC 2024
Experiment C48_ATM_e5becab5 Completed 2 Cycles: *SUCCESS* at Mon Nov 25 19:30:46 UTC 2024
Experiment C96C48_hybatmaerosnowDA_e5becab5 Completed 3 Cycles: *SUCCESS* at Mon Nov 25 20:31:54 UTC 2024
Experiment C48_S2SWA_gefs_e5becab5 Completed 1 Cycles: *SUCCESS* at Mon Nov 25 20:32:59 UTC 2024
Experiment C96_atm3DVar_e5becab5 Completed 3 Cycles: *SUCCESS* at Mon Nov 25 20:37:58 UTC 2024
Experiment C96C48_hybatmDA_e5becab5 Completed 3 Cycles: *SUCCESS* at Mon Nov 25 20:38:00 UTC 2024
Experiment C48_S2SW_e5becab5 Completed 2 Cycles: *SUCCESS* at Mon Nov 25 21:08:27 UTC 2024
Experiment C96C48_ufs_hybatmDA_e5becab5 Completed 3 Cycles: *SUCCESS* at Mon Nov 25 21:38:55 UTC 2024

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI-Hera-Passed **Bot use only** CI testing on Hera for this PR has completed successfully CI-Hercules-Passed **Bot use only** CI testing on Hercules for this PR has completed successfully CI-Wcoss2-Passed CI testing on WCOSS for this PR has completed successfully

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Check reservable memory on Hercules and Orion Enable RUN-specific APP configurations

5 participants