Skip to content

Adding hooks for running on-prem automated WE2E tests.#676

Merged
JeffBeck-NOAA merged 1 commit into
ufs-community:developfrom
christinaholtNOAA:on_prem_test_script
Feb 15, 2022
Merged

Adding hooks for running on-prem automated WE2E tests.#676
JeffBeck-NOAA merged 1 commit into
ufs-community:developfrom
christinaholtNOAA:on_prem_test_script

Conversation

@christinaholtNOAA
Copy link
Copy Markdown
Contributor

@christinaholtNOAA christinaholtNOAA commented Feb 8, 2022

DESCRIPTION OF CHANGES:

Adds the hooks necessary to interact with the on-prem automated testing framework developed at NOAA-GSL. The framework runs regularly via cron on Jet and Hera (can be deployed to other machines by those with accounts/resources) and checks all open PRs for labels like ci-jet-intel-WE and ci-hera-intel-WE before 1) building the code, and 2) running WE2E tests for either SRW and regional_workflow.

The changes here add the following:

  • A script to setup the WE2E tests per machine, and to be consistent with the SRW build test directory structure.
  • Adds configurable option for installation location since the build test puts the bin directory in a slightly different location than the assumed default.

Once implemented, the existing Jet and Hera framework will support testing PRs to develop in either repositories. We can share the framework code so that these automated tests may be run on other supported platforms.

Outstanding work includes adding additional tests to the machine suite files.

TESTS CONDUCTED:

We have tested this script as a part of our test framework on Jet and Hera using the test included here in the machine suites files.

CONTRIBUTORS (optional):

@venitahagerty @robgonzalezpita

@mkavulich mkavulich added ci-hera-intel-WE Kicks off automated workflow test on hera with intel ci-jet-intel-WE Kicks off automated workflow test on jet with intel labels Feb 9, 2022
@venitahagerty
Copy link
Copy Markdown
Collaborator

venitahagerty commented Feb 10, 2022

Machine: hera
Compiler: intel
Job: WE
Repo location: /scratch2/BMC/zrtrr/rrfs_ci/autoci/pr/843090532/20220210134601/ufs-srweather-app
Build was Successful
Rocoto jobs started
Done: 0 of 1
Long term tracking will be done
If test failed, please make changes and add the following label back:
ci-hera-intel-WE

@venitahagerty
Copy link
Copy Markdown
Collaborator

venitahagerty commented Feb 10, 2022

Experiment Succeeded on hera: grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GSD_SAR
2022-02-10 14:26:09 +0000 :: hfe05 :: This cycle is complete: Success

@venitahagerty
Copy link
Copy Markdown
Collaborator

venitahagerty commented Feb 10, 2022

Machine: jet
Compiler: intel
Job: WE
Repo location: /lfs1/BMC/nrtrr/rrfs_ci/autoci/pr/843090532/20220210152109/ufs-srweather-app
Build was Successful
Rocoto jobs started
Done: 0 of 1
Long term tracking will be done
If test failed, please make changes and add the following label back:
ci-jet-intel-WE

@venitahagerty
Copy link
Copy Markdown
Collaborator

venitahagerty commented Feb 10, 2022

Experiment Succeeded on jet: grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GSD_SAR
2022-02-10 16:30:10 +0000 :: fe7 :: This cycle is complete: Success

JeffBeck-NOAA
JeffBeck-NOAA reviewed Feb 10, 2022
View reviewed changes
Comment thread ush/config_defaults.sh
@JeffBeck-NOAA JeffBeck-NOAA merged commit e5d5c38 into ufs-community:develop Feb 15, 2022
@mkavulich mkavulich mentioned this pull request Feb 16, 2022
Merged
mkavulich pushed a commit to ufs-community/ufs-srweather-app that referenced this pull request Feb 16, 2022
@christinaholtNOAA
Update hash for regional_workflow. (#213)
a3950b4 
## DESCRIPTION OF CHANGES: 
Updates the hash to the regional_workflow to include the script necessary for running automated WE2E tests.

## TESTS CONDUCTED: 
Tests were conducted with the top of this branch with the acceptance of the regional_workflow PR (ufs-community/regional_workflow#676).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@JeffBeck-NOAA JeffBeck-NOAA JeffBeck-NOAA approved these changes

@BenjaminBlake-NOAA BenjaminBlake-NOAA Awaiting requested review from BenjaminBlake-NOAA BenjaminBlake-NOAA is a code owner

@gsketefian gsketefian Awaiting requested review from gsketefian gsketefian is a code owner

@mkavulich mkavulich Awaiting requested review from mkavulich mkavulich is a code owner

Assignees

No one assigned

Labels

ci-hera-intel-WE Kicks off automated workflow test on hera with intel ci-jet-intel-WE Kicks off automated workflow test on jet with intel

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@christinaholtNOAA @venitahagerty @JeffBeck-NOAA @mkavulich