Skip to content

Bug fix for #1309: false reports of test failures#1312

Closed
SamuelTrahanNOAA wants to merge 2 commits into
ufs-community:developfrom
SamuelTrahanNOAA:bugfix/no-false-failures
Closed

Bug fix for #1309: false reports of test failures#1312
SamuelTrahanNOAA wants to merge 2 commits into
ufs-community:developfrom
SamuelTrahanNOAA:bugfix/no-false-failures

Conversation

@SamuelTrahanNOAA
Copy link
Copy Markdown
Collaborator

@SamuelTrahanNOAA SamuelTrahanNOAA commented Jul 5, 2022

PR Checklist

  • This PR is up-to-date with the top of all sub-component repositories except for those sub-components which are the subject of this PR. Please consult the ufs-weather-model wiki if you are unsure how to do this.

  • This PR has been tested using a branch which is up-to-date with the top of all sub-component repositories except for those sub-components which are the subject of this PR

  • An Issue describing the work contained in this PR has been created either in the subcomponent(s) or in the ufs-weather-model. The Issue should be created in the repository that is most relevant to the changes in contained in the PR. The Issue and the dependent sub-component PR
    are specified below.

Description

Fixes a known issue in the regression test system which can cause successful tests to be reported as failing.

Issue(s) addressed

fixes #1309

Testing

Ran tests on Hera, causing jobs to fail in various ways and then succeed. The fix seems to work. I want to test on Jet once it's back since that system has had the most trouble.

  • hera.intel
  • hera.gnu
  • orion.intel
  • cheyenne.intel
  • cheyenne.gnu
  • gaea.intel
  • jet.intel
  • wcoss2.intel
  • opnReqTest for newly added/changed feature
  • CI

Dependencies

None.

@SamuelTrahanNOAA
Copy link
Copy Markdown
Collaborator Author

This PR should be combined with one that has to generate baselines, to fully test the regression test system.

@junwang-noaa
Copy link
Copy Markdown
Collaborator

@SamuelTrahanNOAA Thanks for the fix, it looks good to me.

@SamuelTrahanNOAA
Copy link
Copy Markdown
Collaborator Author

This was merged with #1292 so I'm closing it.

SamuelTrahanNOAA added a commit to NOAA-GSL/ufs-weather-model that referenced this pull request Aug 8, 2022
SamuelTrahanNOAA added a commit to hannahcbarnes/ufs-weather-model that referenced this pull request Aug 8, 2022
SamuelTrahanNOAA added a commit to NOAA-GSL/ufs-weather-model that referenced this pull request Aug 18, 2022
* - Updates to GF and sgscloud_radpre for HFIP

* -Bug fixes

* bugfix from ufs-community: "Bug fix for ufs-community#1309: false reports of test failures ufs-community#1312"

* pefc was declared twice, which annoyed gnu

* bugfix from develop: do not complete workflow when all compile jobs fail

* update baseline date

* update ccpp/physics hash

* hera.gnu tests passed

* hera.intel tests passed

* jet intel tests passed

Co-authored-by: samuel.trahan <Samuel.Trahan@noaa.gov>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Regression tests falsely marked as failed when prior failed attempt finishes after next successful attempt starts

2 participants