Skip to content

Fix LAM inline post and long run time RT tests#513

Merged
junwang-noaa merged 29 commits into
ufs-community:developfrom
junwang-noaa:lampost_ww3test
Apr 20, 2021
Merged

Fix LAM inline post and long run time RT tests#513
junwang-noaa merged 29 commits into
ufs-community:developfrom
junwang-noaa:lampost_ww3test

Conversation

@junwang-noaa
Copy link
Copy Markdown
Collaborator

@junwang-noaa junwang-noaa commented Apr 7, 2021

PR Checklist

  • [x ] Ths PR is up-to-date with the top of all sub-component repositories except for those sub-components which are the subject of this PR. Please consult the ufs-weather-model wiki if you are unsure how to do this.

  • [x ] This PR has been tested using a branch which is up-to-date with the top of all sub-component repositories except for those sub-components which are the subject of this PR

  • [x ] An Issue describing the work contained in this PR has been created either in the subcomponent(s) or in the ufs-weather-model. The Issue should be created in the repository that is most relevant to the changes in contained in the PR. The Issue and the dependent sub-component PR
    are specified below.

  • If new or updated input data is required by this PR, it is clearly stated in the text of the PR.
    No input data change

Instructions: All subsequent sections of text should be filled in as appropriate.

The information provided below allows the code managers to understand the changes relevant to this PR, whether those changes are in the ufs-weather-model repository or in a subcomponent repository. Ufs-weather-model code managers will use the information provided to add any applicable labels, assign reviewers and place it in the Commit Queue. Once the PR is in the Commit Queue, it is the PR owner's responsiblity to keep the PR up-to-date with the develop branch of ufs-weather-model.

Description

This PR will do the following:

  1. Fix the LAM inline post reproducibility issue due to uninitialized variables.
  2. More tasks have been added in several RT tests that take long run time. Those tests were reported reach wall clock time on some platforms.
  3. Update UPP lib from 10.0.4 to 10.0.5. UPP lib10.0.5 has threading issue fixed.
  4. Remove the baseline creation in fv3_gfs_v16_RRTMGP_2thrd test
  5. change LAM configuration in LAM3km suite file and namelist

Issue(s) addressed

Link the issues to be closed with this PR, whether in this repository, or in another repository.
(Remember, issues must always be created before starting work on a PR branch!)

Testing

Testing has been done on hera and orion.

  • ww3 tasks are increased from 42 to 82 in fv3 wave tests (fv3_gfdlmprad and fv3_gfdlmprad_atmwav) run time is changed from 700-800s to 350-400s
  • forecast length fhmax is reduced from 6 to 3, fv3 write nemsio c768 with wave run time change: 710s ->530s
  • total tasks in regional tests are increased from 24->80, run time change: 550->250s, results are also changed

How were these changes tested? What compilers / HPCs was it tested with? Are the changes covered by regression tests? (If not, why? Do new tests need to be added?) Have regression tests and unit tests (utests) been run? On which platforms and with which compilers? (Note that unit tests can only be run on tier-1 platforms)

  • [x ] hera.intel
  • [x ] hera.gnu
  • [x ] orion.intel
  • [x ] cheyenne.intel
  • [x ] cheyenne.gnu
  • [x ] gaea.intel
  • [x ] jet.intel
  • [x ] wcoss_cray
  • [x ] wcoss_dell_p3

Dependencies

If testing this branch requires non-default branches in other repositories, list them. Those branches should have matching names (ideally).

Do PRs in upstream repositories need to be merged first?
If so add the "waiting for other repos" label and list the upstream PRs

@junwang-noaa junwang-noaa added Baseline Updates Current baselines will be updated. Waiting for Reviews The PR is waiting for reviews from associated component PR's. labels Apr 9, 2021
Copy link
Copy Markdown
Collaborator

@climbfuji climbfuji left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me. The fix for the LAM post is in the fv3atm PR, correct? Everything in this ufs-weather-models PR is about reducing the runtime of the regression tests?

@junwang-noaa
Copy link
Copy Markdown
Collaborator Author

@climbfuji Yes, the lam post fix is in FV3 PR, POST code manager reviewed the code changes. The ufs-weather-models PR is to reduce the run time of some long RT test.

@junwang-noaa
Copy link
Copy Markdown
Collaborator Author

When the module file update is committed, I will update upp lib to 10.0.5.

@BrianCurtis-NOAA
Copy link
Copy Markdown
Collaborator

Machine: gaea
Compiler: intel
Job: BL
Repo location: /lustre/f2/pdata/ncep/emc.nemspara/autort/pr/610295225/20210413023016/ufs-weather-model
Please manually delete: /lustre/f2/scratch/emc.nemspara/FV3_RT/rt_7367
Repo location: /lustre/f2/pdata/ncep/emc.nemspara/autort/pr/610295225/20210413033956/ufs-weather-model
Please manually delete: /lustre/f2/scratch/emc.nemspara/FV3_RT/rt_9828
Test fv3_regional_quilt 023 failed in check_result failed
Test fv3_regional_quilt 023 failed in run_test failed
Please make changes and add the following label back:
gaea-intel-BL

@BrianCurtis-NOAA
Copy link
Copy Markdown
Collaborator

Machine: orion
Compiler: intel
Job: BL
Repo location: /work/noaa/nems/emc.nemspara/autort/pr/610295225/20210412224511/ufs-weather-model
Please manually delete: /work/noaa/stmp/bcurtis/stmp/bcurtis/FV3_RT/rt_375545
Test fv3_regional_quilt 023 failed in run_test failed
Please make changes and add the following label back:
orion-intel-BL

@junwang-noaa junwang-noaa removed the Waiting for Reviews The PR is waiting for reviews from associated component PR's. label Apr 15, 2021
@BrianCurtis-NOAA
Copy link
Copy Markdown
Collaborator

BrianCurtis-NOAA commented Apr 19, 2021

Baseline Cheyenne-GNU were created successfully. The move failed, but that has been fixed and I will be manually moving the Cheyenne BL's to the correct place and running the RT's on them

@junwang-noaa
Copy link
Copy Markdown
Collaborator Author

CI test passed.

@junwang-noaa junwang-noaa merged commit 4d63a85 into ufs-community:develop Apr 20, 2021
@junwang-noaa junwang-noaa deleted the lampost_ww3test branch November 24, 2021 14:51
pjpegion pushed a commit to NOAA-PSL/ufs-weather-model that referenced this pull request Apr 4, 2023
…ional veg (ufs-community#513)

Updates to allow land perturbation scheme to be applied for Noah-MP.

Main code changes:
-added lsm_noahmp model option to lndp_type==2 land perturbation scheme (fv3-atm, stochastic_physics)
-updated comments
-cleaned up the namelists to make the different options clearer. Removed misleading lndp_each_step variable from gfs_physics_nml, and replaced it with "lndp_model_type" in the nam_sfcperts namelist for the different forecast types (cycling DA, short forecasts, perturbing only initial conditions) (fv3-atm, stochastic_physics, ufs-weather-model)
NOTE: see note below, re: specification of smc perturbation for RAP/HRRR/etc (lndp_model_type==2)
-revised code in stochastic_physics_wrapper to only allocate arrays that will be used when passed into lndp_apply_perts (fv3-atm)
-deleted unused albedo arrays in stochastic_physics_wrapper and lndp_apply_perts (fv3-atm, stochastic_physics)
-fixed bug causing precision errors when calculating the soil moisture ice content (often ~0.0; stochastic_physics)
-fixed bug in which lndp_apply_perts wasn't called for nscyc = 0. (fv3-atm)
-increased max_nvar_lndp at Jeff Ator's request (fv3-atm)
-added a new test for the Noah-MP and lndp==2 combination (ufs-weather-model)
epic-cicd-jenkins pushed a commit that referenced this pull request Apr 17, 2023
Co-authored-by: gspetro <gillian.s.petro@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Baseline Updates Current baselines will be updated. Waiting for Reviews The PR is waiting for reviews from associated component PR's.

Projects

None yet

6 participants