Skip to content

Move IO related configuration from fv3_cap to write grid component#600

Merged
DusanJovic-NOAA merged 23 commits into
ufs-community:developfrom
DusanJovic-NOAA:nuopc_labels
Jun 8, 2021
Merged

Move IO related configuration from fv3_cap to write grid component#600
DusanJovic-NOAA merged 23 commits into
ufs-community:developfrom
DusanJovic-NOAA:nuopc_labels

Conversation

@DusanJovic-NOAA
Copy link
Copy Markdown
Collaborator

@DusanJovic-NOAA DusanJovic-NOAA commented May 25, 2021

PR Checklist

  • Ths PR is up-to-date with the top of all sub-component repositories except for those sub-components which are the subject of this PR. Please consult the ufs-weather-model wiki if you are unsure how to do this.

  • This PR has been tested using a branch which is up-to-date with the top of all sub-component repositories except for those sub-components which are the subject of this PR

  • An Issue describing the work contained in this PR has been created either in the subcomponent(s) or in the ufs-weather-model. The Issue should be created in the repository that is most relevant to the changes in contained in the PR. The Issue and the dependent sub-component PR
    are specified below.

  • If new or updated input data is required by this PR, it is clearly stated in the text of the PR.

Instructions: All subsequent sections of text should be filled in as appropriate.

The information provided below allows the code managers to understand the changes relevant to this PR, whether those changes are in the ufs-weather-model repository or in a subcomponent repository. Ufs-weather-model code managers will use the information provided to add any applicable labels, assign reviewers and place it in the Commit Queue. Once the PR is in the Commit Queue, it is the PR owner's responsiblity to keep the PR up-to-date with the develop branch of ufs-weather-model.

Description

Update fv3_cap's SetServices to use ONLY the semantic labels for each of the phases
Move IO related configuration from fv3_cap to write grid component
Code cleanup.

Is a change of answers expected from this PR? No.
Are any library updates included in this PR (modulefiles etc.)? No.

Testing

How were these changes tested? What compilers / HPCs was it tested with? Are the changes covered by regression tests? (If not, why? Do new tests need to be added?) Have regression tests and unit tests (utests) been run? On which platforms and with which compilers? (Note that unit tests can only be run on tier-1 platforms)

  • hera.intel
  • hera.gnu
  • orion.intel
  • cheyenne.intel
  • cheyenne.gnu
  • gaea.intel
  • jet.intel - down for maintenance
  • wcoss_cray
  • wcoss_dell_p3

Dependencies

If testing this branch requires non-default branches in other repositories, list them. Those branches should have matching names (ideally).

Do PRs in upstream repositories need to be merged first?
If so add the "waiting for other repos" label and list the upstream PRs

@DusanJovic-NOAA
Copy link
Copy Markdown
Collaborator Author

@rsdunlapiv I had to revert one commit (using semantic labels in fv3_cap) from this PR because cpld tests failed using GNU compilers on Hera and Cheyenne. We need to find out why.

@BrianCurtis-NOAA
Copy link
Copy Markdown
Collaborator

Machine: cheyenne
Compiler: intel
Job: RT
Repo location: /glade/scratch/dtcufsrt/autort/tests/auto/pr/652803767/20210608113008/ufs-weather-model
Please manually delete: /glade/scratch/dtcufsrt/FV3_RT/rt_32527
Test fv3_rrfs_v1alpha_debug 070 failed in run_test failed
Test control_flake 031 failed in run_test failed
Test cpld_restart_c384 008 failed in run_test failed
Test cpld_restart_bmark_v16 010 failed in run_test failed
Please make changes and add the following label back:
cheyenne-intel-RT

@BrianCurtis-NOAA
Copy link
Copy Markdown
Collaborator

Machine: gaea
Compiler: intel
Job: RT
Repo location: /lustre/f2/pdata/ncep/emc.nemspara/autort/pr/652803767/20210608173013/ufs-weather-model
Please manually delete: /lustre/f2/scratch/emc.nemspara/FV3_RT/rt_27076
Test control_wrtGauss_netcdf_parallel 021 failed in run_test failed
Please make changes and add the following label back:
gaea-intel-RT

@DusanJovic-NOAA
Copy link
Copy Markdown
Collaborator Author

Machine: gaea
Compiler: intel
Job: RT
Repo location: /lustre/f2/pdata/ncep/emc.nemspara/autort/pr/652803767/20210608173013/ufs-weather-model
Please manually delete: /lustre/f2/scratch/emc.nemspara/FV3_RT/rt_27076
Test control_wrtGauss_netcdf_parallel 021 failed in run_test failed
Please make changes and add the following label back:
gaea-intel-RT

$ tail /lustre/f2/scratch/emc.nemspara/FV3_RT/rt_27076/control_wrtGauss_netcdf_parallel/err
 MXFLD is:          999
 size of lvlsxml:       150000
 size of post_avblflds param         104
 in readxml. nfld=         104 nrecout=         113
 post_fname=GFSFLX.GrbF05
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 268826806.0 ON nid01111 CANCELLED AT 2021-06-08T18:01:46 DUE TO TIME LIMIT ***
slurmstepd: error: *** JOB 268826806 ON nid01111 CANCELLED AT 2021-06-08T18:01:46 DUE TO TIME LIMIT ***
srun: got SIGCONT
srun: forcing job termination

All tests except this one finished successfully. Since gaea.intel tests already passed in the previous commit, I'm not going to rerun this again.

@DusanJovic-NOAA DusanJovic-NOAA requested a review from climbfuji June 8, 2021 20:13
@DusanJovic-NOAA
Copy link
Copy Markdown
Collaborator Author

Ready for review/merge.

@DusanJovic-NOAA DusanJovic-NOAA merged commit 9aebf1a into ufs-community:develop Jun 8, 2021
@DusanJovic-NOAA DusanJovic-NOAA deleted the nuopc_labels branch July 16, 2021 17:36
mdtoyNOAA added a commit to mdtoyNOAA/ufs-weather-model that referenced this pull request Dec 22, 2022
pjpegion pushed a commit to NOAA-PSL/ufs-weather-model that referenced this pull request Apr 4, 2023
* Enhanced stability of drag_suite module and added diagnostics

* Updated standard_names for do_gsl_drag_ls_bl, do_gsl_drag_ss, do_gsl_drag_tofd and ugwp_seq_update

* Assumed-shape in gwdps.f

* Added logical flag 'ugwp_seq_update' to gfs_physics_nml namelist

* Modified calculation of dtfac in drag_suite.F90 and revised various long_name's of diagnostic variables

* Removed passage of variables 'ak' and 'bk' to drag_suite -- these are no longer used

* Removed unused variables from GFS_typedefs.F90 and added clarifying comments in ccpp-physics
epic-cicd-jenkins pushed a commit that referenced this pull request Apr 17, 2023
…provements (#600)

This is another round of improvements for the pythonized WE2E test scripts. I was originally going to wait until the script was ready to replace, but I accidentally forgot to make a change to a final log message in monitor_jobs.py; this results in a scary-looking error message even though all experiments may have completed successfully.

The solution was simply to replace the undefined variable with a correct one.

This PR comes from an in-progress branch for improvements to the python scripts, so a few other improvements are coming along with this bug fix:

* When monitor_jobs.py is called for the first time, it will check the status of all jobs, not just those that are incomplete. 
 This will allow users to use this script to monitor a previously failed job that has been fixed.
* Add checks for proper run_envir, and add all needed variables for run_envir=nco mode.
* Fix another incorrect error message in setup.py.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

No Baseline Change No Baseline Change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants