Skip to content

Max depth calculation without mpp_global_field#289

Merged
adcroft merged 1 commit into
mom-ocean:dev/masterfrom
marshallward:maxdepth
May 10, 2016
Merged

Max depth calculation without mpp_global_field#289
adcroft merged 1 commit into
mom-ocean:dev/masterfrom
marshallward:maxdepth

Conversation

@marshallward
Copy link
Copy Markdown
Collaborator

The mpp_global_field call in horiz_interp_and_extrap_tracer, used to
calculate the maximum depth (max_depth), caused a model hang on our
system beyond ~4000 CPUs.

This patch calculates max_depth by calculating the local maximum
depth, followed by a mpp_max collective. This avoids the
mpp_global_field requirement.


As best I can tell, checksums were unchanged after this patch for a 10-day OM4_025 job using 960 CPUs. (stdout diffs were identical, aside from timings and some out-of-order initialization)

The `mpp_global_field` call in `horiz_interp_and_extrap_tracer`, used to
calculate the maximum depth (`max_depth`), caused a model hang on our
system beyond ~4000 CPUs.

This patch calculates `max_depth` by calculating the local maximum
depth, followed by a `mpp_max` collective.  This avoids the
`mpp_global_field` requirement.
@adcroft
Copy link
Copy Markdown
Collaborator

adcroft commented May 10, 2016

Crikey! Was there really a global array allocation in there? Nice catch
@marshallward . I'll handle the PR tomorrow ...

Dr Alistair Adcroft (Alistair.Adcroft@noaa.gov)
Princeton University Tel: (609) 987-5073
NOAA/GFDL, 201 Forrestal Road, Princeton, NJ 08540

On Mon, May 9, 2016 at 9:00 PM, Marshall Ward notifications@github.com
wrote:

The mpp_global_field call in horiz_interp_and_extrap_tracer, used to
calculate the maximum depth (max_depth), caused a model hang on our
system beyond ~4000 CPUs.

This patch calculates max_depth by calculating the local maximum
depth, followed by a mpp_max collective. This avoids the

mpp_global_field requirement.

As best I can tell, checksums were unchanged after this patch for a 10-day
OM4_025 job using 960 CPUs. (stdout diffs were identical, aside from

timings and some out-of-order initialization)

You can view, comment on, or merge this pull request online at:

NOAA-GFDL#289
Commit Summary

  • Max depth calculation without mpp_global_field

File Changes

Patch Links:


You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub
NOAA-GFDL#289

@adcroft adcroft merged commit 4af8d24 into mom-ocean:dev/master May 10, 2016
@MJHarrison-GFDL
Copy link
Copy Markdown
Contributor

Thanks Marshall for catching my mistakes!

On Tue, May 10, 2016 at 9:42 AM, Alistair Adcroft notifications@github.com
wrote:

Merged #289 NOAA-GFDL#289.


You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub
NOAA-GFDL#289 (comment)

@marshallward
Copy link
Copy Markdown
Collaborator Author

I think it says more about our computer and what it can (and can't) handle!

BTW, the 7680-core job ran fine as well, and scaling is not terrible either (122 main loop seconds for 10 days on OM4_025)

@marshallward marshallward deleted the maxdepth branch May 10, 2016 19:27
Hallberg-NOAA added a commit to Hallberg-NOAA/MOM6 that referenced this pull request Feb 17, 2023
  Corrected the units in the get_param call for WAVE_HEIGHT_SCALE_FACTOR, as
well as 39 other inconsistent units in comments in 26 files scattered throughout
the MOM6 code.  WAVE_HEIGHT_SCALE_FACTOR was added in December 2022 as a part of
PR mom-ocean#289 to dev/gfdl. These inconsistent units were detected because they do not
match the patterns of other valid units; most are recent additions.  Apart from
a single unit in a get_param call, only comments are changed, and all answers
are bitwise identical.
Hallberg-NOAA added a commit to Hallberg-NOAA/MOM6 that referenced this pull request Feb 17, 2023
  Corrected the units in the get_param call for WAVE_HEIGHT_SCALE_FACTOR, and
corrected the units descriptions in comments of 22 wind stress related variables
in 6 driver routines, from [R L Z T-1 ~> Pa] to [R L Z T-2 ~> Pa], but the
actual conversion factors in the code are correct.  Also fixed 39 other
inconsistent units in comments in 26 files scattered throughout the MOM6 code.
WAVE_HEIGHT_SCALE_FACTOR was added in December 2022 as a part of PR mom-ocean#289 to
dev/gfdl. These inconsistent units were detected because they do not match the
patterns of other valid units; most are recent additions.  Apart from a single
unit in a get_param call, only comments are changed, and all answers are bitwise
identical.
Hallberg-NOAA added a commit to Hallberg-NOAA/MOM6 that referenced this pull request Feb 20, 2023
  Corrected the units in the get_param call for WAVE_HEIGHT_SCALE_FACTOR, and
corrected the units descriptions in comments of 22 wind stress related variables
in 6 driver routines, from [R L Z T-1 ~> Pa] to [R L Z T-2 ~> Pa], but the
actual conversion factors in the code are correct.  Also fixed 42 other
inconsistent units in comments in 28 files scattered throughout the MOM6 code.
WAVE_HEIGHT_SCALE_FACTOR was added in December 2022 as a part of PR mom-ocean#289 to
dev/gfdl. These inconsistent units were detected because they do not match the
patterns of other valid units; most are recent additions.  Apart from a single
unit in a get_param call, only comments are changed, and all answers are bitwise
identical.
marshallward pushed a commit to Hallberg-NOAA/MOM6 that referenced this pull request Mar 2, 2023
  Corrected the units in the get_param call for WAVE_HEIGHT_SCALE_FACTOR, and
corrected the units descriptions in comments of 22 wind stress related variables
in 6 driver routines, from [R L Z T-1 ~> Pa] to [R L Z T-2 ~> Pa], but the
actual conversion factors in the code are correct.  Also fixed 42 other
inconsistent units in comments in 28 files scattered throughout the MOM6 code.
WAVE_HEIGHT_SCALE_FACTOR was added in December 2022 as a part of PR mom-ocean#289 to
dev/gfdl. These inconsistent units were detected because they do not match the
patterns of other valid units; most are recent additions.  Apart from a single
unit in a get_param call, only comments are changed, and all answers are bitwise
identical.
gustavo-marques added a commit to gustavo-marques/MOM6 that referenced this pull request Aug 5, 2024
* Adding Ohlmann solar pentration scheme to MOM_optics

* Fixed some violations of code style guide

* Fixing a few more code style violations

* Fixing yet another code style guide violation

* Cleaned up some coment statements. No changes to code.

* Fixed formatting of string in get_param. Cleaned up extraneous FOB
footprints in comments

* Fix spelling (Ohlman to Ohlmann)

---------

Co-authored-by: Gustavo Marques <gmarques@ucar.edu>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants