Skip to content

Add ulimit to the task scripts for Orion#626

Merged
JeffBeck-NOAA merged 4 commits into
ufs-community:developfrom
chan-hoo:feature/orion_make_grid
Nov 11, 2021
Merged

Add ulimit to the task scripts for Orion#626
JeffBeck-NOAA merged 4 commits into
ufs-community:developfrom
chan-hoo:feature/orion_make_grid

Conversation

@chan-hoo
Copy link
Copy Markdown
Collaborator

@chan-hoo chan-hoo commented Nov 8, 2021

DESCRIPTION OF CHANGES:

To resolve the memory issue, 'ulimit' is added to the 'make_grid', 'make_ics', and 'run_post' scripts for Orion.

TESTS CONDUCTED:

WE2E tests on Orion and Hera:

  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2
  • grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2
  • grid_RRFS_CONUS_3km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2
  • grid_RRFS_NA_3km_ics_FV3GFS_lbcs_FV3GFS_suite_RRFS_v1alpha

ISSUE:

Fixes issue mentioned in #625

"HERA")
ulimit -s unlimited
ulimit -a
APRUN="time"
Copy link
Copy Markdown
Collaborator

@JeffBeck-NOAA JeffBeck-NOAA Nov 11, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@chan-hoo, did you mean to add these to the Hera block too? I see you tested on Hera, but just wanted to make sure. The title and description of changes for the PR doesn't mention Hera. You can change that if it's appropriate.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also, I see you said this change was necessary to resolve a memory limit. I've never run into a memory limit error on Orion or Hera using the domains you tested. Is this a relatively recent error that you didn't have before? Do you think Jet needs a "ulimit -s unlimited" line as well?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@JeffBeck-NOAA, I didn't have any issues on Hera. I'll remove this change for Hera. Regarding Orion, yes, I didn't have this error a couple of months ago either, but I got this when I tested the 3km domains on Orion last week. I don't think Jet needs this change.

"HERA")
ulimit -s unlimited
ulimit -a
APRUN="time"
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also, I see you said this change was necessary to resolve a memory limit. I've never run into a memory limit error on Orion or Hera using the domains you tested. Is this a relatively recent error that you didn't have before? Do you think Jet needs a "ulimit -s unlimited" line as well?

@@ -105,6 +105,7 @@ case "$MACHINE" in

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No "ulimit -a" line necessary for the Hera block here?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hera doesn't need this change at this moment.

@@ -125,6 +125,8 @@ case "$MACHINE" in
;;
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No modifications required to Hera here?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not for Hera.

@JeffBeck-NOAA JeffBeck-NOAA merged commit 4e4d2cd into ufs-community:develop Nov 11, 2021
@chan-hoo chan-hoo deleted the feature/orion_make_grid branch November 11, 2021 18:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants