Ensure proper stack size setting on Orion

[GeorgeGayno-NOAA]

DESCRIPTION OF CHANGES:

Remove any setting of stack size in the Orion regression test scripts, which can
cause script crashes. Instead, users (including the role account) will be required to
set a proper stack size in their environment

TESTS CONDUCTED:

• Run all consistency tests on Orion using both the role account and personal account (George). Done using 88cd6c0.
• Run all consistency tests on Orion using both the role account and personal account (Brian)

Describe any additional tests performed.

DEPENDENCIES:

None.

DOCUMENTATION:

N/A

ISSUE:

Fixes #1079.

[BrianCurtis-NOAA]

I'm timing out on my personal account. Looking into it.

[GeorgeGayno-NOAA]

When trying to run the rt.sh script under my own account from the cron, I was getting seg faults. I had to adjust my crontab to set the stack size. The crontab apparently does not run my .bashrc file. Here is what I did:

13 09 * * * ulimit -S -s unlimited; /bin/bash -l /work/noaa/da/ggayno/save/ufs_utils.git/UFS_UTILS/reg_tests/rt.sh > /home/ggayno/reg.log 2>&1

[BrianCurtis-NOAA]

When trying to run the rt.sh script under my own account from the cron, I was getting seg faults. I had to adjust my crontab to set the stack size. The crontab apparently does not run my .bashrc file. Here is what I did:

13 09 * * * ulimit -S -s unlimited; /bin/bash -l /work/noaa/da/ggayno/save/ufs_utils.git/UFS_UTILS/reg_tests/rt.sh > /home/ggayno/reg.log 2>&1

if you change https://github.com/GeorgeGayno-NOAA/UFS_UTILS/blob/9c21f89b7865716403d24abf360eb2e49d4c474b/reg_tests/rt.sh#L1 to #!/bin/bash -l that might help use the .bashrc file from the user.

[BrianCurtis-NOAA]

Started on  orion-login-2
Commit hash: 9c21f89b7865716403d24abf360eb2e49d4c474b

regrid_sfc consistency tests PASSED
weight_gen consistency tests PASSED
ocnice_prep consistency tests PASSED
cpld_gridgen consistency tests PASSED
chgres_cube consistency tests PASSED
grid_gen consistency tests PASSED
global_cycle consistency tests PASSED
ice_blend consistency tests PASSED
snow2mdl consistency tests PASSED

[BrianCurtis-NOAA]

My role-nems run was already posted here: #1079 (comment)

[GeorgeGayno-NOAA]

Using 9c21f89, I was able to run all tests (under my personal account) using rt.sh from the cron using this command:

13 09 * * * ulimit -S -s unlimited; /bin/bash -l /work/noaa/da/ggayno/save/ufs_utils.git/UFS_UTILS/reg_tests/rt.sh > /home/ggayno/reg.log 2>&1

and got the following email:

Started on  orion-login-1
Commit hash: 9c21f89b7865716403d24abf360eb2e49d4c474b

regrid_sfc consistency tests PASSED
weight_gen consistency tests PASSED
ocnice_prep consistency tests PASSED
cpld_gridgen consistency tests PASSED
chgres_cube consistency tests PASSED
grid_gen consistency tests PASSED
global_cycle consistency tests PASSED
ice_blend consistency tests PASSED
snow2mdl consistency tests PASSED

[GeorgeGayno-NOAA]

Using 9c21f89, I was able to run all tests (under my personal account) using rt.sh from the cron using this command:

13 09 * * * ulimit -S -s unlimited; /bin/bash -l /work/noaa/da/ggayno/save/ufs_utils.git/UFS_UTILS/reg_tests/rt.sh > /home/ggayno/reg.log 2>&1

and got the following email:

Started on  orion-login-1
Commit hash: 9c21f89b7865716403d24abf360eb2e49d4c474b

regrid_sfc consistency tests PASSED
weight_gen consistency tests PASSED
ocnice_prep consistency tests PASSED
cpld_gridgen consistency tests PASSED
chgres_cube consistency tests PASSED
grid_gen consistency tests PASSED
global_cycle consistency tests PASSED
ice_blend consistency tests PASSED
snow2mdl consistency tests PASSED

I repeated the test, but logged in as role-nems. All tests passed.

[GeorgeGayno-NOAA]

@BrianCurtis-NOAA - let's merge #1076 first. This is low priority.

[BrianCurtis-NOAA]

@GeorgeGayno-NOAA I think our testing on the previous PR has concluded. Did we want to merge this one?

[GeorgeGayno-NOAA]

@GeorgeGayno-NOAA I think our testing on the previous PR has concluded. Did we want to merge this one?

We can merge this one next. Let me pull the latest updates from 'develop' to my branch and do a quick retest.

[GeorgeGayno-NOAA]

Retested my branch on Orion after the merge from 'develop' (88cd6c0). All tests passed under my account and the role account.

@BrianCurtis-NOAA - go ahead and merge this.

[GeorgeGayno-NOAA]

Oh, since the rt.sh script was updated for Orion. I would have the role account on that machine point to the head of 'develop'.