Use container with spack stack 1.9.2

[weihuang-jedi]

DESCRIPTION OF CHANGES:

With a new container with spack-stack 1.9.2 inside, update ufs_utils to use this new container.

TESTS CONDUCTED:

If there are changes to the build or source code, the tests below must be conducted. Contact a repository manager if you need assistance.

• Compile branch on AWS and Ursa using container

DEPENDENCIES:

• None

DOCUMENTATION:

• README updated with preliminary cloud information

ISSUE:

• Closes Using spack-stack 1.9.2 in container #1095

CONTRIBUTORS (optional):

EPIC SI team Edward Snyder

[BrianCurtis-NOAA]

@weihuang-jedi Would I be correct that this work is part of EPIC's move to a containerized spack-stack on cloud and RDHPCS?

If so, is this container installed on all RDHPCS, or a subset?

[weihuang-jedi]

@BrianCurtis-NOAA Yes, it is part of EPIC's move to a containerized spack-stack on cloud and RDHPCS.
This container includes: Ubuntu (OS), Intel Compiler, and Spack-stack 1.9.2.
We basically can install/copy this container to any NOAA RDHPCS, but start with AWS, Ursa (and also did some test on GaeaC6). If needed, we can certainly copy to MSU machine as well.
Eventually, we want the broad community to use it to solve the spack-stack install issue for people outside NOAA.

[BrianCurtis-NOAA]

@weihuang-jedi It would be beneficial to have some additions to the documentation on how to run this with the container. @GeorgeGayno-NOAA would this go in the docs/source/ufs_utils.rst location?

[GeorgeGayno-NOAA]

@weihuang-jedi It would be beneficial to have some additions to the documentation on how to run this with the container. @GeorgeGayno-NOAA would this go in the docs/source/ufs_utils.rst location?

The 'readthedocs' does not have a section on building/running, but you can certainly add something to it, or you can add a section to the README.md file.

[weihuang-jedi]

@BrianCurtis-NOAA @GeorgeGayno-NOAA I'll add a section to README.md. Thanks.

[weihuang-jedi]

@BrianCurtis-NOAA and @GeorgeGayno-NOAA
I have added a paragraph to README.md about how to compile ufs_utils on Ursa and AWS.
Please check and see.
Sorry to make it so long, as we need to figure a way to put the container SIF to a common place on Ursa.
Thanks,
Wei

[weihuang-jedi]

@BrianCurtis-NOAA and @GeorgeGayno-NOAA,
Could you please review and see if there is more to update?
Thanks,
Wei

[BrianCurtis-NOAA]

Hi @weihuang-jedi I would like to eventually make it such that we are running routine PR testing on the cloud (automated). I am not sure this work was intended for anything like this yet. Ideally for this PR I wanted to try running it once myself, but I note in your README that the batch jobs are unsupported.

You're one commit behind the top of the develop branch currently, so if you can bump to the latest hash and possible run the reg-tests in the cloud to verify all is still OK, that will be sufficient to proceed to merge.

[weihuang-jedi]

@BrianCurtis-NOAA
I have updated the my branch.
If you can give some basic intro of running reg_test,
I'll try on Could and report back.
Thanks,
Wei

[BrianCurtis-NOAA]

You will want to edit: https://github.com/NOAA-EPIC/UFS_UTILS-cloud/blob/1b7c9820f5fec050bc770dba34f35cea7634bbed/reg_tests/rt.sh#L22-L29
and: https://github.com/NOAA-EPIC/UFS_UTILS-cloud/blob/1b7c9820f5fec050bc770dba34f35cea7634bbed/reg_tests/rt.sh#L36

then just run rt.sh.

There may be some slight changes for cloud, too.

If this proves to be too difficult, that's OK, this code doesn't touch anything I'd need to run testing on outside of the cloud.

[weihuang-jedi]

@BrianCurtis-NOAA
There is an issue for me to run rt.sh, as it check out the develop branch, and did use my own branch, so the compile failed.
I can update rt.sh for future test. Do you want me do that?
Thanks,
Wei

[BrianCurtis-NOAA]

@weihuang-jedi No need. Let's try to get UFS_UTILS running its reg-tests in a container for another future PR.

Since you bumped the hash did you want to run any further testing before merging?

[weihuang-jedi]

I do not have further test to run on container.
Will certainly work with you for further test on cloud and with container.
Thanks,