Skip to content

Update Orion modulefile to use new python venv#6

Merged
CoryMartin-NOAA merged 1 commit into
developfrom
feature/new_orion_modules
Mar 23, 2022
Merged

Update Orion modulefile to use new python venv#6
CoryMartin-NOAA merged 1 commit into
developfrom
feature/new_orion_modules

Conversation

@CoryMartin-NOAA

@CoryMartin-NOAA CoryMartin-NOAA commented Mar 21, 2022

Copy link
Copy Markdown
Contributor

Update the Orion modulefile to 1) load each library/module explicitly rather than the JEDI metamodule and 2) load a GDASApp python virtual environment.

A later PR will do the same for Hera once I have set up the venv there.

@guillaumevernieres please ensure when these modules are loaded that soca r2d2 scripts work as intended. I think the correct commits were checked out by pip when the env was installed.

@CoryMartin-NOAA CoryMartin-NOAA self-assigned this Mar 21, 2022
aerorahul
aerorahul reviewed Mar 21, 2022
View reviewed changes
Comment thread modulefiles/GDAS/orion.lua
load("atlas/ecmwf-0.24.1")

load("hpc")
load("miniconda3")

@aerorahul aerorahul Mar 21, 2022

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Think this should be hpc-miniconda3/4.6.14

guillaumevernieres
guillaumevernieres approved these changes Mar 21, 2022
View reviewed changes

@guillaumevernieres guillaumevernieres left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tested the the r2d2 install with soca, seems fine.

@CoryMartin-NOAA CoryMartin-NOAA added the orion-RT Queue for automated testing on Orion label Mar 22, 2022
CoryMartin-NOAA
CoryMartin-NOAA commented Mar 22, 2022
View reviewed changes

@CoryMartin-NOAA CoryMartin-NOAA left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a test adding a comment from Orion using GitHub CLI tools

@emcbot

emcbot commented Mar 22, 2022

Copy link
Copy Markdown

Test from bot

@emcbot

emcbot commented Mar 22, 2022

Copy link
Copy Markdown

Automated orion Pull Request Testing Results:

Start: Tue Mar 22 13:15:12 CDT 2022 on Orion-login-1.HPC.MsState.Edu
Build:             *SUCCESS*
Build: Completed at Tue Mar 22 14:08:27 CDT 2022
---------------------------------
ctest: error while loading shared libraries: libimf.so: cannot open shared object file: No such file or directory

@emcbot emcbot added orion-RT-Running Automated testing running on Orion and removed orion-RT Queue for automated testing on Orion labels Mar 22, 2022
@CoryMartin-NOAA CoryMartin-NOAA mentioned this pull request Mar 22, 2022
Merged
@CoryMartin-NOAA CoryMartin-NOAA removed the orion-RT-Running Automated testing running on Orion label Mar 22, 2022
@CoryMartin-NOAA CoryMartin-NOAA merged commit 9ceef17 into develop Mar 23, 2022
@CoryMartin-NOAA CoryMartin-NOAA deleted the feature/new_orion_modules branch March 23, 2022 15:20
guillaumevernieres added a commit that referenced this pull request May 23, 2024
@guillaumevernieres
Optionally run specified rocoto task as part of the ctests (#1121)
af7fb73 
Only tested with the coupled UFS and the marine DA tasks:
```
Test project /scratch1/NCEPDEV/stmp2/Guillaume.Vernieres/runs/prs/global-workflow/sorc/gdas.cd/build/gdas/test/gw-ci
  Test  #1: C48mx500_3DVarAOWCDA
  Test  #2: C96_atmaerosnowDA
  Test  #3: C96C48_ufs_hybatmDA
  Test  #4: C48mx500_3DVarAOWCDA_gdasfcst_202103241200
  Test  #5: C48mx500_3DVarAOWCDA_gdasprepoceanobs_202103241800
  Test  #6: C48mx500_3DVarAOWCDA_gdasocnanalprep_202103241800
  Test  #7: C48mx500_3DVarAOWCDA_gdasocnanalbmat_202103241800
  Test  #8: C48mx500_3DVarAOWCDA_gdasocnanalrun_202103241800
  Test  #9: C48mx500_3DVarAOWCDA_gdasocnanalchkpt_202103241800
  Test #10: C48mx500_3DVarAOWCDA_gdasocnanalpost_202103241800

Total Tests: 10
```
guillaumevernieres added a commit that referenced this pull request May 28, 2024
@guillaumevernieres @CoryMartin-NOAA
Addin a GFSv17 ctest (#1130)
4598d91 
**What was done:**
- reorganization/code tidy to facilitate the addition of a GFSv17
prototype ctest
- exclude the new ctest by default, the user will have to run ```cmake
-DRUNGWCI=ON .``` on an old build to configure the new ctest

He're the current list:

```
 Test project /scratch1/NCEPDEV/stmp2/Guillaume.Vernieres/runs/prs/global-workflow/sorc/gdas.cd/build/gdas/test/gw-ci
  Test  #1: WCDA-3DVAR-C48mx500
  Test  #2: WCDA-3DVAR-C48mx500_gdasfcst_202103241200
  Test  #3: WCDA-3DVAR-C48mx500_gdasprepoceanobs_202103241800
  Test  #4: WCDA-3DVAR-C48mx500_gdasocnanalprep_202103241800
  Test  #5: WCDA-3DVAR-C48mx500_gdasocnanalbmat_202103241800
  Test  #6: WCDA-3DVAR-C48mx500_gdasocnanalrun_202103241800
  Test  #7: WCDA-3DVAR-C48mx500_gdasocnanalchkpt_202103241800
  Test  #8: WCDA-3DVAR-C48mx500_gdasocnanalpost_202103241800
  Test  #9: Aero-Snow-3DVAR-C96
  Test #10: Aero-Snow-3DVAR-C96_gdasfcst_202112201200
  Test #11: Atm-hyb-C96C48
  Test #12: Atm-hyb-C96C48_gdasfcst_202402231800
  Test #13: GFSv17-3DVAR-C384mx025
  Test #14: GFSv17-3DVAR-C384mx025_gdasfcst_202106300000
  Test #15: GFSv17-3DVAR-C384mx025_gdasprepoceanobs_202106300600
  Test #16: GFSv17-3DVAR-C384mx025_gdasocnanalprep_202106300600
  Test #17: GFSv17-3DVAR-C384mx025_gdasocnanalbmat_202106300600
  Test #18: GFSv17-3DVAR-C384mx025_gdasocnanalrun_202106300600
  Test #19: GFSv17-3DVAR-C384mx025_gdasocnanalchkpt_202106300600
  Test #20: GFSv17-3DVAR-C384mx025_gdasocnanalpost_202106300600
  Test #21: GFSv17-3DVAR-C384mx025_gdasocnanalvrfy_202106300600
  Test #22: GFSv17-3DVAR-C384mx025_gdasprep_202106300600
  Test #23: GFSv17-3DVAR-C384mx025_gdasanal_202106300600

Total Tests: 23
```

---------

Co-authored-by: Cory Martin <cory.r.martin@noaa.gov>
DavidNew-NOAA pushed a commit that referenced this pull request Jan 6, 2026
@RussTreadon-NOAA @danholdaway
Yaml updates for use with updated GDASApp submodules (#8)
a8aee98 
GDASApp PR [#1123](#1123)
updates the hashes for select JEDI repositories. The updated hashes
require yaml updates.
 - add `static` keyword to `gsi covariance`
 - update names used for radiance bias correction terms
 
Resolves #6

Co-authored-by: Dan Holdaway <27729500+danholdaway@users.noreply.github.com>
DavidNew-NOAA pushed a commit that referenced this pull request Jan 16, 2026
@CoryMartin-NOAA
Use new python env on orion (#6)
9f09107
DavidNew-NOAA pushed a commit that referenced this pull request Jan 16, 2026
@guillaumevernieres
Optionally run specified rocoto task as part of the ctests (#1121)
e2312c2 
Only tested with the coupled UFS and the marine DA tasks:
```
Test project /scratch1/NCEPDEV/stmp2/Guillaume.Vernieres/runs/prs/global-workflow/sorc/gdas.cd/build/gdas/test/gw-ci
  Test  #1: C48mx500_3DVarAOWCDA
  Test  #2: C96_atmaerosnowDA
  Test  #3: C96C48_ufs_hybatmDA
  Test  #4: C48mx500_3DVarAOWCDA_gdasfcst_202103241200
  Test  #5: C48mx500_3DVarAOWCDA_gdasprepoceanobs_202103241800
  Test  #6: C48mx500_3DVarAOWCDA_gdasocnanalprep_202103241800
  Test  #7: C48mx500_3DVarAOWCDA_gdasocnanalbmat_202103241800
  Test  #8: C48mx500_3DVarAOWCDA_gdasocnanalrun_202103241800
  Test  #9: C48mx500_3DVarAOWCDA_gdasocnanalchkpt_202103241800
  Test #10: C48mx500_3DVarAOWCDA_gdasocnanalpost_202103241800

Total Tests: 10
```
DavidNew-NOAA pushed a commit that referenced this pull request Jan 16, 2026
@guillaumevernieres @CoryMartin-NOAA
Addin a GFSv17 ctest (#1130)
44a870c 
**What was done:**
- reorganization/code tidy to facilitate the addition of a GFSv17
prototype ctest
- exclude the new ctest by default, the user will have to run ```cmake
-DRUNGWCI=ON .``` on an old build to configure the new ctest

He're the current list:

```
 Test project /scratch1/NCEPDEV/stmp2/Guillaume.Vernieres/runs/prs/global-workflow/sorc/gdas.cd/build/gdas/test/gw-ci
  Test  #1: WCDA-3DVAR-C48mx500
  Test  #2: WCDA-3DVAR-C48mx500_gdasfcst_202103241200
  Test  #3: WCDA-3DVAR-C48mx500_gdasprepoceanobs_202103241800
  Test  #4: WCDA-3DVAR-C48mx500_gdasocnanalprep_202103241800
  Test  #5: WCDA-3DVAR-C48mx500_gdasocnanalbmat_202103241800
  Test  #6: WCDA-3DVAR-C48mx500_gdasocnanalrun_202103241800
  Test  #7: WCDA-3DVAR-C48mx500_gdasocnanalchkpt_202103241800
  Test  #8: WCDA-3DVAR-C48mx500_gdasocnanalpost_202103241800
  Test  #9: Aero-Snow-3DVAR-C96
  Test #10: Aero-Snow-3DVAR-C96_gdasfcst_202112201200
  Test #11: Atm-hyb-C96C48
  Test #12: Atm-hyb-C96C48_gdasfcst_202402231800
  Test #13: GFSv17-3DVAR-C384mx025
  Test #14: GFSv17-3DVAR-C384mx025_gdasfcst_202106300000
  Test #15: GFSv17-3DVAR-C384mx025_gdasprepoceanobs_202106300600
  Test #16: GFSv17-3DVAR-C384mx025_gdasocnanalprep_202106300600
  Test #17: GFSv17-3DVAR-C384mx025_gdasocnanalbmat_202106300600
  Test #18: GFSv17-3DVAR-C384mx025_gdasocnanalrun_202106300600
  Test #19: GFSv17-3DVAR-C384mx025_gdasocnanalchkpt_202106300600
  Test #20: GFSv17-3DVAR-C384mx025_gdasocnanalpost_202106300600
  Test #21: GFSv17-3DVAR-C384mx025_gdasocnanalvrfy_202106300600
  Test #22: GFSv17-3DVAR-C384mx025_gdasprep_202106300600
  Test #23: GFSv17-3DVAR-C384mx025_gdasanal_202106300600

Total Tests: 23
```

---------

Co-authored-by: Cory Martin <cory.r.martin@noaa.gov>
RussTreadon-NOAA added a commit that referenced this pull request Jan 16, 2026
@RussTreadon-NOAA @danholdaway
Yaml updates for use with updated GDASApp submodules (#8)
0d66231 
GDASApp PR [#1123](#1123)
updates the hashes for select JEDI repositories. The updated hashes
require yaml updates.
 - add `static` keyword to `gsi covariance`
 - update names used for radiance bias correction terms
 
Resolves #6

Co-authored-by: Dan Holdaway <27729500+danholdaway@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@aerorahul aerorahul aerorahul left review comments

@guillaumevernieres guillaumevernieres guillaumevernieres approved these changes

@RussTreadon-NOAA RussTreadon-NOAA Awaiting requested review from RussTreadon-NOAA

Assignees

@CoryMartin-NOAA CoryMartin-NOAA

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@CoryMartin-NOAA @emcbot @aerorahul @guillaumevernieres