Skip to content

Fix: Workflow maintaing conda environment #60

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
oelbert merged 2 commits into from
Sep 15, 2025
Merged

Fix: Workflow maintaing conda environment #60

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
4e9c84e
Fixes to maintain conda environment
fmalatino Sep 11, 2025
0901488
Removing shell specification for orchestrated tests in github workflow
fmalatino Sep 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 3 additions & 11 deletions .github/workflows/translate.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,9 @@ concurrency:
jobs:
pyshield_translate_tests:
runs-on: ubuntu-latest
defaults:
run:
shell: bash -el {0}
env:
TEST_DATA_PATH: "./test_data/8.1.3/c12_6ranks_baroclinic/physics"
TEST_DATA_URL: "https://portal.nccs.nasa.gov/datashare/astg/smt/pace-regression-data/8.1.3_c12_6ranks_baroclinic.physics.tar.gz"
Expand All @@ -49,11 +52,9 @@ jobs:
activate-environment: pyshield_test_env

- name: Install mpi (MPICH flavor)
shell: bash -l {0}
run: pip install mpich

- name: External trigger remove existing component in pySHiELD/develop
shell: bash -l {0}
if: ${{ inputs.component_trigger }}
run: rm -rf ${GITHUB_WORKSPACE}/pySHiELD/${{inputs.component_name}}

Expand All @@ -64,36 +65,30 @@ jobs:
path: pySHiELD/${{inputs.component_name}}

- name: external trigger Install packages for FV3 component
shell: bash -l {0}
if: ${{contains(inputs.component_name, 'FV3')}}
run: |
cd ${GITHUB_WORKSPACE}/pySHiELD
pip3 install --upgrade pip setuptools wheel
cd ${{inputs.component_name}} && pip3 install .[test] && cd ..
pip3 install .[ndsl,test]
pip install numpy==1.26.4
conda remove sqlite

- name: external trigger Install packages for NDSL component
shell: bash -l {0}
if: ${{contains(inputs.component_name, 'NDSL')}}
run: |
cd ${GITHUB_WORKSPACE}/pySHiELD
pip3 install --upgrade pip setuptools wheel
cd ${{inputs.component_name}} && pip3 install .[test] && cd ..
pip3 install .[pyfv3,test]
pip install numpy==1.26.4
conda remove sqlite

- name: Install pySHiELD packages
shell: bash -l {0}
if: ${{ !inputs.component_trigger}}
run: |
cd ${GITHUB_WORKSPACE}/pySHiELD
pip install --upgrade pip setuptools wheel
pip install .[ndsl,pyfv3,test]
pip install numpy==1.26.4
conda remove sqlite

# Only restore (don't save) caches on PRs. New caches created from PRs won't be
# accessible from other PRs, see workflows/create_cache.yaml.
Expand All @@ -106,14 +101,12 @@ jobs:

- name: Download data (if not cached)
if: steps.cache-restore.outputs.cache-hit != 'true'
shell: bash -l {0}
run: |
mkdir -p pySHiELD/test_data && cd pySHiELD/test_data
wget ${{ env.TEST_DATA_URL }}
tar -xzvf 8.1.3_c12_6ranks_baroclinic.physics.tar.gz

- name: Numpy Translate Test
shell: bash -l {0}
run: |
cd ${GITHUB_WORKSPACE}/pySHiELD
pytest \
Expand All @@ -123,7 +116,6 @@ jobs:
./tests/savepoint

- name: Orchestrated dace:cpu Translate Test
shell: bash -l {0}
run: |
cd ${GITHUB_WORKSPACE}/pySHiELD
export FV3_DACEMODE=BuildAndRun
Expand Down
Loading