Skip to content

Upload conda and wheel builds to Github Artifact Store #297

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ajschmidt8 merged 29 commits into from
Mar 14, 2025
Merged

Upload conda and wheel builds to Github Artifact Store #297

Show file tree
Hide file tree
Changes from 28 commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
aa1341d
testing github artifact for CPP build
jayavenkatesh19 Feb 3, 2025
08fb696
added artifact location fix
jayavenkatesh19 Feb 3, 2025
eb85805
removed .tar.gz extension
jayavenkatesh19 Feb 5, 2025
c376d5d
added fork of gha-tools
jayavenkatesh19 Feb 6, 2025
4dc10b7
added fork of gha-tools to custom-job
jayavenkatesh19 Feb 6, 2025
26f699a
modified wheel build workflows
jayavenkatesh19 Feb 11, 2025
77ed009
fixed error in shell command
jayavenkatesh19 Feb 11, 2025
aeac41d
Merge branch 'branch-25.04' into test-github-artifacts
jayavenkatesh19 Feb 11, 2025
be7005f
fixed error in conda test workflow
jayavenkatesh19 Feb 11, 2025
91b6da3
Merge branch 'branch-25.04' into test-github-artifacts
jayavenkatesh19 Feb 12, 2025
348d197
update wheel build workflow
jayavenkatesh19 Feb 12, 2025
9d65dd6
update env variable read in build
jayavenkatesh19 Feb 12, 2025
af86791
Merge branch 'branch-25.04' into test-github-artifacts
jayavenkatesh19 Feb 19, 2025
19cb78d
Merge remote-tracking branch 'origin/branch-25.04' into test-github-a…
jayavenkatesh19 Feb 24, 2025
2ca3a33
added support for building multiple wheels in a repo
jayavenkatesh19 Feb 25, 2025
5d4347d
changed path for build wheels
jayavenkatesh19 Feb 26, 2025
9b2987b
changed post-build-checks to download from github
jayavenkatesh19 Feb 26, 2025
be6d008
added gha-tools fork to cpp-post-build checks
jayavenkatesh19 Feb 26, 2025
0d2de56
added GH token to cpp-post-build-checks
jayavenkatesh19 Feb 27, 2025
a60ad1e
created env variables to prevent script injection
jayavenkatesh19 Feb 28, 2025
aa4663a
added tree command to build steps
jayavenkatesh19 Feb 28, 2025
9d45756
Merge branch 'branch-25.04' into test-github-artifacts
jayavenkatesh19 Mar 10, 2025
4ee4874
Merge branch 'branch-25.04' into test-github-artifacts
jayavenkatesh19 Mar 13, 2025
9ca290a
removed gha-tools custom fork and streamlined uploads
jayavenkatesh19 Mar 13, 2025
d990129
removed extra spaces
jayavenkatesh19 Mar 13, 2025
5e059e4
removed unnecessary spaces
jayavenkatesh19 Mar 13, 2025
2ea442a
added wheel outputs
jayavenkatesh19 Mar 13, 2025
ff427c2
added flag to remove .tar.gz extension
jayavenkatesh19 Mar 14, 2025
a4d215a
Apply suggestions from code review
jayavenkatesh19 Mar 14, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 13 additions & 0 deletions .github/workflows/conda-cpp-build.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -121,6 +121,19 @@ jobs:
env:
STEP_NAME: "C++ build"
GH_TOKEN: ${{ github.token }}
- name: Get Package Name and Location
run: |
echo "RAPIDS_PACKAGE_NAME=$(RAPIDS_NO_PKG_EXTENSION=true rapids-package-name conda_cpp)" >> "${GITHUB_OUTPUT}"
echo "CONDA_OUTPUT_DIR=$(echo $RAPIDS_CONDA_BLD_OUTPUT_DIR)" >> "${GITHUB_OUTPUT}"
Comment thread
jayavenkatesh19 marked this conversation as resolved.
Outdated
id: package-name
- name: Show files to be uploaded
run: |
echo "Contents of directory to be uploaded:"
tree -a ${{ steps.package-name.outputs.CONDA_OUTPUT_DIR }}
- uses: actions/upload-artifact@v4
with:
name: ${{ steps.package-name.outputs.RAPIDS_PACKAGE_NAME }}
path: ${{ steps.package-name.outputs.CONDA_OUTPUT_DIR }}
- name: Upload additional artifacts
if: "!cancelled()"
run: rapids-upload-artifacts-dir cuda${RAPIDS_CUDA_VERSION%%.*}_$(arch)
Expand Down
13 changes: 13 additions & 0 deletions .github/workflows/conda-python-build.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -121,6 +121,19 @@ jobs:
run: ${{ inputs.script }}
env:
GH_TOKEN: ${{ github.token }}
- name: Get Package Name and Location
run: |
echo "RAPIDS_PACKAGE_NAME=$(RAPIDS_NO_PKG_EXTENSION=true rapids-package-name conda_python)" >> "${GITHUB_OUTPUT}"
echo "CONDA_OUTPUT_DIR=$(echo $RAPIDS_CONDA_BLD_OUTPUT_DIR)" >> "${GITHUB_OUTPUT}"
Comment thread
jayavenkatesh19 marked this conversation as resolved.
Outdated
id: package-name
- name: Show files to be uploaded
run: |
echo "Contents of directory to be uploaded:"
tree -a ${{ steps.package-name.outputs.CONDA_OUTPUT_DIR }}
- uses: actions/upload-artifact@v4
with:
name: ${{ steps.package-name.outputs.RAPIDS_PACKAGE_NAME }}
path: ${{ steps.package-name.outputs.CONDA_OUTPUT_DIR }}
- name: Upload additional artifacts
if: "!cancelled()"
run: rapids-upload-artifacts-dir cuda${RAPIDS_CUDA_VERSION%%.*}_$(arch)_py${RAPIDS_PY_VERSION//.}
Expand Down
42 changes: 42 additions & 0 deletions .github/workflows/wheels-build.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,16 @@ on:
script:
required: true
type: string
wheel_type:
required: false
type: string
wheel_name:
required: false
type: string
pure_wheel:
required: false
type: boolean
default: false

# allow a bigger runner instance
node_type:
Expand Down Expand Up @@ -173,6 +183,38 @@ jobs:
GH_TOKEN: ${{ github.token }}
# Use a shell that loads the rc file so that we get the compiler settings
shell: bash -leo pipefail {0}

- name: Get package name
if: inputs.wheel_type != ''
env:
WHEEL_TYPE: ${{ inputs.wheel_type }}
WHEEL_NAME: ${{ inputs.wheel_name }}
PURE_WHEEL: ${{ inputs.pure_wheel }}
run: |
if [ -z "${WHEEL_NAME}" ]; then
WHEEL_NAME="${RAPIDS_REPOSITORY#*/}"
fi
export "RAPIDS_PY_CUDA_SUFFIX=$(rapids-wheel-ctk-name-gen ${RAPIDS_CUDA_VERSION})"
export "RAPIDS_PY_WHEEL_NAME=${WHEEL_NAME}_${RAPIDS_PY_CUDA_SUFFIX}"
if [ "${PURE_WHEEL}" = "true" ]; then
export "RAPIDS_PY_WHEEL_PURE=1"
fi
echo "RAPIDS_PACKAGE_NAME=$(RAPIDS_NO_PKG_EXTENSION=true rapids-package-name wheel_${WHEEL_TYPE})" >> "${GITHUB_OUTPUT}"
echo "WHEEL_OUTPUT_DIR=$(echo $RAPIDS_WHEEL_BLD_OUTPUT_DIR)" >> "${GITHUB_OUTPUT}"
Comment thread
jayavenkatesh19 marked this conversation as resolved.
Outdated
id: package-name

- name: Show files to be uploaded
if: inputs.wheel_type != ''
run: |
echo "Contents of directory to be uploaded:"
tree -a ${{ steps.package-name.outputs.WHEEL_OUTPUT_DIR }}

- uses: actions/upload-artifact@v4
if: inputs.wheel_type != ''
with:
name: ${{ steps.package-name.outputs.RAPIDS_PACKAGE_NAME }}
path: ${{ steps.package-name.outputs.WHEEL_OUTPUT_DIR }}

- name: Upload additional artifacts
if: "!cancelled()"
run: rapids-upload-artifacts-dir cuda${RAPIDS_CUDA_VERSION%%.*}_$(arch)_py${RAPIDS_PY_VERSION//.}
Expand Down