introduce libraft wheels by jameslamb · Pull Request #2531 · NVIDIA/raft

jameslamb · 2024-12-17T16:15:02Z

Replaces #2306, contributes to rapidsai/build-planning#33.

Proposes packaging libraft as a wheel, which is then re-used by:

pylibraft-cu{11,12} and raft-cu{11,12} (this PR)
libcugraph-cu{11,12}, pylibcugraph-cu{11,12}, and cugraph-cu{11,12} in introduce libcugraph wheels rapidsai/cugraph#4804
libcuml-cu{11,12} and cuml-cu{11,12} in introduce libcuml wheels rapidsai/cuml#6199

As part of this, also proposes:

introducing a new CMake option, RAFT_COMPILE_DYNAMIC_ONLY, to allow building/installing only the dynamic shared library (i.e. skipping the static library)
enforcing rapids-cmake's preferred CMake style (introduce libraft wheels #2531 (comment))
making wheel-building CI jobs always depend on other wheel-building CI jobs, not tests or *-publish (to reduce end-to-end CI time)

Notes for Reviewers

Benefits of these changes

smaller wheels (see "Size Changes" below)
faster compile times (no more re-compiling RAFT in cuGraph and cuML CI)
other benefits mentioned in Support dynamic linking between RAPIDS wheels rapidsai/build-planning#33

Wheel contents

libraft:

libraft.so (shared library)
RAFT headers
vendored dependencies (fmt, CCCL, cuco, cute, cutlass)

pylibraft:

pylibraft Python / Cython code and compiled Cython extensions

raft-dask:

raft-dask Python / Cython code and compiled Cython extension

Dependency Flows

In short.... libraft contains a libraft.so dynamic library and the headers to link against it.

Anything that needs to link against RAFT at build time pulls in libraft wheels as a build dependency.
Anything that needs RAFT's symbols at runtime pulls it in as a runtime dependency, and calls libraft.load_library().

For more details and some flowcharts, see rapidsai/build-planning#33 (comment)

Size changes (CUDA 12, Python 3.12, x86_64)

wheel	num files (before)	num files (these PRs)	size (before)	size (these PRs)
`libraft`.	---	3169	---	19M
`pylibraft`	64	63	11M	1M
`raft-dask`	29	28	188M	188M
`libcugraph`	---	1762	---	903M
`pylibcugraph`	190	187	901M	2M
`cugraph`	315	313	899M	3.0M
`libcuml`	---	1766	---	289M
`cuml`	442	---	517M	---
TOTAL	1,040	7,268	2,516M	1,405M

NOTES: size = compressed, "before" = 2025-01-13 nightlies

how I calculated those (click me)

cugraph: nightly commit = rapidsai/cugraph@8507cbf, PR = introduce libcugraph wheels rapidsai/cugraph#4804
cuml: nightly commit = rapidsai/cuml@7c715c4, PR = introduce libcuml wheels rapidsai/cuml#6199
raft: nightly commit = 1b62c41, PR = this PR

docker run \
    --rm \
    --network host \
    --env RAPIDS_NIGHTLY_DATE=2025-01-13 \
    --env CUGRAPH_NIGHTLY_SHA=8507cbf63db2f349136b266d3e6e787b189f45a0 \
    --env CUGRAPH_PR="pull-request/4804" \
    --env CUGRAPH_PR_SHA="2ef32eaa006a84c0bd16220bb8e8af34198fbee8" \
    --env CUML_NIGHTLY_SHA=7c715c494dff71274d0fdec774bdee12a7e78827 \
    --env CUML_PR="pull-request/6199" \
    --env CUML_PR_SHA="2ef32eaa006a84c0bd16220bb8e8af34198fbee8" \
    --env RAFT_NIGHTLY_SHA=1b62c4117a35b11ce3c830daae248e32ebf75e3f \
    --env RAFT_PR="pull-request/2531" \
    --env RAFT_PR_SHA="0d6597b08919f2aae8ac268f1a68d6a8fe5beb4e" \
    --env RAPIDS_PY_CUDA_SUFFIX=cu12 \
    --env WHEEL_DIR_BEFORE=/tmp/wheels-before \
    --env WHEEL_DIR_AFTER=/tmp/wheels-after \
    -it rapidsai/ci-wheel:cuda12.5.1-rockylinux8-py3.12 \
    bash

# --- nightly wheels --- #
mkdir -p ./wheels-before

export RAPIDS_BUILD_TYPE=branch
export RAPIDS_REF_NAME="branch-25.02"

# pylibraft
RAPIDS_PY_WHEEL_NAME="pylibraft_${RAPIDS_PY_CUDA_SUFFIX}" \
RAPIDS_REPOSITORY=rapidsai/raft \
RAPIDS_SHA=${RAFT_NIGHTLY_SHA} \
    rapids-download-wheels-from-s3 python ./wheels-before

# raft-dask
RAPIDS_PY_WHEEL_NAME="raft_dask_${RAPIDS_PY_CUDA_SUFFIX}" \
RAPIDS_REPOSITORY=rapidsai/raft \
RAPIDS_SHA=${RAFT_NIGHTLY_SHA} \
    rapids-download-wheels-from-s3 python ./wheels-before

# cugraph
RAPIDS_PY_WHEEL_NAME="cugraph_${RAPIDS_PY_CUDA_SUFFIX}" \
RAPIDS_REPOSITORY=rapidsai/cugraph \
RAPIDS_SHA=${CUGRAPH_NIGHTLY_SHA} \
    rapids-download-wheels-from-s3 python ./wheels-before

# pylibcugraph
RAPIDS_PY_WHEEL_NAME="pylibcugraph_${RAPIDS_PY_CUDA_SUFFIX}" \
RAPIDS_REPOSITORY=rapidsai/cugraph \
RAPIDS_SHA=${CUGRAPH_NIGHTLY_SHA} \
    rapids-download-wheels-from-s3 python ./wheels-before

# cuml
RAPIDS_PY_WHEEL_NAME="cuml_${RAPIDS_PY_CUDA_SUFFIX}" \
RAPIDS_REPOSITORY=rapidsai/cuml \
RAPIDS_SHA=${CUML_NIGHTLY_SHA} \
    rapids-download-wheels-from-s3 python ./wheels-before

# --- wheels from CI --- #
mkdir -p ./wheels-after

export RAPIDS_BUILD_TYPE="pull-request"

# libraft
RAPIDS_PY_WHEEL_NAME="libraft_${RAPIDS_PY_CUDA_SUFFIX}" \
RAPIDS_REPOSITORY=rapidsai/raft \
RAPIDS_REF_NAME="${RAFT_PR}" \
RAPIDS_SHA="${RAFT_PR_SHA}" \
    rapids-download-wheels-from-s3 cpp ./wheels-after

# pylibraft
RAPIDS_PY_WHEEL_NAME="pylibraft_${RAPIDS_PY_CUDA_SUFFIX}" \
RAPIDS_REPOSITORY=rapidsai/raft \
RAPIDS_REF_NAME="${RAFT_PR}" \
RAPIDS_SHA="${RAFT_PR_SHA}" \
    rapids-download-wheels-from-s3 python ./wheels-after

# raft-dask
RAPIDS_PY_WHEEL_NAME="raft_dask_${RAPIDS_PY_CUDA_SUFFIX}" \
RAPIDS_REPOSITORY=rapidsai/raft \
RAPIDS_REF_NAME="${RAFT_PR}" \
RAPIDS_SHA="${RAFT_PR_SHA}" \
    rapids-download-wheels-from-s3 python ./wheels-after

# libcugraph
RAPIDS_PY_WHEEL_NAME="libcugraph_${RAPIDS_PY_CUDA_SUFFIX}" \
RAPIDS_REPOSITORY=rapidsai/cugraph \
RAPIDS_REF_NAME="${CUGRAPH_PR}" \
RAPIDS_SHA="${CUGRAPH_PR_SHA}" \
    rapids-download-wheels-from-s3 cpp ./wheels-after

# pylibcugraph
RAPIDS_PY_WHEEL_NAME="pylibcugraph_${RAPIDS_PY_CUDA_SUFFIX}" \
RAPIDS_REPOSITORY=rapidsai/cugraph \
RAPIDS_REF_NAME="${CUGRAPH_PR}" \
RAPIDS_SHA="${CUGRAPH_PR_SHA}" \
    rapids-download-wheels-from-s3 python ./wheels-after

# cugraph
RAPIDS_PY_WHEEL_NAME="cugraph_${RAPIDS_PY_CUDA_SUFFIX}" \
RAPIDS_REPOSITORY=rapidsai/cugraph \
RAPIDS_REF_NAME="${CUGRAPH_PR}" \
RAPIDS_SHA="${CUGRAPH_PR_SHA}" \
    rapids-download-wheels-from-s3 python ./wheels-after

# libcuml
RAPIDS_PY_WHEEL_NAME="libcuml_${RAPIDS_PY_CUDA_SUFFIX}" \
RAPIDS_REPOSITORY=rapidsai/cuml \
RAPIDS_REF_NAME="${CUML_PR}" \
RAPIDS_SHA="${CUML_PR_SHA}" \
    rapids-download-wheels-from-s3 cpp ./wheels-after

# cuml
RAPIDS_PY_WHEEL_NAME="cuml_${RAPIDS_PY_CUDA_SUFFIX}" \
RAPIDS_REPOSITORY=rapidsai/cuml \
RAPIDS_REF_NAME="${CUML_PR}" \
RAPIDS_SHA="${CUML_PR_SHA}" \
    rapids-download-wheels-from-s3 python ./wheels-after

pip install pydistcheck
pydistcheck \
    --inspect \
    --select 'distro-too-large-compressed' \
    ./wheels-before/*.whl \
| grep -E '^checking|files: | compressed' \
> ./before.txt

# get more exact sizes
du -sh ./wheels-before/*

pydistcheck \
    --inspect \
    --select 'distro-too-large-compressed' \
    ./wheels-after/*.whl \
| grep -E '^checking|files: | compressed' \
> ./after.txt

# get more exact sizes
du -sh ./wheels-after/*

How I tested this

These other PRs:

…wheels

jameslamb · 2025-01-15T17:12:01Z

😭 one of the earlier commits on this is unverified, so I'm gonna have to trigger CI with comments. Sorry for the notification noise, idk what happened there.

jameslamb · 2025-01-15T17:12:06Z

/ok to test

vyasr · 2025-01-15T18:59:55Z

😭 one of the earlier commits on this is unverified, so I'm gonna have to trigger CI with comments. Sorry for the notification noise, idk what happened there.

https://git-scm.com/docs/git-rebase#Documentation/git-rebase.txt---signoff

bdice · 2025-01-16T16:10:33Z

Approved additional changes since my last review.

vyasr

I left a couple of threads unresolved that require some follow-up work from you, but otherwise this PR LGTM now pending the devcontainer updates.

…wheels

jameslamb · 2025-01-16T18:15:13Z

/ok to test

benfred

lgtm!

benfred · 2025-01-16T21:51:04Z

+# To use a different ucxx locally, set the CMake variable
+# CPM_ucxx_SOURCE=/path/to/local/ucxx


thanks for fixing - looks like a cut and paste error

Pulling just the RAFT-related changes off of #438 Complements NVIDIA/raft#2531 ## Notes for Reviewers Proposing: 1. see this pass CI pointed at my fork (branch from NVIDIA/raft#2531) 2. admin-merge NVIDIA/raft#2531 3. point this back at upstream `rapidsai/raft` and see it pass CI 4. merge --------- Co-authored-by: Bradley Dice <bdice@bradleydice.com>

Replaces #4340, contributes to rapidsai/build-planning#33. Proposes packaging `libcugraph` as a wheel, which is then re-used by `cugraph-cu{11,12}` and `pylibcugraph-cu{11,12}` wheels. ## Notes for Reviewers ### Benefits of these changes * smaller wheels (see "Size Changes" below) - *no more `pylibcugraph` and `cugraph` both holding copies of libcugraph.so* * faster compile times - *no more re-compiling RAFT, thanks to NVIDIA/raft#2531 - *no more recompiling libcugraph.so in both `pylibcugraph` and `cugraph` wheel builds* * other benefits mentioned in rapidsai/build-planning#33 ### Wheel contents `libcugraph`: * `libcugraph.so` (shared library) * cuGraph headers * vendored dependencies (`fmt`, `spdlog`, CCCL, `cuco`) `pylibcugraph`: * `pylibcugraph` Python / Cython code and compiled Cython extensions `cugraph`: * `cugraph` Python / Cython code and compiled Cython extension ### Dependency Flows In short.... `libcugraph` contains `libcugraph.so` and `libcugraph_c.so` dynamic libraries and the headers to link against it. * Anything that needs to link against cuGraph at build time pulls in `libcugraph` wheels as a build dependency. * Anything that needs cuGraph's symbols at runtime pulls it in as a runtime dependency, and calls `libcugraph.load_library()`. For more details and some flowcharts, see rapidsai/build-planning#33 (comment) ### Size changes (CUDA 12, Python 3.12, x86_64) | wheel | num files (before) | num files (this PR) | size (before) | size (this PR) | |:---------------:|------------------:|-----------------:|--------------:|-------------:| | `libcugraph` | --- | 1762 | --- | 903M | | `pylibcugraph` | 190 | 187 | 901M | 2M | | `cugraph` | 315 | 313 | 899M | 3M | |**TOTAL** | **505** | **2,262** | **1,800M** | **908M** | *NOTES: size = compressed, "before" = 2025-01-13 nightlies* *This is a cuGraph-specific slice of the table from NVIDIA/raft#2531. See that PR for details.* ### How I tested this These other PRs: * rapidsai/devcontainers#435 * rapidsai/cugraph-gnn#110 Authors: - James Lamb (https://github.com/jameslamb) - Ralph Liu (https://github.com/nv-rliu) - Bradley Dice (https://github.com/bdice) Approvers: - Brad Rees (https://github.com/BradReesWork) - Bradley Dice (https://github.com/bdice) URL: #4804

Contributes to rapidsai/build-planning#137 Follow-up to #2531 . See the linked issue for many more details, but in short... using a dynamically-loaded libraft which has statically-linked cuBLAS causes issues for other libraries. There are now aarch64 CUDA 11 wheels for cuBLAS and other CUDA libraries, so it's possible to have RAFT wheels dynamically link against them. This PR does that. ## Notes for Reviewers This has other side benefits in addition to fixing runtime issues... it also simplifies the wheel-building scripts and CMake, and makes CUDA 11 wheels noticeably smaller 😊 Authors: - James Lamb (https://github.com/jameslamb) Approvers: - Bradley Dice (https://github.com/bdice) URL: #2548

Contributes to rapidsai/build-planning#33. Proposes packaging `libcuvs` as a wheel, which is then re-used by `cuvs-cu{11,12}`. Similar changes were recently made in RAFT: NVIDIA/raft#2531 As part of this, also proposes: * introducing a new CMake option, `CUVS_COMPILE_DYNAMIC_ONLY`, to allow building/installing only the dynamic shared library (i.e. skipping the static library) * enforcing `rapids-cmake`'s preferred CMake style (similar NVIDIA/raft#2531 (comment)) * standardizing `clang` pins across the project, and pinning to `clang` 16 for Rust builds (#594 (comment)) ## Notes for Reviewers ### Benefits of these changes * smaller wheels for projects that depend on cuVS (they can dynamically link against `libcuvs` instead of statically linking in the pieces they need) * fewer CI resources used for cuVS wheels (no more re-compiling for every Python minor version) * faster, cheaper cuML wheel builds (rapidsai/cuml#6199 (comment)) * other benefits mentioned in rapidsai/build-planning#33 ### Wheel contents `libcuvs`: * `libcuvs.so` and `libcuvs_c.so` (shared library) * cuVS headers * vendored dependencies (hnswlib) `cuvs`: * `cuvs` Python / Cython code and compiled Cython extensions ### Size changes (CUDA 12, Python 3.12, x86_64) | wheel | num files (before) | num files (this PR) | size (before) | size (this PR) | |:---------------:|------------------:|-----------------:|--------------:|---------------:| | `libcuvs` | --- | 67 | --- | 843M | | `cuvs` | 88 | 84 |845M | 2M | |**TOTAL** | **88** | **131** | **845M** | **845M** | *NOTES: size = compressed, "before" = 2025-01-22 nightlies* <details><summary>how I calculated those (click me)</summary> * nightly commit = rapidsai/cuml@7c715c4 * PR = this PR ```shell docker run \ --rm \ --network host \ --env RAPIDS_NIGHTLY_DATE=2025-01-22 \ --env CUVS_NIGHTLY_SHA=f1de1b2 \ --env CUVS_PR="pull-request/594" \ --env CUVS_PR_SHA="97c56178cd0e07e4b6b138bb0904af78379f1bb3" \ --env RAPIDS_PY_CUDA_SUFFIX=cu12 \ --env WHEEL_DIR_BEFORE=/tmp/wheels-before \ --env WHEEL_DIR_AFTER=/tmp/wheels-after \ -it rapidsai/ci-wheel:cuda12.5.1-rockylinux8-py3.12 \ bash # --- nightly wheels --- # mkdir -p ./wheels-before export RAPIDS_BUILD_TYPE=branch export RAPIDS_REF_NAME="branch-25.02" # cuvs RAPIDS_PY_WHEEL_NAME="cuvs_${RAPIDS_PY_CUDA_SUFFIX}" \ RAPIDS_REPOSITORY=rapidsai/cuvs \ RAPIDS_SHA=${CUVS_NIGHTLY_SHA} \ rapids-download-wheels-from-s3 python ./wheels-before # --- wheels from CI --- # mkdir -p ./wheels-after export RAPIDS_BUILD_TYPE="pull-request" # libcuvs RAPIDS_PY_WHEEL_NAME="libcuvs_${RAPIDS_PY_CUDA_SUFFIX}" \ RAPIDS_REPOSITORY=rapidsai/cuvs \ RAPIDS_REF_NAME="${CUVS_PR}" \ RAPIDS_SHA="${CUVS_PR_SHA}" \ rapids-download-wheels-from-s3 cpp ./wheels-after # cuvs RAPIDS_PY_WHEEL_NAME="cuvs_${RAPIDS_PY_CUDA_SUFFIX}" \ RAPIDS_REPOSITORY=rapidsai/cuvs \ RAPIDS_REF_NAME="${CUVS_PR}" \ RAPIDS_SHA="${CUVS_PR_SHA}" \ rapids-download-wheels-from-s3 python ./wheels-after pip install pydistcheck pydistcheck \ --inspect \ --select 'distro-too-large-compressed' \ ./wheels-before/*.whl \ | grep -E '^checking|files: | compressed' \ > ./before.txt # get more exact sizes du -sh ./wheels-before/* pydistcheck \ --inspect \ --select 'distro-too-large-compressed' \ ./wheels-after/*.whl \ | grep -E '^checking|files: | compressed' \ > ./after.txt # get more exact sizes du -sh ./wheels-after/* ``` </details> ### How I tested this * rapidsai/devcontainers#440 * rapidsai/cuml#6199 Authors: - James Lamb (https://github.com/jameslamb) Approvers: - Bradley Dice (https://github.com/bdice) - Ben Frederickson (https://github.com/benfred) URL: #594

Replaces #6006, contributes to rapidsai/build-planning#33. Proposes packaging `libcuml` as a wheel, which is then re-used by `cuml-cu{11,12}` wheels. ## Notes for Reviewers ### Benefits of these changes * smaller wheels (see "Size Changes" below) * faster compile times - *no more re-compiling RAFT, thanks to NVIDIA/raft#2531 * less use of CI resources (only compiling once per CPU architecture / CUDA versions, instead of once per those + Python minor version) * other benefits mentioned in rapidsai/build-planning#33 ### Wheel contents `libcuml`: * `libcuml++.so` (shared library) and its headers * `libcumlprims_mg.so` (shared library) and its headers * other vendored dependencies (CCCL, `fmt`) `cuml`: * `cuml` Python / Cython code and compiled Cython extensions ### Dependency Flows In short.... `libcuml` contains `libcuml.so` and `libcumlprims_mg.so` dynamic libraries and the headers to link against them. * Anything that needs to link against cuML at build time pulls in `libcugraph` wheels as a build dependency. * Anything that needs cuML's symbols at runtime pulls it in as a runtime dependency, and calls `libcuml.load_library()`. For more details and some flowcharts, see rapidsai/build-planning#33 (comment) ### Size changes (CUDA 12, Python 3.12, x86_64) | wheel | num files (before) | num files (this PR) | size (before) | size (this PR) | |:---------------:|------------------:|-----------------:|--------------:|-------------:| | `libcuml` | --- | 1766 | --- | 289M | | `cuml` | 442 | 441 | 527M | 9M | |**TOTAL** | **442** | **2207** | **527M** | **298M** | *NOTES: size = compressed, "before" = 2025-01-22 nightlies* <details><summary>how I calculated those (click me)</summary> ```shell docker run \ --rm \ --network host \ --env RAPIDS_NIGHTLY_DATE=2025-01-22 \ --env CUML_NIGHTLY_SHA=01e19bba9821954b062a04fbf31d3522afa4b0b1 \ --env CUML_PR="pull-request/6199" \ --env CUML_PR_SHA="9d5100ec4589e20230a31817518427efa1e49c6d" \ --env RAPIDS_PY_CUDA_SUFFIX=cu12 \ --env WHEEL_DIR_BEFORE=/tmp/wheels-before \ --env WHEEL_DIR_AFTER=/tmp/wheels-after \ -it rapidsai/ci-wheel:cuda12.5.1-rockylinux8-py3.12 \ bash # --- nightly wheels --- # mkdir -p ./wheels-before export RAPIDS_BUILD_TYPE=branch export RAPIDS_REF_NAME="branch-25.02" # cuml RAPIDS_PY_WHEEL_NAME="cuml_${RAPIDS_PY_CUDA_SUFFIX}" \ RAPIDS_REPOSITORY=rapidsai/cuml \ RAPIDS_SHA=${CUML_NIGHTLY_SHA} \ rapids-download-wheels-from-s3 python ./wheels-before # --- wheels from CI --- # mkdir -p ./wheels-after export RAPIDS_BUILD_TYPE="pull-request" # libcuml RAPIDS_PY_WHEEL_NAME="libcuml_${RAPIDS_PY_CUDA_SUFFIX}" \ RAPIDS_REPOSITORY=rapidsai/cuml \ RAPIDS_REF_NAME="${CUML_PR}" \ RAPIDS_SHA="${CUML_PR_SHA}" \ rapids-download-wheels-from-s3 cpp ./wheels-after # cuml RAPIDS_PY_WHEEL_NAME="cuml_${RAPIDS_PY_CUDA_SUFFIX}" \ RAPIDS_REPOSITORY=rapidsai/cuml \ RAPIDS_REF_NAME="${CUML_PR}" \ RAPIDS_SHA="${CUML_PR_SHA}" \ rapids-download-wheels-from-s3 python ./wheels-after pip install pydistcheck pydistcheck \ --inspect \ --select 'distro-too-large-compressed' \ ./wheels-before/*.whl \ | grep -E '^checking|files: | compressed' \ > ./before.txt # get more exact sizes du -sh ./wheels-before/* pydistcheck \ --inspect \ --select 'distro-too-large-compressed' \ ./wheels-after/*.whl \ | grep -E '^checking|files: | compressed' \ > ./after.txt # get more exact sizes du -sh ./wheels-after/* ``` </details> ### How I tested this These other PRs: * rapidsai/devcontainers#442 Authors: - James Lamb (https://github.com/jameslamb) - Bradley Dice (https://github.com/bdice) Approvers: - Bradley Dice (https://github.com/bdice) - Divye Gala (https://github.com/divyegala) URL: #6199

jameslamb added 3 commits December 16, 2024 08:30

start adding libraft wheels

24a4db8

libraft minimally working

c0f059c

pylibraft builds mostly working

d116417

jameslamb added DO NOT MERGE Hold off on merging; see PR for details improvement Improvement / enhancement to an existing function non-breaking Non-breaking change 2 - In Progress Currenty a work in progress labels Dec 17, 2024

This comment was marked as resolved.

Sign in to view

github-actions Bot added CMake python ci labels Dec 17, 2024

jameslamb added 7 commits December 17, 2024 08:47

more changes

eb17735

comment out more CI

d317235

more changes

679d289

more dependencies.yaml fiddling

51e7041

actually run builds

6d38c19

pre-commit

717df6f

merge branch-25.02

d815242

jameslamb changed the title ~~WIP: introduce libraft wheels~~ WIP: [DO NOT MERGE] introduce libraft wheels Dec 17, 2024

jameslamb added 4 commits December 17, 2024 10:45

install libraft wheels

11168a1

fewer builds, fix libraft downloads

46bfcfa

fix branches

97f5d31

more fixes to CI scripts

f492d59

jameslamb mentioned this pull request Dec 17, 2024

remove unused 'joblib' and 'numba' dependencies, other packaging cleanup #2532

Merged

jameslamb added 2 commits December 17, 2024 12:55

download libraft in wheel test jobs, change file-size limits

ad13d08

pylibraft no longer needs CUDA-wheels runtime dependency

6bf5eba

jameslamb mentioned this pull request Dec 17, 2024

introduce libcugraph wheels rapidsai/cugraph#4804

Merged

jameslamb added 3 commits December 18, 2024 13:32

update thresholds

9783244

Merge branch 'branch-25.02' into libraft-wheels

d0b6385

try re-enabling conda CI

ee99702

jameslamb added 3 commits January 15, 2025 08:59

enforce rapids-cmake CMake style

a800691

Merge branch 'branch-25.02' of github.com:rapidsai/raft into libraft-…

6635330

…wheels

empty commit to re-trigger CI

0d6597b

bdice approved these changes Jan 16, 2025

View reviewed changes

jameslamb mentioned this pull request Jan 16, 2025

add libraft wheels rapidsai/devcontainers#438

Merged

vyasr approved these changes Jan 16, 2025

View reviewed changes

jameslamb added 2 commits January 16, 2025 10:09

add devcontainer builds back

93f39fb

Merge branch 'branch-25.02' of github.com:rapidsai/raft into libraft-…

38aede9

…wheels

jameslamb mentioned this pull request Jan 16, 2025

WIP: [DO NOT MERGE] Associate headers with raft target via a CMake FILE_SET #2528

Closed

jameslamb removed 2 - In Progress Currenty a work in progress DO NOT MERGE Hold off on merging; see PR for details labels Jan 16, 2025

jameslamb removed the request for review from KyleFromNVIDIA January 16, 2025 22:28

divyegala approved these changes Jan 16, 2025

View reviewed changes

benfred approved these changes Jan 16, 2025

View reviewed changes

raydouglass merged commit 8299f17 into NVIDIA:branch-25.02 Jan 16, 2025

jameslamb deleted the libraft-wheels branch January 17, 2025 17:09

This was referenced Jan 21, 2025

introduce libcuvs wheels NVIDIA/cuvs#594

Merged

wheel builds: standardizations for 25.02 rapidsai/build-planning#136

Closed

use dynamic CUDA wheels on CUDA 11 #2548

Merged

jameslamb mentioned this pull request Jan 24, 2025

enforce cmake-format and cmake-lint rapidsai/cugraph#4889

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

introduce libraft wheels#2531

introduce libraft wheels#2531
raydouglass merged 42 commits into
NVIDIA:branch-25.02from
jameslamb:libraft-wheels

jameslamb commented Dec 17, 2024 •

edited

Loading

Uh oh!

This comment was marked as resolved.

jameslamb commented Jan 15, 2025

Uh oh!

jameslamb commented Jan 15, 2025

Uh oh!

vyasr commented Jan 15, 2025

Uh oh!

bdice commented Jan 16, 2025

Uh oh!

vyasr left a comment

Uh oh!

jameslamb commented Jan 16, 2025

Uh oh!

benfred left a comment

Uh oh!

benfred Jan 16, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

		# To use a different ucxx locally, set the CMake variable
		# CPM_ucxx_SOURCE=/path/to/local/ucxx

Uh oh!

Conversation

jameslamb commented Dec 17, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Notes for Reviewers

Benefits of these changes

Wheel contents

Dependency Flows

Size changes (CUDA 12, Python 3.12, x86_64)

How I tested this

Uh oh!

This comment was marked as resolved.

jameslamb commented Jan 15, 2025

Uh oh!

jameslamb commented Jan 15, 2025

Uh oh!

vyasr commented Jan 15, 2025

Uh oh!

bdice commented Jan 16, 2025

Uh oh!

vyasr left a comment

Choose a reason for hiding this comment

Uh oh!

jameslamb commented Jan 16, 2025

Uh oh!

benfred left a comment

Choose a reason for hiding this comment

Uh oh!

benfred Jan 16, 2025

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

jameslamb commented Dec 17, 2024 •

edited

Loading