Skip to content

refactor(citestwheel): switch base image from devel to base - #408

Merged
rapids-bot[bot] merged 5 commits into
rapidsai:mainfrom
gforsyth:switch_devel_to_base
Jul 21, 2026
Merged

refactor(citestwheel): switch base image from devel to base#408
rapids-bot[bot] merged 5 commits into
rapidsai:mainfrom
gforsyth:switch_devel_to_base

Conversation

@gforsyth

@gforsyth gforsyth commented May 18, 2026

Copy link
Copy Markdown
Contributor

New PR because I rebased and force-pushed -- rebuilding ci-imgs against cuda base

Depends on rapidsai/build-planning#279.

Testing is tracked in rapidsai/build-planning#143 (comment)

As of 2026-07-21 -- all libraries that load shared objects from wheel installs are tested against the cuda-base image, and all fixes to ensure that they correctly load those shared objects have landed in their respective projects.

rapids-bot Bot pushed a commit that referenced this pull request May 19, 2026
Debugging failures that showed up in https://github.com/rapidsai/ci-imgs/actions/runs/26057524971/job/76609236506?pr=408#step:9:6848 while working on #408 

@jameslamb is seeing the same thing over in `rapidsai/docker` (tracked at rapidsai/docker#878)
 
**update 2026-05-19**

@jameslamb figured out that force-reinstalling `conda` before performing any other `conda` operations fixes the notices loading issue.
I've applied those same changed here and reverted the previous change.

Authors:
  - Gil Forsyth (https://github.com/gforsyth)

Approvers:
  - Kyle Edwards (https://github.com/KyleFromNVIDIA)
  - James Lamb (https://github.com/jameslamb)

URL: #409
@gforsyth
gforsyth force-pushed the switch_devel_to_base branch from c69238c to d0fa8d9 Compare May 19, 2026 19:22
@gforsyth
gforsyth force-pushed the switch_devel_to_base branch from d0fa8d9 to a3edbfe Compare June 30, 2026 13:47
@bdice

bdice commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

After we merge this, let's work on rapidsai/docs#673 and use base as the recommended image flavor in our docs.

@gforsyth
gforsyth marked this pull request as ready for review July 21, 2026 17:14
@gforsyth
gforsyth requested a review from a team as a code owner July 21, 2026 17:14
@gforsyth
gforsyth requested review from KyleFromNVIDIA and removed request for a team July 21, 2026 17:14
@jameslamb jameslamb added the breaking Introduces a breaking change label Jul 21, 2026

@jameslamb jameslamb left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

awesome!!!

The images look like they're about 10x smaller (400ish MB instead of 4ish GB) and I saw container spin-up times around 30 seconds on the testing PRs (usually like 3-4 minutes today).

Let's merge this. The testing looks pretty thorough, I'm around to help with whatever other things may break because of this.

@vyasr

vyasr commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

That's an awesome speedup. Glad we're finally in a position to do this!

@gforsyth

Copy link
Copy Markdown
Contributor Author

Let's goooooooooooooo

@gforsyth

Copy link
Copy Markdown
Contributor Author

/merge

@rapids-bot
rapids-bot Bot merged commit 6fe2a45 into rapidsai:main Jul 21, 2026
316 checks passed
@gforsyth
gforsyth deleted the switch_devel_to_base branch July 21, 2026 18:15
rapids-bot Bot pushed a commit to NVIDIA/cudf that referenced this pull request Jul 22, 2026
The `ci-imgs` change in rapidsai/ci-imgs#408 switched `citestwheel` images from CUDA `devel` to `base`, which no longer bundles `libcufile.so` with the container. Now we must install cuFile wheels in Python test environments that use CUDA wheels.

CUDA 12 uses `nvidia-cufile-cu12` with some caveats in the pinnings, because cuFile wheels weren't available until 12.6.3 so the `[cufile]` extra isn't reliable.

CUDA 13 uses the `cuda-toolkit[cufile]` extra.

Authors:
  - Bradley Dice (https://github.com/bdice)
  - Gil Forsyth (https://github.com/gforsyth)

Approvers:
  - Gil Forsyth (https://github.com/gforsyth)

URL: #23392
rapids-bot Bot pushed a commit to NVIDIA/cudf that referenced this pull request Jul 30, 2026
It looks like up until this point our usage of numba-cuda from CUDA wheels has been relying on the system CCCL rather than the one bundled with libcudf. We noticed this as a result of the change in ci-imgs to use the base rather than devel CUDA images as our base (rapidsai/ci-imgs#408) because testing on older CTKs revealed that headers required by numba-cuda were missing (specifically `cuda/atomic`). To ensure that we have ABI-compatible usage of CCCL given that we have custom numba extension code for our string UDFs, we're best off ensuring that we use the CCCL bundled in libcudf rather than whatever is found on the system, so this PR adds that directory to our numba search path.

Authors:
  - Vyas Ramasubramani (https://github.com/vyasr)

Approvers:
  - James Lamb (https://github.com/jameslamb)
  - Matthew Roeschke (https://github.com/mroeschke)

URL: #23455
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

breaking Introduces a breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants