Skip to content

Upgrade conda builds to latest rattler-build - #1258

Merged
rapids-bot[bot] merged 11 commits into
rapidsai:mainfrom
vyasr:rattler-build-latest
Oct 15, 2026
Merged

rapids-bot[bot] merged 11 commits into
rapidsai:mainfrom
vyasr:rattler-build-latest

Conversation

@vyasr

@vyasr vyasr commented Oct 14, 2026 •

Copy link
Copy Markdown
Contributor

Install and verify the latest stable conda-forge rattler-build in the C++ and Python conda build entrypoints. Replace the removed C++ recipe cache with an inherited staging output and explicitly forward CUDA and compiler-cache settings required by isolated builds.

The explicit installation of the latest stable rattler-build version in the build scripts is temporary. The installer and its calls will be removed as soon as the shared RAPIDS CI images are updated to provide the upgraded version.

Declare compiler runtimes and directly linked NUMA, UCX and project-library dependencies where existing recipes suppress run exports or omit direct ownership. Normalize versioned compiler debug-prefix maps so Python cache entries remain reusable across package builds. Preserve package identities and artifact conventions. Part of rapidsai/build-planning#259.

Signed-off-by: Vyas Ramasubramani <vyasr@nvidia.com>
@vyasr vyasr added conda Relates to conda packaging improvement Improves an existing functionality non-breaking Introduces a non-breaking change labels Oct 14, 2026
@copy-pr-bot

copy-pr-bot Bot commented Oct 14, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@vyasr

vyasr commented Oct 14, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test

Signed-off-by: Vyas Ramasubramani <vyasr@nvidia.com>
@vyasr

vyasr commented Oct 14, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test

Signed-off-by: Vyas Ramasubramani <vyasr@nvidia.com>
@vyasr

vyasr commented Oct 14, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test

Signed-off-by: Vyas Ramasubramani <vyasr@nvidia.com>
@vyasr

vyasr commented Oct 14, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test

Signed-off-by: Vyas Ramasubramani <vyasr@nvidia.com>
@vyasr

vyasr commented Oct 14, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test

Signed-off-by: Vyas Ramasubramani <vyasr@nvidia.com>
@vyasr

vyasr commented Oct 14, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test

Signed-off-by: Vyas Ramasubramani <vyasr@nvidia.com>
@vyasr

vyasr commented Oct 14, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test

@copy-pr-bot

copy-pr-bot Bot commented Oct 14, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@vyasr

vyasr commented Oct 15, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test

@copy-pr-bot

copy-pr-bot Bot commented Oct 15, 2026

Copy link
Copy Markdown

/ok to test

@vyasr, there was an error processing your request: E1

See the following link for more information: https://docs.gha-runners.nvidia.com/cpr/e/1/

@vyasr

vyasr commented Oct 15, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 9af1ede

Signed-off-by: Vyas Ramasubramani <vyasr@nvidia.com>
@vyasr
vyasr force-pushed the rattler-build-latest branch from 9af1ede to 9ebd818 Compare October 15, 2026 04:45
@vyasr

vyasr commented Oct 15, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 9ebd818

Signed-off-by: Vyas Ramasubramani <vyasr@nvidia.com>
(cherry picked from commit f061499)
@vyasr

vyasr commented Oct 15, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test b7cdd06

Signed-off-by: Vyas Ramasubramani <vyasr@nvidia.com>
@vyasr

vyasr commented Oct 15, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 5ce52df

rapids-bot Bot pushed a commit that referenced this pull request Oct 15, 2026
Adopting a default-constructed or moved-from empty `rmm::device_buffer` can attempt to record an event on an invalid CUDA stream after rapidsai/rmm#2546. Skip the upstream join only when the buffer has no allocation and carries the invalid-stream sentinel, then assign the requested stream before constructing the rapidsmpf buffer. Valid upstream streams retain their synchronization behavior.

Add a regression test that adopts a default-constructed buffer onto a nondefault stream and waits for its recorded event. This addresses the `MetadataMessage.round_trip` runtime failure separately from the rattler-build migration in #1258.

Authors:
  - Vyas Ramasubramani (https://github.com/vyasr)
  - Peter Andreas Entschev (https://github.com/pentschev)

Approvers:
  - Peter Andreas Entschev (https://github.com/pentschev)

URL: #1261
Signed-off-by: Vyas Ramasubramani <vyasr@nvidia.com>
@vyasr

vyasr commented Oct 15, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 312813d

@vyasr
vyasr marked this pull request as ready for review October 15, 2026 19:04
@vyasr
vyasr requested review from a team as code owners October 15, 2026 19:04
@vyasr
vyasr requested a review from msarahan October 15, 2026 19:04
@vyasr

vyasr commented Oct 15, 2026

Copy link
Copy Markdown
Contributor Author

/merge

@rapids-bot
rapids-bot Bot merged commit 700ef9b into rapidsai:main Oct 15, 2026
59 checks passed
@vyasr
vyasr deleted the rattler-build-latest branch October 15, 2026 19:31
rapids-bot Bot pushed a commit that referenced this pull request Oct 16, 2026
Remove the temporary rattler-build installer added in #1258 and its calls from the conda build scripts, so builds use the rattler-build provided by the CI image.

Depends on rapidsai/ci-imgs#473. Keep this PR in draft until that image update has merged and the updated images are available.

Related to rapidsai/build-planning#259.

Authors:
  - Vyas Ramasubramani (https://github.com/vyasr)

Approvers:
  - Bradley Dice (https://github.com/bdice)
  - James Lamb (https://github.com/jameslamb)

URL: #1264
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

conda Relates to conda packaging improvement Improves an existing functionality non-breaking Introduces a non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants