Skip to content

Support repository dependency_keys in manifest.yaml - #536

Merged
bdice merged 2 commits into
rapidsai:branch-25.08from
bdice:repo-file-keys
Jul 17, 2025
Merged

Support repository dependency_keys in manifest.yaml#536
bdice merged 2 commits into
rapidsai:branch-25.08from
bdice:repo-file-keys

Conversation

@bdice

@bdice bdice commented Jul 16, 2025

Copy link
Copy Markdown
Contributor

This PR isolates a change from @trxcllnt in #479 so that we can unblock CI on this repository.

We need this so we can exclude xgboost from cuML's dependency list, since libxgboost brings in librmm conda packages, and that breaks devcontainers building everything from source.

Closes #535.

This temporarily breaks cuML devcontainers because it does not include the cuML test dependencies, but it unblocks cuML CI.

Planned follow-up actions:

  • Create a cuML dependency file key called devcontainers with everything except xgboost
  • Update the manifest.yaml to use that file key instead of the current set of keys (if the cuML PR merges first, we can modify this PR instead of needing a follow-up)

@bdice
bdice requested a review from a team as a code owner July 16, 2025 20:57
@bdice
bdice requested review from AyodeAwe and removed request for a team July 16, 2025 20:57

@jameslamb jameslamb left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for considering this and to @trxcllnt for implementing it.

I agree, we need to get this onto branch-25.08 and unblock CI.

@jameslamb

Copy link
Copy Markdown
Member

Every time you update one of the devcontainers features, you have to update the version to ensure it's published:

I just pushed c82f309 doing that here.

@bdice
bdice merged commit 166bd81 into rapidsai:branch-25.08 Jul 17, 2025
@bdice bdice mentioned this pull request Jul 17, 2025
rapids-bot Bot pushed a commit to NVIDIA/cuml that referenced this pull request Jul 18, 2025
Unified conda devcontainers use the `all` file key to generate their dependency lists for each repository. Currently cuml includes `xgboost` in its `all` file key via the `test_python` dependency list. Unfortunately, this pulls in a conda dependency on `librmm` via `libxgboost`. This is problematic because we must build `librmm` from source in our unified devcontainers.

It seems like `xgboost` is a soft test dependency. In this PR, I add a new dependency file key called `devcontainers` that excludes `xgboost`. Developer conda environments, CI workflows, and pip devcontainers are unaffected by this change. Conda devcontainers will now require the user to manually install `xgboost` in order to run tests that need it, and this is noted in `BUILD.md`.

This is needed to solve the problems discussed in rapidsai/devcontainers#534 (comment).

Once this is merged, I will push a change to rapidsai/devcontainers#536 to use the new `devcontainers` file key.

Authors:
  - Bradley Dice (https://github.com/bdice)

Approvers:
  - Paul Taylor (https://github.com/trxcllnt)
  - James Lamb (https://github.com/jameslamb)
  - Simon Adorf (https://github.com/csadorf)

URL: #7006
bdice added a commit that referenced this pull request Jul 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants