Repository navigation
Run the cudf-polars test suite against DaskEngine and RayEngine
#22381
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
rapids-bot
merged 28 commits into
NVIDIA:main
from
madsbk:engine_reset-test-dask-and-ray
May 7, 2026
Merged
Changes from 12 commits
Commits
Show all changes
28 commits
Select commit
Hold shift + click to select a range
1b165a8
Test Ray and Dask engine
madsbk 7cdedd0
CI: install Ray
madsbk 8feaf42
cleanup
madsbk e26e24b
CI: restrict UCX to TCP and CUDA transports
madsbk 26daa0e
NUM_RANKS = 2
madsbk b294bf8
spmd_engine_factory
madsbk e5427fa
remove noise
madsbk 75d234c
Add UCX-specific configs to cudf-polars CI runners
pentschev 41d71b3
Remove UCX_TLS config from cudf-polars CI script
pentschev 9a05eb8
Remove unnecessary blank line
pentschev 0c26c09
Fix container option matrix
pentschev f3dc183
Merge remote-tracking branch 'upstream/main' into engine_reset-test-d…
pentschev 1996620
ray>=2.55.1
madsbk f2005f3
Merge branch 'main' of github.com:rapidsai/cudf into engine_reset-tes…
madsbk 673df5b
Merge branch 'engine_reset-test-dask-and-ray' of github.com:madsbk/cu…
madsbk 27b631c
ray>=2.55.1
madsbk d280fab
Merge branch 'main' of github.com:rapidsai/cudf into engine_reset-tes…
madsbk 5c4d952
Don't limit to spmd_engine, ignore warning locally instead
madsbk 8c1819f
warns_on_spmd
madsbk d3904b7
cudf-polars: fix ConditionalJoin fallback on asymmetric partition counts
madsbk 6482434
more warns_on_spmd
madsbk f79fb71
test_rapidsmpf_join_metadata(): https://github.com/rapidsai/cudf/pull…
madsbk cd78518
Merge branch 'main' of github.com:rapidsai/cudf into engine_reset-tes…
madsbk 56fc913
xskip: multi-rank fallback
madsbk 88f6b5d
cover
madsbk 734df2e
test_over_in_filter_unsupported: fix warning
madsbk efc904b
Merge branch 'main' of github.com:rapidsai/cudf into engine_reset-tes…
madsbk 83059fd
ConditionalJoin cleanup
madsbk File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Some comments aren't visible on the classic Files Changed page.
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
These changes are necessary to provide enough resources for UCX. For reference, we already do the same for UCXX and RapidsMPF, both need it for the same reason: