Skip to content

Fix dask_setup and cleanup#1541

Merged
rapids-bot[bot] merged 10 commits intorapidsai:branch-25.10from
pentschev:fix-dask-setup
Aug 27, 2025
Merged

Fix dask_setup and cleanup#1541
rapids-bot[bot] merged 10 commits intorapidsai:branch-25.10from
pentschev:fix-dask-setup

Conversation

@pentschev
Copy link
Member

Remove unused dask_setup arguments, leaving only --create-cuda-context using worker._protocol to determine the protocol correctly instead of the incorrect "overload" of the argument from cli.py. Additionally add tests to check that dask_setup is called.

Fixes #1540 .

@pentschev pentschev self-assigned this Aug 26, 2025
@pentschev pentschev added bug Something isn't working 3 - Ready for Review Ready for review by team labels Aug 26, 2025
@pentschev pentschev requested a review from a team as a code owner August 26, 2025 12:14
@pentschev pentschev added the non-breaking Non-breaking change label Aug 26, 2025
Comment on lines +48 to +51
if (
distributed.comm.ucx.cuda_context_created is False
or distributed.comm.ucx.cuda_context_created.has_context
):
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This would normally deserve a better fix, but since we're dropping that piece of code soon (within a week) with UCX-Py archive it's not worth spending more time on it.

@jameslamb
Copy link
Member

@pentschev @TomAugspurger can this be merged?

I think cudf CUDA 13 CI is facing exactly the issue this is fixing: rapidsai/cudf#19768 (comment)

@TomAugspurger
Copy link
Contributor

TomAugspurger commented Aug 27, 2025

Yep. I think Peter is out today, so I'll merge this and keep an eye on CI.

@TomAugspurger
Copy link
Contributor

/merge

@rapids-bot rapids-bot bot merged commit 8b90ca0 into rapidsai:branch-25.10 Aug 27, 2025
40 checks passed
@jameslamb
Copy link
Member

Thank you!

@pentschev
Copy link
Member Author

Thanks Tom. I'm mostly out today indeed, but I'm pretty sure the failure is not related to Dask, see the (or one of, haven't checked all the log) actual failure here.

@jameslamb
Copy link
Member

Oh thank you! Did not see that hiding in those logs too... ok maybe we had 2 problems there 😅

@pentschev pentschev deleted the fix-dask-setup branch August 28, 2025 18:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

3 - Ready for Review Ready for review by team bug Something isn't working non-breaking Non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Errors in dask_setup

3 participants

Comments