Introduce a process-wide singleton engine for `.collect(engine="gpu")` - #22410

Merged

rapids-bot[bot] merged 22 commits into

NVIDIA:mainfrom

madsbk:default_gpu_engine

May 12, 2026

Commits on May 9, 2026

DefaultSingletonEngine
madsbk
committed
34498a9
Remove the legacy "single" path
madsbk
committed
f2fa352
Handle default_singleton in the SPMD path
madsbk
committed
5b25d92
def py_executor
madsbk
committed
1685160

Commits on May 10, 2026

reorder exit_stack
madsbk
committed
792f8f8
comments
madsbk
committed
27edefd
Context explicit shutdown
madsbk
committed
0b6db4b
self._ctx always
madsbk
committed
a8501c6
guard against self._ctx.shutdown() errors.
madsbk
committed
b5543e1

Commits on May 11, 2026

Apply suggestions from code review

madsbk
and
wence-
authored
2f7b115
Merge branch 'main' of github.com:rapidsai/cudf into default_gpu_engine
madsbk
committed
432e590
remove delattr(dask_worker, attr) guard
madsbk
committed
c5ee511
cleanup
madsbk
committed
22312a2
Merge branch 'main' of github.com:rapidsai/cudf into default_gpu_engine
madsbk
committed
806cf80
moved check_no_live_default_singleton() call inside StreamingEngine
madsbk
committed
4a1903a
rename to get_or_create()
madsbk
committed
f2687e3
test collect(engine=gpu")
madsbk
committed
138af2d
Merge branch 'main' of github.com:rapidsai/cudf into default_gpu_engine
madsbk
committed
108c019
Merge branch 'main' of github.com:rapidsai/cudf into default_gpu_engine
madsbk
committed
5d7803e

Commits on May 12, 2026

Merge branch 'main' of github.com:rapidsai/cudf into default_gpu_engine
madsbk
committed
3b9e5c0
Update python/cudf_polars/cudf_polars/experimental/rapidsmpf/frontend/default_singleton_engine.py

madsbk
and
wence-
authored
da4c0c4
docs
madsbk
committed
6ad85b1