RapidsMPF SPMD mode - #21619

Merged

rapids-bot[bot] merged 36 commits into

NVIDIA:mainfrom

madsbk:rapidsmpf-spmd

Mar 6, 2026

Commits on Mar 3, 2026

SPMD mode
madsbk
committed
423be42
reserve_op_id
madsbk
committed
b6636b6
allgather_polars_dataframe
madsbk
committed
c7d0564
ContextSPMD
madsbk
committed
fa2ec5e
spmd_execution
madsbk
committed
a7bd8ac
tests
madsbk
committed
6daef05
docs
madsbk
committed
6932b99
rename to evaluate_pipeline_spmd_mode
madsbk
committed
c87dd57
cleanup
madsbk
committed
bb168b3
run_polars_dask
madsbk
committed
3df81a2
remove num_queries
madsbk
committed
0240712
spmd_execution(): takes engine_kwargs
madsbk
committed
db332fe
benchmark: spmd
madsbk
committed
a401946
doc
madsbk
committed
8f4989c
spmd_execution(): read rapidsmpf_py_executor_max_workers
madsbk
committed
93fd93d

Commits on Mar 4, 2026

Apply suggestions from code review

madsbk
and
wence-
authored
eb34aae
Merge branch 'main' of github.com:rapidsai/cudf into rapidsmpf-spmd
madsbk
committed
7b6283e
revert utils.py
madsbk
committed
f0f3474
run_polars(): remove unused argument
madsbk
committed
6aff093
more tests and docs
madsbk
committed
fdef8ff
use stream_ordered_after
madsbk
committed
e900e93

Commits on Mar 5, 2026

Commits on Mar 6, 2026

SPMDContext
madsbk
committed
335c91c
docs
madsbk
committed
cdfffa6
Merge branch 'main' of github.com:rapidsai/cudf into rapidsmpf-spmd
madsbk
committed
97a0555
run_duckdb(): removed num_queries
madsbk
committed
8753701
cleanup
madsbk
committed
720c97e
Context doesn't have a comm anymore
madsbk
committed
86cdabe
more tests and docs
madsbk
committed
373537c
cleanup
madsbk
committed
51941d9
cleanup
madsbk
committed
7a55100
docs
madsbk
committed
9db3e52