Skip to content

Forward-merge main into pandas3 - #21755

Merged
AyodeAwe merged 7 commits into
pandas3from
main
Mar 11, 2026
Merged

Forward-merge main into pandas3#21755
AyodeAwe merged 7 commits into
pandas3from
main

Conversation

@AyodeAwe

Copy link
Copy Markdown
Contributor

Forward-merge triggered by automated cron job to keep pandas3 up-to-date with main.

If this PR has conflicts, it will remain open for manual resolution.

See forward-merger docs for more info.

mhaseeb123 and others added 7 commits March 10, 2026 19:09
Closes #21584

This PR enables proper support for fixed point (specifically decimal128) types in Parquet / Hybrid scan predicate pushdown

Authors:
  - Muhammad Haseeb (https://github.com/mhaseeb123)

Approvers:
  - Lawrence Mitchell (https://github.com/wence-)
  - Nghia Truong (https://github.com/ttnghia)

URL: #21681
All queries validated at SF1.
Contributes to #19200

```bash
$ python python/cudf_polars/cudf_polars/experimental/benchmarks/pdsds.py --root ~/cudf/tpcds_decimal --scale 1.0 --executor streaming --no-print-results --validate --baseline duckdb --runtime rapidsmpf --na
tive-parquet 83-85
✅ Query 83 - Iteration 0 finished in 0.9256s
✅ Query 84 - Iteration 0 finished in 0.1377s
✅ Query 85 - Iteration 0 finished in 0.5136s
```

Authors:
  - Matthew Murray (https://github.com/Matt711)

Approvers:
  - Vyas Ramasubramani (https://github.com/vyasr)

URL: #21649
The tests for internal `cudf::detail::gather` is no longer needed and requires exporting too many dependent detail functions.

Authors:
  - David Wendt (https://github.com/davidwendt)

Approvers:
  - Bradley Dice (https://github.com/bdice)
  - Nghia Truong (https://github.com/ttnghia)

URL: #21735
)

Moves a device function defined in `cpp/include/cudf/detail/unary.hpp` to new `cpp/src/unary/true_if.cuh` and update internal includes appropriately.
The device function defined in a .hpp is unexpected and not needed to be available outside of the `cpp/src/unary` folder.
Also removes the `CUDF_EXPORT` from the `detail/unary.hpp` declarations.

Authors:
  - David Wendt (https://github.com/davidwendt)

Approvers:
  - Bradley Dice (https://github.com/bdice)
  - Nghia Truong (https://github.com/ttnghia)

URL: #21717
Adds support for the `COUNT_ALL` and `COUNT_VALID` aggregation types to the `cudf::scan` API.
This is only available for INCLUSIVE_SCAN and is 1-based like its counterpart in groupby-scan.

Closes #8710

Authors:
  - David Wendt (https://github.com/davidwendt)

Approvers:
  - Lawrence Mitchell (https://github.com/wence-)
  - Nghia Truong (https://github.com/ttnghia)

URL: #21565
Update the PDSH benchmarks to support `--cluster=spmd` runs.

Run using something like:
```bash 
rrun -n 2 python \
  python/cudf_polars/cudf_polars/experimental/benchmarks/pdsh.py \
  --executor=streaming \
  --suffix="" \
  --spill-device=0.5 \
  --shuffle=rapidsmpf \
  --runtime=rapidsmpf \
  --stream-policy=pool \
  --no-print-results --no-summarize \
  --iterations=10 \
  --path /datasets/datasets/tpch-rs/scale-10 \
  --cluster spmd \
  1
```

Authors:
  - Mads R. B. Kristensen (https://github.com/madsbk)

Approvers:
  - Tom Augspurger (https://github.com/TomAugspurger)

URL: #21652
This pull-request adds functions to aid benchmarking of CUDF's JIT functions for the `cold` and `hot` JIT compilation states.

Follows up #18023

xref Useful for benchmarking JIT in polars #21456

Authors:
  - Basit Ayantunde (https://github.com/lamarrr)
  - https://github.com/apps/pre-commit-ci

Approvers:
  - Matthew Murray (https://github.com/Matt711)
  - David Wendt (https://github.com/davidwendt)
  - Yunsong Wang (https://github.com/PointKernel)

URL: #21553
@AyodeAwe
AyodeAwe requested review from a team as code owners March 11, 2026 18:00
@AyodeAwe
AyodeAwe requested review from Matt711, bdice and devavret and removed request for a team March 11, 2026 18:00
@AyodeAwe
AyodeAwe merged commit 36fc4e4 into pandas3 Mar 11, 2026
48 checks passed
@AyodeAwe

Copy link
Copy Markdown
Contributor Author

SUCCESS - forward-merge complete (automated).

@github-actions github-actions Bot added libcudf Affects libcudf (C++/CUDA) code. Python Affects Python cuDF API. CMake CMake build issue cudf-polars Issues specific to cudf-polars labels Mar 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CMake CMake build issue cudf-polars Issues specific to cudf-polars libcudf Affects libcudf (C++/CUDA) code. Python Affects Python cuDF API.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants