Use owning Arrow types in C++ to expose data to Python - #18402

Merged

rapids-bot[bot] merged 46 commits into

NVIDIA:branch-25.06from

vyasr:feat/arrow_data_structures_python

Apr 16, 2025

Commits on Apr 1, 2025

First pass of using the new APIs
vyasr
committed
24b1f68
Fix some C++ API docs
vyasr
committed
a09a31d
Remove now unused APIs
vyasr
committed
5d2884c
Don't call release manually anymore
vyasr
committed
b4760ac
Move table to arrow interop functions to Table class via capsule
vyasr
committed
72ef25d
Move from_arrow table interop to Table constructor overload
vyasr
committed
4bafc1f
Move column from_arrow logic to constructor
vyasr
committed
17ce423
Add missing support for empty type
vyasr
committed
2c65d72
Properly handle length 0 list columns when importing
vyasr
committed
94a2c02
Support modifying struct field names when exporting via to_arrow
vyasr
committed
c5cd26b
One more fix for empty type
vyasr
committed
219a506
Change null_count API to accept a gpumemoryview instead of a pointer and use that to fix invalid test
vyasr
committed
6edcf13
Remove invalid access to gpumemoryview.obj
vyasr
committed
c89c86b
Fix a few more places that need to handle EMPTY
vyasr
committed
bbbc422
Update one more use of null_count to match the updated API signature
vyasr
committed
83b6b92
One more handling of EMPTY types
vyasr
committed
e2df6b3
Fix various typos in null type handling
vyasr
committed
a820a6c
Revert "Remove invalid access to gpumemoryview.obj"
vyasr
committed
8ba32e3
Wrap column views in objects that expose the CUDA array interface and use those to construct gpumemoryviews safely
vyasr
committed
69fd71f
Update pytest-benchmark bound
vyasr
committed
08ae13a
Add a benchmark using pyarrow for construction
vyasr
committed
2197a21
Fix comments
vyasr
committed
3eb72ee
More comments
vyasr
committed
f07f8cb

Commits on Apr 9, 2025

Merge remote-tracking branch 'upstream/branch-25.06' into feat/arrow_data_structures_python
vyasr
committed
b226766
Expose the protocol for columns as well and make column implementation independent of table
vyasr
committed
281ece3
Centralize common interop functions
vyasr
committed
b3f29eb
Rename to _interop_helpers
vyasr
committed
db92c88
Some cleanup and commenting
vyasr
committed
7beecf6
Fix cudf Python chunk expectations
vyasr
committed
7c917a2
Merge remote-tracking branch 'upstream/branch-25.06' into feat/arrow_data_structures_python
vyasr
committed
04e37b4

Commits on Apr 10, 2025

Add one more include of dlpack
vyasr
committed
1e4e37e
Typo
vyasr
committed
e26bd3c
More targets
vyasr
committed
a6b8284
Fix prefetching for EMPTY
vyasr
committed
83acdcc
Merge remote-tracking branch 'upstream/branch-25.06' into feat/arrow_data_structures_python
vyasr
committed
05a0806
New envs need updates
vyasr
committed
a141d21

Commits on Apr 15, 2025

Merge remote-tracking branch 'upstream/branch-25.06' into feat/arrow_data_structures_python
vyasr
committed
5e7ff46
Add helper function for empty columns
vyasr
committed
1710d4e
Add missing throw
vyasr
committed
b7ee1bf
Switch to uintptr_t
vyasr
committed
932b0ad
Rename cudf_object to plc_object
vyasr
committed
fd5ab31
Add comments on inline C++
vyasr
committed
3176f39
Remove redundant is_fixed_point check
vyasr
committed
457f677
Minor cleanup
vyasr
committed
bb8a2f0
Merge remote-tracking branch 'upstream/branch-25.06' into feat/arrow_data_structures_python
vyasr
committed
33b3cc8
Fix incomplete replacement
vyasr
committed
1a3197c