Skip to content

pylibcudf.Column: add device_buffer_size and register a dask.sizeof function for cudf-polars Column and DataFrame#18602

Merged
rapids-bot[bot] merged 21 commits intorapidsai:branch-25.06from
madsbk:sizeof_polars_dataframe
May 6, 2025
Merged

pylibcudf.Column: add device_buffer_size and register a dask.sizeof function for cudf-polars Column and DataFrame#18602
rapids-bot[bot] merged 21 commits intorapidsai:branch-25.06from
madsbk:sizeof_polars_dataframe

Conversation

@madsbk
Copy link
Member

@madsbk madsbk commented Apr 30, 2025

This is used by RAPIDSMPF's approx_spillable_amount.

To simplify, moved all the dask registration (incl. the serializers) into dask_registers.py

@madsbk madsbk added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change cudf-polars Issues specific to cudf-polars labels Apr 30, 2025
@madsbk madsbk self-assigned this Apr 30, 2025
@copy-pr-bot
Copy link

copy-pr-bot bot commented Apr 30, 2025

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@github-actions github-actions bot added the Python Affects Python cuDF API. label Apr 30, 2025
@madsbk madsbk force-pushed the sizeof_polars_dataframe branch from 0a5c342 to 5183e35 Compare May 1, 2025 07:17
@madsbk madsbk force-pushed the sizeof_polars_dataframe branch from 7ba07c8 to a589761 Compare May 1, 2025 10:32
@madsbk madsbk marked this pull request as ready for review May 1, 2025 11:19
@madsbk madsbk requested a review from a team as a code owner May 1, 2025 11:19
@madsbk madsbk requested review from Matt711 and wence- May 1, 2025 11:19
@madsbk madsbk requested a review from wence- May 1, 2025 12:50
@github-actions github-actions bot added the pylibcudf Issues specific to the pylibcudf package label May 2, 2025
@madsbk madsbk changed the title Register a dask.sizeof function for Polars Column and DataFrame pylibcudf.Column: add device_buffer_size and register a dask.sizeof function for cudf-polars Column and DataFrame May 2, 2025
Co-authored-by: Lawrence Mitchell <wence@gmx.li>
madsbk and others added 2 commits May 2, 2025 12:22
@madsbk madsbk requested a review from wence- May 2, 2025 11:15
Co-authored-by: Lawrence Mitchell <wence@gmx.li>
@madsbk madsbk requested a review from wence- May 2, 2025 15:42
@madsbk
Copy link
Member Author

madsbk commented May 6, 2025

/merge

@rapids-bot rapids-bot bot merged commit 545d2a0 into rapidsai:branch-25.06 May 6, 2025
109 checks passed
vyasr added a commit to vyasr/cudf that referenced this pull request May 6, 2025
…k.sizeof function for cudf-polars Column and DataFrame (rapidsai#18602)"

This reverts commit 545d2a0.
@madsbk madsbk deleted the sizeof_polars_dataframe branch May 16, 2025 11:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cudf-polars Issues specific to cudf-polars improvement Improvement / enhancement to an existing function non-breaking Non-breaking change pylibcudf Issues specific to the pylibcudf package Python Affects Python cuDF API.

Projects

Archived in project

Development

Successfully merging this pull request may close these issues.

2 participants