-
Notifications
You must be signed in to change notification settings - Fork 78
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feature: Additional export methods #236
Conversation
examples/export.py
Outdated
# export to Polars dataframe | ||
polars_df = pl.DataFrame(df.to_arrow_table()) | ||
assert polars_df.shape == (3, 2) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do you think it's worthwhile introducing a to_polars()
helper function?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, I think that would be great
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the feedback - added to_polars()
method & unit tests for it
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This looks great. Thanks @simicd
Which issue does this PR close?
Closes #234
Closes #235
Rationale for this change
Implement additional export functions and fix bug if datafusion dataframe is empty
What changes are included in this PR?
to_arrow_table()
,to_pylist()
andto_pydict()
Are there any user-facing changes?
See above