Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

#793: Added support for Pandas 2 pyarrow dtype columns for emitting data from Python UDFs #357

Merged
merged 13 commits into from
Jun 1, 2023

Conversation

tkilias
Copy link
Collaborator

@tkilias tkilias commented May 4, 2023

@tkilias tkilias force-pushed the feature/793_update_to_pandas_2 branch from 1bce18c to d01a24f Compare May 16, 2023 13:35
@tkilias tkilias force-pushed the feature/793_update_to_pandas_2 branch from 6e3a5f8 to 0ad7c51 Compare May 17, 2023 13:59
pyValue.reset(PyObject_Str(pyFloat.get()));
break;
case SWIGVMContainers::DOUBLE:
pyValue.reset(pyFloat.release());
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The old implementation used also PyFloat_FromDouble().
And if you change this, should you also check for an error like above for the int case?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ähm, here we don't do any conversion, we only set pyValue to the value of pyFloat. pyValue will be then emitted.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tomuben
tomuben previously approved these changes May 31, 2023
@tkilias tkilias changed the title #793: Update Pandas package to version 2.0 in standard 8.0 flavor and the template flavors #793: Update Pandas package to version 2.0 in the template flavors Jun 1, 2023
@tkilias tkilias changed the title #793: Update Pandas package to version 2.0 in the template flavors #793: Update Pandas package to version 2.0 in the template flavors and add pyarrow dtype support Jun 1, 2023
@tkilias tkilias changed the title #793: Update Pandas package to version 2.0 in the template flavors and add pyarrow dtype support #793: Updated Pandas package to version 2.0 in the template flavors and added pyarrow dtype support Jun 1, 2023
@tkilias tkilias changed the title #793: Updated Pandas package to version 2.0 in the template flavors and added pyarrow dtype support #793: Added support for Pandas 2 pyarrow dtype columns for emitting data from Python UDFs Jun 1, 2023
@tkilias tkilias enabled auto-merge (squash) June 1, 2023 08:03
@tkilias tkilias merged commit 433f064 into master Jun 1, 2023
@tkilias tkilias deleted the feature/793_update_to_pandas_2 branch June 1, 2023 09:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants