Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move PartitionEvaluator and window_state structures to datafusion_expr crate #6690

Merged
merged 5 commits into from
Jun 21, 2023

Conversation

alamb
Copy link
Contributor

@alamb alamb commented Jun 15, 2023

Which issue does this PR close?

Part of #5781

Rationale for this change

We are in the process of allowing users to define their own window functions, and to do we plan for them to implement the PartitionEvaluator trait, similarly to how they implement the Accumulator trait for aggregates

You can see the basic idea in the RFC PR: #6617

I think this is the last "getting ready" PR and the next one will have real support for User Defined Window Functions 🤞

What changes are included in this PR?

Move PartitionEvaluator and related structures to datafusion_expr crate (where the WindowUDFs will be defined)

There is no new functionality, this PR just moves code around.

Are these changes tested?

Covered by existing tests

Are there any user-facing changes?

PartitionEvaluator and related structs are now visible in datafusion_expr

@github-actions github-actions bot added core Core DataFusion crate logical-expr Logical plan and expressions physical-expr Physical Expressions labels Jun 15, 2023
@alamb alamb changed the title Move PartitonEvaluator and window_state structures to datafusion_expr crate Move PartitionEvaluator and window_state structures to datafusion_expr crate Jun 16, 2023
@alamb
Copy link
Contributor Author

alamb commented Jun 20, 2023

@mustafasrepo I wonder if I can trouble you for a review of this PR? I think it is straightforward

Copy link
Contributor

@mustafasrepo mustafasrepo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This PR is LGTM!. Thanks @alamb. Also it was weird to have impl WindowAggStates scattered, thanks for combining them on the way.

@mustafasrepo mustafasrepo merged commit 3c304e0 into apache:main Jun 21, 2023
20 checks passed
@alamb alamb deleted the alamb/move_partition_evaluator branch June 21, 2023 18:13
This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core Core DataFusion crate logical-expr Logical plan and expressions physical-expr Physical Expressions
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants