Skip to content

[native]: Add operator override for xxhash64, combine_hash internal functions#24503

Merged
aditi-pandit merged 1 commit intoprestodb:masterfrom
pradeepvaka:export-D68917161
Feb 6, 2025
Merged

[native]: Add operator override for xxhash64, combine_hash internal functions#24503
aditi-pandit merged 1 commit intoprestodb:masterfrom
pradeepvaka:export-D68917161

Conversation

@pradeepvaka
Copy link
Contributor

@pradeepvaka pradeepvaka commented Feb 5, 2025

Summary: Add operator override for xxhash64 and combine_hash internal operators to unblock join prefilter optimization for Presto native execution.

Differential Revision: D68917161

@pradeepvaka pradeepvaka requested a review from a team as a code owner February 5, 2025 19:24
@linux-foundation-easycla
Copy link

linux-foundation-easycla bot commented Feb 5, 2025

CLA Signed

The committers listed above are authorized under a signed CLA.

  • ✅ login: pradeepvaka / name: Pradeep Vaka (660432e)

@facebook-github-bot
Copy link
Collaborator

This pull request was exported from Phabricator. Differential Revision: D68917161

@facebook-github-bot
Copy link
Collaborator

This pull request was exported from Phabricator. Differential Revision: D68917161

@aditi-pandit aditi-pandit changed the title Add operator override for xxhash64, combine_hash internal functions native: Add operator override for xxhash64, combine_hash internal functions Feb 6, 2025
Copy link
Contributor

@aditi-pandit aditi-pandit left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @pradeepvaka

@aditi-pandit aditi-pandit changed the title native: Add operator override for xxhash64, combine_hash internal functions [native]: Add operator override for xxhash64, combine_hash internal functions Feb 6, 2025
@aditi-pandit aditi-pandit merged commit 391541a into prestodb:master Feb 6, 2025
63 checks passed
@aditi-pandit
Copy link
Contributor

@pradeepvaka : I approved and merged this PR. But I presume you have a bigger PR showing the e2e optimization in native engine. Is that ready yet ?

@pradeepvaka
Copy link
Contributor Author

@aditi-pandit thanks for approval. Join prefilter optimization already exists in Presto but the xxhash_64 and combine_hash internal operators were missing on native. These internal operators were added to velox and the overrides are updated in the commit for e2e to work.

https://github.com/prestodb/presto/blob/391541a831bdcd0b65d3ebb361b8324019977f0b/presto-main/src/main/java/com/facebook/presto/sql/planner/optimizations/JoinPrefilter.java#L116C1-L132C4

@aditi-pandit
Copy link
Contributor

@pradeepvaka : Got you. Can you add some tests in https://github.com/prestodb/presto/blob/master/presto-native-execution/src/test/java/com/facebook/presto/nativeworker/AbstractTestNativeJoinQueries.java that will set and test "JOIN_PREFILTER_BUILD_SIDE" system property ?

jp-sivaprasad pushed a commit to jp-sivaprasad/presto that referenced this pull request Mar 10, 2025
@prestodb-ci prestodb-ci mentioned this pull request Mar 28, 2025
30 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants