Skip to content

Fix Pinot aggregation pushdown for subqueries#12653

Merged
kokosing merged 4 commits intotrinodb:masterfrom
elonazoulay:fix_agg_pushdown
Apr 19, 2023
Merged

Fix Pinot aggregation pushdown for subqueries#12653
kokosing merged 4 commits intotrinodb:masterfrom
elonazoulay:fix_agg_pushdown

Conversation

@elonazoulay
Copy link
Copy Markdown
Member

@elonazoulay elonazoulay commented Jun 2, 2022

Description

Is this change a fix, improvement, new feature, refactoring, or other?

Is this a change to the core query engine, a connector, client library, or the SPI interfaces? (be specific)

How would you describe this change to a non-technical end user or system administrator?

Related issues, pull requests, and links

Documentation

( ) No documentation is needed.
( ) Sufficient documentation is included in this PR.
( ) Documentation PR is available with #prnumber.
( ) Documentation issue #issuenumber is filed, and can be handled later.

Release notes

( ) No release notes entries required.
( ) Release notes entries required with the following suggested text:

# Section
* Fix some things. ({issue}`issuenumber`)

@cla-bot cla-bot bot added the cla-signed label Jun 2, 2022
@elonazoulay elonazoulay changed the title Fix agg pushdown Fix Pinot aggregation pushdown for subqueries Jun 2, 2022
@elonazoulay
Copy link
Copy Markdown
Member Author

elonazoulay commented Jun 2, 2022

Fixes #12655

@elonazoulay elonazoulay requested a review from hashhar June 2, 2022 18:05
@findepi findepi requested a review from wendigo June 5, 2022 20:27
martint
martint reviewed Jun 14, 2022
View reviewed changes
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotMetadata.java Outdated
Copy link
Copy Markdown
Member

@martint martint Jun 14, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can aggregates be empty at this point?

Copy link
Copy Markdown
Member Author

@elonazoulay elonazoulay Mar 30, 2023 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Now aggregates would only contain 1 aggregate.

@martint martint self-requested a review June 14, 2022 18:52
@xiangfu0
Copy link
Copy Markdown
Contributor

xiangfu0 commented Jun 23, 2022

Thanks for fixing this bug!

@elonazoulay elonazoulay requested a review from xiangfu0 June 27, 2022 04:55
@elonazoulay elonazoulay requested a review from xiangfu0 July 19, 2022 00:58
@ellieshen
Copy link
Copy Markdown

ellieshen commented Feb 27, 2023

@elonazoulay when can this pull be merged?

@elonazoulay
Copy link
Copy Markdown
Member Author

elonazoulay commented Mar 30, 2023

Resolves #9134

@elonazoulay elonazoulay mentioned this pull request Mar 30, 2023
Open
@elonazoulay elonazoulay force-pushed the fix_agg_pushdown branch 4 times, most recently from f85aab4 to cb49aa2 Compare April 1, 2023 03:09
kokosing
kokosing reviewed Apr 6, 2023
View reviewed changes
.../trino-pinot/src/test/java/io/trino/plugin/pinot/BasePinotIntegrationConnectorSmokeTest.java Outdated
Copy link
Copy Markdown
Member

@kokosing kokosing Apr 6, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

use """

Copy link
Copy Markdown
Member Author

@elonazoulay elonazoulay Apr 14, 2023 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done. Noticed that using formatted(...) disables the SQL formatting so the table names are hardcoded. Seems to be similar to other use cases, lmk if you prefer using formatted(tableName).

plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotMetadata.java Outdated
Copy link
Copy Markdown
Member

@kokosing kokosing Apr 6, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it looks like this method does things that do not match what the name suggests (see pattern matching implementCountDistinct.getPattern().matches()

Copy link
Copy Markdown
Member Author

@elonazoulay elonazoulay Apr 15, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lmk if the new name is ok: isAggregationPushdownSupported. Thanks for all the advice!

@sumit-gupta-sgt
Copy link
Copy Markdown

sumit-gupta-sgt commented Apr 10, 2023 •
edited
Loading

@elonazoulay @hashhar when can this pull be merged?

@elonazoulay elonazoulay requested a review from kokosing April 14, 2023 18:19
@elonazoulay elonazoulay requested a review from findepi April 16, 2023 03:42
kokosing
kokosing approved these changes Apr 16, 2023
View reviewed changes
kokosing
kokosing approved these changes Apr 16, 2023
View reviewed changes
Copy link
Copy Markdown
Member

@kokosing kokosing left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

% minor comments

@github-actions github-actions bot added the docs label Apr 17, 2023
@elonazoulay elonazoulay requested a review from kokosing April 17, 2023 22:40
@kokosing kokosing merged commit 4c0e62c into trinodb:master Apr 19, 2023
@kokosing
Copy link
Copy Markdown
Member

kokosing commented Apr 19, 2023

Thank you!

@github-actions github-actions bot added this to the 414 milestone Apr 19, 2023
@colebow colebow mentioned this pull request Apr 19, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@kokosing kokosing kokosing approved these changes

@hashhar hashhar Awaiting requested review from hashhar

@wendigo wendigo Awaiting requested review from wendigo

@martint martint Awaiting requested review from martint

@xiangfu0 xiangfu0 Awaiting requested review from xiangfu0

@findepi findepi Awaiting requested review from findepi

Assignees

No one assigned

Labels

cla-signed docs

Milestone

414

Development

Successfully merging this pull request may close these issues.

6 participants

@elonazoulay @xiangfu0 @ellieshen @sumit-gupta-sgt @kokosing @martint