Skip to content

Fix Handling of Aggregation Expressions in Pinot Passthrough Queries#9781

Merged
hashhar merged 5 commits intotrinodb:masterfrom
elonazoulay:pinot-0.8.0-aggregation_expressions
Mar 19, 2022
Merged

Fix Handling of Aggregation Expressions in Pinot Passthrough Queries#9781
hashhar merged 5 commits intotrinodb:masterfrom
elonazoulay:pinot-0.8.0-aggregation_expressions

Conversation

@elonazoulay
Copy link
Copy Markdown
Member

Also includes some minor code cleanup.
Based off of #9098

@alec-heif
Copy link
Copy Markdown
Contributor

is there any update to this PR? my org would find this pretty useful

@elonazoulay
Copy link
Copy Markdown
Member Author

Yes, will be updating shortly.

@elonazoulay elonazoulay force-pushed the pinot-0.8.0-aggregation_expressions branch from 9d77b77 to 8436f89 Compare December 16, 2021 09:03
@elonazoulay
Copy link
Copy Markdown
Member Author

Fixes #10148

@mapshen
Copy link
Copy Markdown

mapshen commented Jan 5, 2022

Any chance this can get into the 368 release?

@mapshen
Copy link
Copy Markdown

mapshen commented Jan 31, 2022

@ebyhr @hashhar possible for you to review this? This fixes #10148. Thanks!

@elonazoulay elonazoulay force-pushed the pinot-0.8.0-aggregation_expressions branch 3 times, most recently from fa2dac2 to aea36fd Compare February 8, 2022 19:33
@hashhar hashhar self-assigned this Feb 15, 2022
@elonazoulay elonazoulay force-pushed the pinot-0.8.0-aggregation_expressions branch 2 times, most recently from 8178c73 to 56d842e Compare March 11, 2022 22:34
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

context.getIdentifierQuote() is identity, right? is it OK?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's ok: the DynamicTablePqlExtractor quotes identifiers.

@elonazoulay elonazoulay force-pushed the pinot-0.8.0-aggregation_expressions branch from 56d842e to 45a8c8b Compare March 15, 2022 09:36
Copy link
Copy Markdown
Member

@hashhar hashhar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM "Simplify logic for generating Pinot ColumnMetadata"

Copy link
Copy Markdown
Member

@hashhar hashhar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"Fix handling of complex aggregate expressions in Pinot passthrough queries".

(just over length limit commit message, reword)

hashhar
hashhar previously approved these changes Mar 15, 2022
Copy link
Copy Markdown
Member

@hashhar hashhar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"Cleanup various minor issues in the Pinot Connector" - reword to indicate these are not "issues" - just refactors.

Copy link
Copy Markdown
Member

@hashhar hashhar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"Fix Pinot aggregate functions with mixed case columns" -> mixed case column names

Some comments, mostly stylistic + comment from Piotr already about the identifier quote - even though pre-existing. IIUC the quote here may not matter since Pinot library performs quoting of literal values for us - but not sure about column names.

@hashhar hashhar dismissed their stale review March 15, 2022 17:28

mistakenly approved early

@hashhar hashhar requested a review from grantatspothero March 15, 2022 17:29
@elonazoulay elonazoulay force-pushed the pinot-0.8.0-aggregation_expressions branch from 9f62e75 to dac3cd5 Compare March 16, 2022 02:45
@elonazoulay elonazoulay requested review from findepi and hashhar March 16, 2022 03:20
@elonazoulay elonazoulay force-pushed the pinot-0.8.0-aggregation_expressions branch from dac3cd5 to 2e2e979 Compare March 16, 2022 03:23
@elonazoulay elonazoulay force-pushed the pinot-0.8.0-aggregation_expressions branch from 2e2e979 to cfb4ad7 Compare March 16, 2022 17:27
Directly create ColumnMetadata from Pinot FieldSpecs.
Create PinotColumnHandles from ColumnMetadata in getColumnHandles.

Previously a PinotColumnHandle was created which would be turned into
ColumnMetadata and then converted back to PinotColumnHandle.
@elonazoulay elonazoulay force-pushed the pinot-0.8.0-aggregation_expressions branch from cfb4ad7 to fd8d1c6 Compare March 16, 2022 17:39
Copy link
Copy Markdown
Member

@hashhar hashhar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM % some final comments

@elonazoulay elonazoulay force-pushed the pinot-0.8.0-aggregation_expressions branch from fd8d1c6 to 090ce8a Compare March 18, 2022 21:17
@hashhar hashhar merged commit 86cbe36 into trinodb:master Mar 19, 2022
@github-actions github-actions bot added this to the 375 milestone Mar 19, 2022
@hashhar hashhar mentioned this pull request Mar 20, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

5 participants