Skip to content

[native] Disable partial aggregation over system table scan#21725

Merged
arhimondr merged 2 commits intoprestodb:masterfrom
arhimondr:native-system-connector-pushdown
Jan 19, 2024
Merged

[native] Disable partial aggregation over system table scan#21725
arhimondr merged 2 commits intoprestodb:masterfrom
arhimondr:native-system-connector-pushdown

Conversation

@arhimondr
Copy link
Member

@arhimondr arhimondr commented Jan 18, 2024

Description

Avoid pushing down aggregations to a coordinator scheduled fragment (system table scan) that runs in Java.

Partial aggregation output is not binary compatible between Presto Java and Prestissimo.

Motivation and Context

In #21285 an extra exchange was introduced to minimize the scope of operations run on coordinator. However past AddExchanges partial aggregation can be pushed down.

Test Plan

Integration tests provided

Contributor checklist

  • Please make sure your submission complies with our development, formatting, commit message, and attribution guidelines.
  • PR description addresses the issue accurately and concisely. If the change is non-trivial, a GitHub Issue is referenced.
  • Documented new properties (with its default value), SQL syntax, functions, or other functionality.
  • If release notes are required, they follow the release notes guidelines.
  • Adequate tests were added if applicable.
  • CI passed.

Release Notes

Please follow release notes guidelines and fill in the release notes below.

== NO RELEASE NOTE ==

@arhimondr arhimondr requested review from a team as code owners January 18, 2024 16:53
@arhimondr arhimondr requested review from mbasmanova, mlyublena and presto-oss and removed request for presto-oss January 18, 2024 16:53
@arhimondr arhimondr force-pushed the native-system-connector-pushdown branch from 2bb3f18 to f86ae2b Compare January 18, 2024 17:03
@arhimondr arhimondr changed the title Avoid problematic pushdowns when native execution is on [native] Disable partial aggregation over system table scan Jan 18, 2024
Copy link
Contributor

@mbasmanova mbasmanova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for a quick fix.

@arhimondr arhimondr force-pushed the native-system-connector-pushdown branch 3 times, most recently from a0bdac3 to 6d37688 Compare January 18, 2024 21:16
Follow up of prestodb#21285

Partial aggregation output might not be compatible between Java
and C++ implementations
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants