Skip to content

Unify grouped execution properties#14886

Merged
rschlussel merged 3 commits intoprestodb:masterfrom
rschlussel:unify-grouped-execution
Jul 27, 2020
Merged

Unify grouped execution properties#14886
rschlussel merged 3 commits intoprestodb:masterfrom
rschlussel:unify-grouped-execution

Conversation

@rschlussel
Copy link
Contributor

@rschlussel rschlussel commented Jul 24, 2020

Turn grouped execution on by default and introduce a new property grouped_execution to eventually replace all other grouped execution properties

#14885

== RELEASE NOTES ==
General Changes
* Enable ``dynamic-schedule-for-grouped-execution`` by default.  In future releases, we will remove this property, and grouped execution will always use dynamic scheduling.
* Enable ``grouped-execution-for-aggregation`` and ``experimental.grouped-execution-for-eligible-table-scans`` by default
* Introduce new configuration property ``grouped-execution-enabled`` and session property ``grouped_execution`` to turn grouped execution on or off.  This property is true by default.  If set to false, it is equivalent to setting all of ``grouped-execution-for-aggregation``, ``grouped-execution-for-join``, and ``experimental.grouped-execution-for-eligible-table-scans`` to false.  In future releases we will remove these other properties and only have a single switch for enabling and disabling grouped execution.

@rschlussel rschlussel changed the title Unify grouped execution Unify grouped execution properties Jul 24, 2020
@rschlussel rschlussel requested a review from a team July 24, 2020 18:31
Copy link
Contributor

@viczhang861 viczhang861 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is extra space for release note.

@rschlussel rschlussel force-pushed the unify-grouped-execution branch from 33edfb7 to 7d3eaa5 Compare July 27, 2020 15:43
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Personally I would prefer to disable the grouped execution for local query runner explicitly (or at least explicitly check for the forceSinceNode flag).

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated to check the forceSingleNode flag

Grouped execution is not supported for SystemPartitioningHandles, and
will fail gettting the bucket node map. forceSingleNode uses
SystemPartitioningHandle.SINGLE_DISTRIBUTION as the partitioning.
Add grouped-execution-enabled property to replace
grouped-execution-for-aggregation-enabled,
grouped-execution-for-join-enabled,
grouped-execution-for-eligible-tablescans-enabled.  These other
properties will be removed in a future release.
@rschlussel rschlussel force-pushed the unify-grouped-execution branch from 7d3eaa5 to 9ff7709 Compare July 27, 2020 16:04
@rschlussel rschlussel merged commit 7cb1d7a into prestodb:master Jul 27, 2020
@caithagoras caithagoras mentioned this pull request Jul 28, 2020
13 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants