Skip to content

Add flags to disable spill for distinct and order by aggregations#16250

Merged
rschlussel merged 2 commits intoprestodb:masterfrom
rschlussel:disable-distinct-spill
Jun 14, 2021
Merged

Add flags to disable spill for distinct and order by aggregations#16250
rschlussel merged 2 commits intoprestodb:masterfrom
rschlussel:disable-distinct-spill

Conversation

@rschlussel
Copy link
Contributor

Added flags to disable spilling for distinct and order by aggregations since with spill enabled, they can cause queries to use more memory than without spilling. Left the features enabled by default to maintain previous behavior.

Test plan - unit test

== RELEASE NOTES ==

General Changes
* Add configuration property ``experimental.distinct-aggregation-spill-enabled`` and session property ``distinct_aggregation_spill_enabled`` to disable spilling for distinct aggregations
* Add configuration property ``experimental.order-by-aggregation-spill-enabled`` and session property ``order_by_aggregation_spill_enabled`` to disable spilling for order by aggregations

methods should be lower camel case, and tests should begin with the
word "test"
Queries can sometimes use more memory in distinct and order by
aggregations when spill is enabled compared to when it isn't.  Until
this is fixed we want to be able to disable those features and still
have other operator spilling happen.
@rschlussel rschlussel requested review from a team and highker June 11, 2021 15:26
@rschlussel rschlussel changed the title Disable distinct spill Add flags to disable spill for distinct and order by aggregations Jun 11, 2021
@rschlussel rschlussel merged commit b0e1b0b into prestodb:master Jun 14, 2021
@mayankgarg1990 mayankgarg1990 mentioned this pull request Jun 18, 2021
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants