Add support for MaxResults on Glue Hive Metastore#16012
Add support for MaxResults on Glue Hive Metastore#16012pettyjamesm merged 1 commit intoprestodb:masterfrom
Conversation
aweisberg
left a comment
There was a problem hiding this comment.
Hard coded values gives me slight pause, but it's in production in Trino and no one is complaining so I will +1 it.
This is metadata so I assume a constant metadata fetch size is acceptable although if it includes statistics it seems like it might be a value people want to change?
|
@pettyjamesm do you have an opinion on this being hard coded? Would you mind merging if you think it is acceptable. |
|
I saw this change in Trino after it had merged. I tried to reproduce the described behavior but what I saw seemed to indicate that setting this value actually has no effect and that there's some other implementation detail on the Glue end that actually determines how many partitions will be included in any given response. That said, hard coding a value should be harmless enough: I can't think of a use case that would want any less than the maximum partitions per response and the maximum allowed values for APIs like this tend not to change all that often. |
|
@pettyjamesm feel free to merge if you approve :-) |
The Facebook Integration step not being completed means that this PR hasn't met the "all checks must pass" criteria to merge. Is that something you can trigger on your side or will this PR need to be force-pushed to re-run? |
Cherry pick of trinodb/trino#3024 and trinodb/trino#4938 Co-authored-by: Istvan <istvan@lambdainsight.com> Co-authored-by: Ashhar Hasan <hashhar_dev@outlook.com>
|
Updated to see if that will trigger an integration build. I think there is almost no chance it would do that, but not worth risking. |
|
Merged, thanks! |
This PR introduces optimizer rules for column pruning and redundant node pruning of TableFunctionProcessorNode. Changes adapted from trino/PR#16012 Author: kasiafi Co-authored-by: kasiafi <30203062+kasiafi@users.noreply.github.com> Co-authored-by: Xin Zhang <desertsxin@gmail.com>
Cherry pick of trinodb/trino#3024 and
trinodb/trino#4938
Co-authored-by: Istvan istvan@lambdainsight.com
Co-authored-by: Ashhar Hasan hashhar_dev@outlook.com