Skip to content

Add missing support for bucket sort order in Glue#1870

Merged
sopel39 merged 1 commit intotrinodb:masterfrom
starburstdata:ks/missing_glue_support
Feb 22, 2020
Merged

Add missing support for bucket sort order in Glue#1870
sopel39 merged 1 commit intotrinodb:masterfrom
starburstdata:ks/missing_glue_support

Conversation

@sopel39
Copy link
Member

@sopel39 sopel39 commented Oct 25, 2019

No description provided.

@sopel39 sopel39 requested a review from electrum October 25, 2019 19:59
@cla-bot cla-bot bot added the cla-signed label Oct 25, 2019
@sopel39
Copy link
Member Author

sopel39 commented Oct 25, 2019

We should add Glue tests for these too

@findepi
Copy link
Member

findepi commented Oct 26, 2019

We should add Glue tests for these too

there is TestHiveGlueMetastore
maybe it can be adapted for these needs.

@sopel39 sopel39 requested review from anusudarsan and findepi and removed request for electrum February 22, 2020 13:08
@sopel39 sopel39 requested review from dain and removed request for anusudarsan February 22, 2020 13:09
sd.setOutputFormat(storage.getStorageFormat().getOutputFormatNullable());
sd.setParameters(ImmutableMap.of());

Optional<HiveBucketProperty> bucketProperty = storage.getBucketProperty();
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

use this var in the next line

@findepi
Copy link
Member

findepi commented Feb 22, 2020

AFAICT we respect bucket sort order when reading glue table, but worth double checking.

@sopel39 sopel39 force-pushed the ks/missing_glue_support branch from 6ac8e3e to 9eed313 Compare February 22, 2020 20:22
@sopel39
Copy link
Member Author

sopel39 commented Feb 22, 2020

AFAICT we respect bucket sort order when reading glue table, but worth double checking.

Yes, we do: io.prestosql.plugin.hive.metastore.glue.converter.GlueToPrestoConverter#setStorageBuilder

@sopel39 sopel39 force-pushed the ks/missing_glue_support branch from 9eed313 to add2034 Compare February 22, 2020 20:26
Support for bucket sort order was missing in Glue
when table or partition was created or updated.
@sopel39 sopel39 force-pushed the ks/missing_glue_support branch from add2034 to 4e3a29b Compare February 22, 2020 20:27
@sopel39 sopel39 merged commit c31ed4f into trinodb:master Feb 22, 2020
@sopel39 sopel39 deleted the ks/missing_glue_support branch February 22, 2020 20:28
@sopel39 sopel39 mentioned this pull request Feb 22, 2020
6 tasks
v-jizhang added a commit to v-jizhang/presto that referenced this pull request Apr 26, 2021
Cherry pick of trinodb/trino#1870.

Co-authored-by: Karol Sobczak <karol.sobczak@karolsobczak.com>
highker pushed a commit to prestodb/presto that referenced this pull request May 20, 2021
Cherry pick of trinodb/trino#1870.

Co-authored-by: Karol Sobczak <karol.sobczak@karolsobczak.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

3 participants