Skip to content

Skip empty bucket creation by default#1375

Merged
findepi merged 1 commit intotrinodb:masterfrom
findepi:findepi/master/skip-empty-bucket-creation-by-default-10e0c0
Jun 20, 2020
Merged

Skip empty bucket creation by default#1375
findepi merged 1 commit intotrinodb:masterfrom
findepi:findepi/master/skip-empty-bucket-creation-by-default-10e0c0

Conversation

@findepi
Copy link
Member

@findepi findepi commented Aug 26, 2019

Hive on Tez does not create them, so other readers support that by
necessity.

@cla-bot cla-bot bot added the cla-signed label Aug 26, 2019
@findepi findepi force-pushed the findepi/master/skip-empty-bucket-creation-by-default-10e0c0 branch from 3867e12 to 20a6bb9 Compare January 10, 2020 18:01
@findepi findepi requested a review from electrum January 11, 2020 16:49
@findepi findepi force-pushed the findepi/master/skip-empty-bucket-creation-by-default-10e0c0 branch 2 times, most recently from 87bb9a1 to 6e8d84f Compare January 11, 2020 16:55
@electrum
Copy link
Member

Does CDH Hive support this?

@findepi
Copy link
Member Author

findepi commented Jan 11, 2020

Does CDH Hive support this?

By default, Hive doesn't do bucket pruning.
And actually I don't know how to force it do this.
I remember I once tried and failed.

@findepi findepi force-pushed the findepi/master/skip-empty-bucket-creation-by-default-10e0c0 branch 2 times, most recently from d592742 to d4bf56b Compare January 11, 2020 19:52
@findepi
Copy link
Member Author

findepi commented Apr 27, 2020

@pettyjamesm does Athena correctly read bucketed data created by e.g. Tez (some bucket files missing)?

@findepi findepi force-pushed the findepi/master/skip-empty-bucket-creation-by-default-10e0c0 branch from d4bf56b to 32286cd Compare June 10, 2020 11:16
@findepi findepi force-pushed the findepi/master/skip-empty-bucket-creation-by-default-10e0c0 branch 3 times, most recently from 8b45f2f to 2481ea5 Compare June 20, 2020 13:25
Hive on Tez does not create them, so other readers support that by
necessity.
@findepi findepi force-pushed the findepi/master/skip-empty-bucket-creation-by-default-10e0c0 branch from 2481ea5 to 308c6ef Compare June 20, 2020 14:12
@findepi findepi merged commit 87791eb into trinodb:master Jun 20, 2020
@findepi findepi deleted the findepi/master/skip-empty-bucket-creation-by-default-10e0c0 branch June 20, 2020 20:48
@findepi findepi added this to the 337 milestone Jun 20, 2020
@findepi findepi mentioned this pull request Jun 20, 2020
9 tasks
v-jizhang added a commit to v-jizhang/presto that referenced this pull request Jun 9, 2021
Cherry-pick of trinodb/trino#822,
trinodb/trino#848 and
trinodb/trino#1375

Co-authored-by: David Phillips <david@acz.org>
Co-authored-by: Piotr Findeisen <piotr.findeisen@gmail.com>
v-jizhang added a commit to v-jizhang/presto that referenced this pull request Jul 23, 2021
Cherry-pick of trinodb/trino#1375

Co-authored-by: Piotr Findeisen <piotr.findeisen@gmail.com>
highker pushed a commit to prestodb/presto that referenced this pull request Aug 9, 2021
Cherry-pick of trinodb/trino#1375

Co-authored-by: Piotr Findeisen <piotr.findeisen@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

3 participants