Skip to content

Move already created check inside of metastore implementations#19969

Merged
dain merged 2 commits intomasterfrom
dain/move-already-created
Dec 2, 2023
Merged

Move already created check inside of metastore implementations#19969
dain merged 2 commits intomasterfrom
dain/move-already-created

Conversation

@dain
Copy link
Member

@dain dain commented Nov 30, 2023

Move the logic to not throw SchemaAlreadyExistsException or TableAlreadyExistsException when the table/schema was already created by the qyery (e.g., retry after timeout), inside the HiveMetastore implementations. This consolidated the logic into code that is reused several connectors, and makes the logic easier to test.

Release notes

(x) This is not user-visible or is docs only, and no release notes are required.

@dain dain requested a review from electrum November 30, 2023 07:44
@cla-bot cla-bot bot added the cla-signed label Nov 30, 2023
@dain dain force-pushed the dain/move-already-created branch from 1eb723a to fdcc554 Compare November 30, 2023 07:55
@github-actions github-actions bot added release-notes docs tests:hive iceberg Iceberg connector delta-lake Delta Lake connector hive Hive connector labels Nov 30, 2023
@ebyhr ebyhr requested a review from pajaks November 30, 2023 08:07
@dain dain force-pushed the dain/move-already-created branch 4 times, most recently from eb572bc to 3db0132 Compare December 1, 2023 00:33
@github-actions github-actions bot added the hudi Hudi connector label Dec 1, 2023
@dain dain force-pushed the dain/move-already-created branch from 3db0132 to 20496ef Compare December 1, 2023 22:24
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You need to add this to the POM in two places. Search for and duplicate TestHiveS3AndGlueMetastoreTest

Copy link
Member Author

@dain dain Dec 2, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Turns out it is already there, because there is another test with the same name in a different package

@dain dain force-pushed the dain/move-already-created branch from 20496ef to 4295ae8 Compare December 2, 2023 07:20
@dain dain merged commit 62acd1b into master Dec 2, 2023
@dain dain deleted the dain/move-already-created branch December 2, 2023 08:29
@github-actions github-actions bot added this to the 435 milestone Dec 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla-signed delta-lake Delta Lake connector docs hive Hive connector hudi Hudi connector iceberg Iceberg connector

Development

Successfully merging this pull request may close these issues.

3 participants