Skip to content

Remove deprecated CREATE TABLE with dummy column on the existing location in Delta Lake connector#17016

Merged
ebyhr merged 1 commit intotrinodb:masterfrom
marcinsbd:remove-support-create-table-with-location
Dec 1, 2023
Merged

Remove deprecated CREATE TABLE with dummy column on the existing location in Delta Lake connector#17016
ebyhr merged 1 commit intotrinodb:masterfrom
marcinsbd:remove-support-create-table-with-location

Conversation

@marcinsbd
Copy link
Contributor

@marcinsbd marcinsbd commented Apr 13, 2023

Release notes

(x) Release notes are required, with the following suggested text:

# Delta Lake
* {{breaking}} Remove support for creating tables with dummy columns on the existing location. Use `register_table` procedure instead. ({issue}`17016`)

@cla-bot
Copy link

cla-bot bot commented Apr 13, 2023

Thank you for your pull request and welcome to the Trino community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. Continue to work with us on the review and improvements in this PR, and submit the signed CLA to cla@trino.io. Photos, scans, or digitally-signed PDF files are all suitable. Processing may take a few days. The CLA needs to be on file before we merge your changes. For more information, see https://github.com/trinodb/cla

@cla-bot
Copy link

cla-bot bot commented Apr 13, 2023

Thank you for your pull request and welcome to the Trino community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. Continue to work with us on the review and improvements in this PR, and submit the signed CLA to cla@trino.io. Photos, scans, or digitally-signed PDF files are all suitable. Processing may take a few days. The CLA needs to be on file before we merge your changes. For more information, see https://github.com/trinodb/cla

@github-actions github-actions bot added delta-lake Delta Lake connector docs labels Apr 13, 2023
@marcinsbd marcinsbd force-pushed the remove-support-create-table-with-location branch from d30574a to 3d32c92 Compare April 14, 2023 13:32
@cla-bot
Copy link

cla-bot bot commented Apr 14, 2023

Thank you for your pull request and welcome to the Trino community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. Continue to work with us on the review and improvements in this PR, and submit the signed CLA to cla@trino.io. Photos, scans, or digitally-signed PDF files are all suitable. Processing may take a few days. The CLA needs to be on file before we merge your changes. For more information, see https://github.com/trinodb/cla

@marcinsbd marcinsbd requested review from ebyhr and krvikash April 14, 2023 13:38
@marcinsbd marcinsbd force-pushed the remove-support-create-table-with-location branch from 3d32c92 to e18b8d8 Compare April 17, 2023 07:40
@cla-bot
Copy link

cla-bot bot commented Apr 17, 2023

Thank you for your pull request and welcome to the Trino community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. Continue to work with us on the review and improvements in this PR, and submit the signed CLA to cla@trino.io. Photos, scans, or digitally-signed PDF files are all suitable. Processing may take a few days. The CLA needs to be on file before we merge your changes. For more information, see https://github.com/trinodb/cla

@ebyhr ebyhr changed the title Remove support create table with location Remove support create table with location in Delta Lake connector Apr 17, 2023
@marcinsbd marcinsbd force-pushed the remove-support-create-table-with-location branch from e18b8d8 to 2f56ffc Compare April 17, 2023 22:41
@cla-bot
Copy link

cla-bot bot commented Apr 17, 2023

Thank you for your pull request and welcome to the Trino community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. Continue to work with us on the review and improvements in this PR, and submit the signed CLA to cla@trino.io. Photos, scans, or digitally-signed PDF files are all suitable. Processing may take a few days. The CLA needs to be on file before we merge your changes. For more information, see https://github.com/trinodb/cla

@marcinsbd marcinsbd force-pushed the remove-support-create-table-with-location branch from 2f56ffc to 989cd60 Compare April 18, 2023 13:08
@cla-bot
Copy link

cla-bot bot commented Apr 18, 2023

Thank you for your pull request and welcome to the Trino community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. Continue to work with us on the review and improvements in this PR, and submit the signed CLA to cla@trino.io. Photos, scans, or digitally-signed PDF files are all suitable. Processing may take a few days. The CLA needs to be on file before we merge your changes. For more information, see https://github.com/trinodb/cla

@Thelin90
Copy link

Thelin90 commented Apr 19, 2023

@marcinsbd

May I ask why you want to delete this?

We use this heavily to create tables written by spark, delta-rs.

It will create a lot of pain to always have to align schema first in galaxy before doing a spark job. I am sure a lot of people must face this issue?

I assume this is what should still enable you to register existing tables? Would still make us have to do some major refactor but at least this does what we do with create table from existing location?

https://trino.io/docs/current/connector/delta-lake.html#register-table

@marcinsbd marcinsbd force-pushed the remove-support-create-table-with-location branch from 989cd60 to b44633c Compare April 20, 2023 16:37
@cla-bot
Copy link

cla-bot bot commented Apr 20, 2023

Thank you for your pull request and welcome to the Trino community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. Continue to work with us on the review and improvements in this PR, and submit the signed CLA to cla@trino.io. Photos, scans, or digitally-signed PDF files are all suitable. Processing may take a few days. The CLA needs to be on file before we merge your changes. For more information, see https://github.com/trinodb/cla

@marcinsbd marcinsbd force-pushed the remove-support-create-table-with-location branch from b44633c to 16b7ff4 Compare April 21, 2023 09:54
@cla-bot
Copy link

cla-bot bot commented Apr 21, 2023

Thank you for your pull request and welcome to the Trino community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. Continue to work with us on the review and improvements in this PR, and submit the signed CLA to cla@trino.io. Photos, scans, or digitally-signed PDF files are all suitable. Processing may take a few days. The CLA needs to be on file before we merge your changes. For more information, see https://github.com/trinodb/cla

@marcinsbd marcinsbd force-pushed the remove-support-create-table-with-location branch from 16b7ff4 to 82e1e81 Compare April 25, 2023 23:00
@cla-bot
Copy link

cla-bot bot commented Apr 25, 2023

Thank you for your pull request and welcome to the Trino community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. Continue to work with us on the review and improvements in this PR, and submit the signed CLA to cla@trino.io. Photos, scans, or digitally-signed PDF files are all suitable. Processing may take a few days. The CLA needs to be on file before we merge your changes. For more information, see https://github.com/trinodb/cla

@marcinsbd marcinsbd closed this Apr 27, 2023
@marcinsbd marcinsbd reopened this Nov 6, 2023
@ebyhr
Copy link
Member

ebyhr commented Nov 6, 2023

Please rebase on master to resolve conflicts.

@marcinsbd marcinsbd force-pushed the remove-support-create-table-with-location branch from 82e1e81 to 8db2cbd Compare November 7, 2023 10:15
@cla-bot cla-bot bot added the cla-signed label Nov 7, 2023
@marcinsbd marcinsbd force-pushed the remove-support-create-table-with-location branch from 8db2cbd to cf6a0da Compare November 7, 2023 11:35
@marcinsbd marcinsbd force-pushed the remove-support-create-table-with-location branch from cf6a0da to d46282f Compare November 13, 2023 11:20
@marcinsbd marcinsbd requested review from ebyhr and krvikash November 14, 2023 09:58
@ebyhr ebyhr merged commit 62cef1a into trinodb:master Dec 1, 2023
@github-actions github-actions bot added this to the 435 milestone Dec 1, 2023
@ebyhr ebyhr changed the title Remove support create table with location in Delta Lake connector Remove deprecated CREATE TABLE with dummy column on the existing location in Delta Lake connector Dec 1, 2023
@mosabua
Copy link
Member

mosabua commented Dec 1, 2023

Does that mean that create table with external location is not remove completely in favour of the register table procedure? And this was the last part of that removal? @marcinsbd @ebyhr

@ebyhr
Copy link
Member

ebyhr commented Dec 2, 2023

@Thelin90 Since the specified location holds the table definitions, passing dummy columns doesn't make sense. We removed the feature to reduce the maintenance cost.

@mosabua Yes, we deprecated delta.legacy-create-table-with-existing-location.enabled few month ago and this PR removed the feature completely.

@mosabua
Copy link
Member

mosabua commented Dec 2, 2023

Cool .. thanks for clarifying .. definitely needs to be a breaking change entry then..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Development

Successfully merging this pull request may close these issues.

5 participants