Skip to content

Prevent modifying old snapshots in Iceberg#12873

Merged
ebyhr merged 1 commit intotrinodb:masterfrom
homar:homar/iceberg_reject_insert_into_versioned_table
Jun 16, 2022
Merged

Prevent modifying old snapshots in Iceberg#12873
ebyhr merged 1 commit intotrinodb:masterfrom
homar:homar/iceberg_reject_insert_into_versioned_table

Conversation

@homar
Copy link
Copy Markdown
Member

@homar homar commented Jun 15, 2022

Description

Is this change a fix, improvement, new feature, refactoring, or other?
fix
Is this a change to the core query engine, a connector, client library, or the SPI interfaces? (be specific)
iceberg connector
How would you describe this change to a non-technical end user or system administrator?
it prevents users from doing things which outcome is not obvious

Related issues, pull requests, and links

Fixes #12860

Documentation

(x) No documentation is needed.
( ) Sufficient documentation is included in this PR.
( ) Documentation PR is available with #prnumber.
( ) Documentation issue #issuenumber is filed, and can be handled later.

Release notes

(x) No release notes entries required.
( ) Release notes entries required with the following suggested text:

# Iceberg
* Prevent modifying old snapshots. ({issue}`12860`)

@homar homar force-pushed the homar/iceberg_reject_insert_into_versioned_table branch from 220ccef to 9d5a02c Compare June 16, 2022 09:07
@homar homar changed the title Reject inserts into table snapshot in Iceberg Prevent modifying old snapshots in Iceberg Jun 16, 2022
@homar
Copy link
Copy Markdown
Member Author

homar commented Jun 16, 2022

@ebyhr comments fixed, scope changed ;)

@homar homar force-pushed the homar/iceberg_reject_insert_into_versioned_table branch from 9d5a02c to 1cde906 Compare June 16, 2022 12:11
@ebyhr ebyhr merged commit b599ac6 into trinodb:master Jun 16, 2022
@ebyhr
Copy link
Copy Markdown
Member

ebyhr commented Jun 16, 2022

Merged, thanks!

@ebyhr ebyhr mentioned this pull request Jun 16, 2022
@github-actions github-actions bot added this to the 387 milestone Jun 16, 2022
@ebyhr
Copy link
Copy Markdown
Member

ebyhr commented Jun 17, 2022

@homar I think we should also block metadata modification (e.g. ADD COLUMN) for old snapshots. Could you send another PR if it makes sense?

@findinpath
Copy link
Copy Markdown
Contributor

we should also block metadata modification (e.g. ADD COLUMN) for old snapshots.

There are multiple DDL changes that should be taken into account for blocking snapshots.

cc @findepi @electrum

@homar
Copy link
Copy Markdown
Member Author

homar commented Jun 17, 2022

@homar I think we should also block metadata modification (e.g. ADD COLUMN) for old snapshots. Could you send another PR if it makes sense?

Sure I will, but I am not sure what else to block. Add column, changes in partitioning, what else ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

Iceberg should reject insert into table snapshot

3 participants