Delta: Support Snapshot Delta Lake Table to Iceberg Table#6449

Merged

jackye1995 merged 57 commits intoapache:masterfrom

JonasJ-ap:migrate_delta_to_iceberg

Feb 7, 2023

Commits on Dec 24, 2022

Migrate delta to iceberg round 1 (#29)
JonasJ-ap
authored

Commits on Dec 25, 2022

Migrate delta to iceberg util refactor (#30)
JonasJ-ap
authored

Commits on Dec 28, 2022

Commits on Dec 29, 2022

use transaction, refactor structure, add optional newTableLocation, add tableProperty (#32)
JonasJ-ap
authored
fix the potential path error due to ambiguous return value of AddFile.getPath
JonasJ-ap
committed

Commits on Dec 30, 2022

refactor getFullPath with unit tests, use newCreateTableTransaction, remove unnecessary parameters and try-catch (#33)
JonasJ-ap
authored

Commits on Jan 3, 2023

allow user to specify a custom location for migrated table, fix load error of icebergCatalog (#34)
JonasJ-ap
authored

Commits on Jan 6, 2023

Commits on Jan 7, 2023

move everthing to iceberg-delta-lake, build demo integration test (#35)
JonasJ-ap
authored

Commits on Jan 9, 2023

optimize api structure, refactor the integration test, add more tests(#39)
JonasJ-ap
authored

Commits on Jan 10, 2023

Commits on Jan 15, 2023

Merge remote-tracking branch 'origin/master' into migrate_delta_to_iceberg
JonasJ-ap
committed

Commits on Jan 17, 2023

simplify the test base (#46)
JonasJ-ap
authored

Commits on Jan 20, 2023

save getLength Call for AddFile and when RemoveFile contains size (#47)
JonasJ-ap
authored

Commits on Jan 21, 2023

add null check for table.currentSnapshot() when querying the total number of data files migrated
JonasJ-ap
committed

Commits on Jan 24, 2023

Refactor iceberg-delta's integration test(#48)
JonasJ-ap
authored

Commits on Jan 25, 2023

Adapt for delta.logRetentionDuration (#49)
JonasJ-ap
authored

Commits on Jan 26, 2023

fix comment and format issue
JonasJ-ap
committed

Commits on Feb 6, 2023