Skip to content

[Data] - Iceberg support upsert tables + schema update + overwrite tables #58270

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
raulchen merged 13 commits into from
Nov 13, 2025
Merged

[Data] - Iceberg support upsert tables + schema update + overwrite tables #58270

Show file tree
Hide file tree
Changes from 5 commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
c6503b1
[Data] - Iceberg support upsert tables + schema update + overwrite ta…
goutamvenkat-anyscale Oct 29, 2025
65f5b1e
Some cleanup
goutamvenkat-anyscale Oct 29, 2025
2436d80
Merge from master
goutamvenkat-anyscale Nov 11, 2025
fb49df2
Clean up tests
goutamvenkat-anyscale Nov 11, 2025
c5d64e1
Move to type_checking
goutamvenkat-anyscale Nov 11, 2025
e55f2fc
Test clean up + datasink cleanup
goutamvenkat-anyscale Nov 11, 2025
f9fe416
doclint + pyiceberg
goutamvenkat-anyscale Nov 11, 2025
cd1731f
change iceberg dep
goutamvenkat-anyscale Nov 11, 2025
52eab22
Change pydoclint
goutamvenkat-anyscale Nov 11, 2025
b5bb0c4
Use union_by_name
goutamvenkat-anyscale Nov 11, 2025
ba59afe
upgrade one more dep
goutamvenkat-anyscale Nov 11, 2025
a734481
Merge branch 'master' into goutam/iceberg_upsert_overwrite_tables
goutamvenkat-anyscale Nov 12, 2025
62dd717
Address comments
goutamvenkat-anyscale Nov 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions python/ray/data/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,7 @@
FileShuffleConfig,
ReadTask,
RowBasedFileDatasink,
SaveMode,
)
from ray.data.iterator import DataIterator, DatasetIterator
from ray.data.preprocessor import Preprocessor
Expand Down Expand Up @@ -131,6 +132,7 @@
"NodeIdStr",
"ReadTask",
"RowBasedFileDatasink",
"SaveMode",
"Schema",
"SinkMode",
"TaskPoolStrategy",
Expand Down
Loading