Skip to content

[HUDI-6592] Flink insert overwrite should support dynamic partition and whole table#9287

Merged
danny0405 merged 1 commit intoapache:masterfrom
SteNicholas:HUDI-6592
Aug 6, 2023
Merged

[HUDI-6592] Flink insert overwrite should support dynamic partition and whole table#9287
danny0405 merged 1 commit intoapache:masterfrom
SteNicholas:HUDI-6592

Conversation

@SteNicholas
Copy link
Copy Markdown
Member

Change Logs

Flink insert overwrite should support dynamic partition instead of the whole table, which behavior is consistent with the semantics of insert overwrite in Flink.

Impact

Flink insert overwrite only supports static and dynamic partition for partitioned table.

Risk level (write none, low medium or high below)

none.

Documentation Update

none.

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

@SteNicholas SteNicholas requested a review from danny0405 July 26, 2023 12:01
@danny0405
Copy link
Copy Markdown
Contributor

Spark related discussions and fix: #9113

@SteNicholas SteNicholas reopened this Jul 31, 2023
@SteNicholas SteNicholas requested a review from leesf August 2, 2023 05:28
@SteNicholas SteNicholas changed the title [HUDI-6592] Flink insert overwrite should support dynamic partition instead of whole table [HUDI-6592] Flink insert overwrite should support dynamic partition and whole table Aug 2, 2023
@SteNicholas
Copy link
Copy Markdown
Member Author

SteNicholas commented Aug 3, 2023

@danny0405, the current behavior and config of INSERT OVERWRITE in Flink is consistent with which in Spark insert overwrite. PTAL.

Copy link
Copy Markdown
Contributor

@leesf leesf left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 from my side.

@SteNicholas
Copy link
Copy Markdown
Member Author

@danny0405, I have addressed the renaming of this config option. PTAL.

@SteNicholas SteNicholas requested a review from danny0405 August 5, 2023 10:49
@hudi-bot
Copy link
Copy Markdown
Collaborator

hudi-bot commented Aug 5, 2023

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@danny0405 danny0405 merged commit 8c6e8d9 into apache:master Aug 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants