Skip to content

Conversation

@flashJd
Copy link
Contributor

@flashJd flashJd commented Aug 19, 2022

Change Logs

flink support query changelog in incremental query:
image

Impact

Describe any public API or user-facing feature change or any performance impact.

Risk level: none | low | medium | high

Choose one. If medium or high, explain what verification was done to mitigate the risks.

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

flashJd added 5 commits August 4, 2022 18:08
incremental query using log files

add FlinkOptions to enable batch incremental changelog query

fix checkStyle and test

flink-sql support emit delete records

output preCombine field of delete record using nonChangelog mode

output preCombine field of delete record using nonChangelog mode

output preCombine and partition field of delete record using nonChangelog mode

fix checkstyle

delete unnecessary code

add tests for flink-sql and api
@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@yihua yihua added priority:high Significant impact; potential bugs engine:flink Flink integration incremental-query labels Sep 6, 2022
@yihua
Copy link
Contributor

yihua commented Sep 6, 2022

@flashJd Could you explain in the PR description what you're adding here? cc @danny0405

@flashJd
Copy link
Contributor Author

flashJd commented Sep 6, 2022

@flashJd Could you explain in the PR description what you're adding here? cc @danny0405

I add a photo to describe it

@flashJd
Copy link
Contributor Author

flashJd commented Sep 6, 2022

we can review it in sequence #6429-->#6435-->#6446

@github-actions github-actions bot added the size:L PR with lines of changes in (300, 1000] label Feb 26, 2024
Copy link
Contributor

@yihua yihua left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@danny0405 do you think this sequence of PRs are still helpful as a new feature for Hudi Flink?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

engine:flink Flink integration priority:high Significant impact; potential bugs size:L PR with lines of changes in (300, 1000]

Projects

Status: 🏁 Triaged
Status: 🔖 Ready for review

Development

Successfully merging this pull request may close these issues.

5 participants