Skip to content

Conversation

@ThinkerLei
Copy link
Contributor

Change Logs

Fix concurrency conflict in ClusteringOperator

Impact

when asyncClustering is enabled, send ClusteringCommitEvent 、 LatencyMarker may cause concurrency conflict.

Risk level (write none, low medium or high below)

none

Documentation Update

fix the buc

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

Copy link
Contributor

@danny0405 danny0405 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@danny0405 danny0405 self-assigned this Jan 9, 2023
@danny0405 danny0405 added the engine:flink Flink integration label Jan 9, 2023
@danny0405 danny0405 changed the title [HUDI-5515]Fix concurrency conflict in ClusteringOperator [HUDI-5515] Fix concurrency conflict in for flink async clustering with latency marker Jan 9, 2023
@danny0405 danny0405 added priority:critical Production degraded; pipelines stalled area:table-service Table services labels Jan 9, 2023
@hudi-bot
Copy link
Collaborator

hudi-bot commented Jan 9, 2023

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@ThinkerLei ThinkerLei changed the title [HUDI-5515] Fix concurrency conflict in for flink async clustering with latency marker [HUDI-5515] Fix concurrency conflict in ClusteringOperator when process latency marker Jan 9, 2023
@danny0405 danny0405 merged commit 2d1dd2a into apache:master Jan 10, 2023
fengjian428 pushed a commit to fengjian428/hudi that referenced this pull request Jan 31, 2023
XuQianJin-Stars pushed a commit that referenced this pull request Feb 11, 2023
…cy marker (#7625)

Co-authored-by: coder_wang <[email protected]>

(cherry picked from commit 2d1dd2a)
nsivabalan pushed a commit to nsivabalan/hudi that referenced this pull request Mar 22, 2023
fengjian428 pushed a commit to fengjian428/hudi that referenced this pull request Apr 5, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:table-service Table services engine:flink Flink integration priority:critical Production degraded; pipelines stalled

Projects

Archived in project

Development

Successfully merging this pull request may close these issues.

3 participants