Skip to content

Commit

Permalink
Write Blog Post
Browse files Browse the repository at this point in the history
  • Loading branch information
ismailsimsek committed Sep 1, 2021
1 parent 879ae45 commit 4f4ad94
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions BLOGPOST.md
Original file line number Diff line number Diff line change
Expand Up @@ -76,10 +76,10 @@ Debezium extracts/consumes database events in real time and this could cause too
which is not optimal for batch processing especially when near realtime data feed is sufficient.
To avoid this problem it's possible to use following configuration and increase batch size per commit

**MaxBatchSizeWait**: This setting adds delay based on debezium metrics,
it periodically monitors streaming queue size, and it starts processing events when it reaches `debezium.source.max.batch.size` value
**MaxBatchSizeWait**: uses debezium metrics to optimize batch size, it periodically reads streaming queue current size and waits until it reaches to `max.batch.size`
maximum wait and check intervals are controlled by `debezium.sink.batch.batch-size-wait.max-wait-ms`, `debezium.sink.batch.batch-size-wait.wait-interval-ms` properties
during the wait debezium events are collected in memory (in debezium streaming queue) and this way each commit receives more and consistent batch size
this setting should be configured together with `debezium.source.max.queue.size` and `debezium.source.max.batch.size` debezium properties
Note: this setting should be configured together with `debezium.source.max.queue.size` and `debezium.source.max.batch.size` debezium properties

example setting:
```properties
Expand Down

0 comments on commit 4f4ad94

Please sign in to comment.