Skip to content

Upgrade Kafka Connector to 2.3.1#14026

Closed
dcfocus wants to merge 1 commit intoprestodb:masterfrom
dcfocus:oss-multi-commits/upgrade-to-kafkaconsumer-ci
Closed

Upgrade Kafka Connector to 2.3.1#14026
dcfocus wants to merge 1 commit intoprestodb:masterfrom
dcfocus:oss-multi-commits/upgrade-to-kafkaconsumer-ci

Conversation

@dcfocus
Copy link
Contributor

@dcfocus dcfocus commented Jan 29, 2020

This PR improves Kafka connector implementation and performance.

Replaced SimpleConsumer with KafkaConsumer for Kafka connector.
Push collecting offsets for each partition from coordinator to workers to resolve the bottleneck.

@dcfocus
Copy link
Contributor Author

dcfocus commented Jan 29, 2020

Duplicate PR to kick off travis-ci

@wenleix
Copy link
Contributor

wenleix commented Jan 29, 2020

Original PR with review comments: #13709

@dcfocus dcfocus force-pushed the oss-multi-commits/upgrade-to-kafkaconsumer-ci branch from 1ac3805 to 2f60ba2 Compare January 29, 2020 09:22
@dcfocus dcfocus closed this Jan 30, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants