Skip to content

Commit

Permalink
Add disclaimer about plugin usage
Browse files Browse the repository at this point in the history
  • Loading branch information
tkornai committed Sep 10, 2020
1 parent 5f88f64 commit 7e65adc
Show file tree
Hide file tree
Showing 2 changed files with 7 additions and 3 deletions.
6 changes: 4 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -141,9 +141,11 @@ See also [ruby-kafka README](https://github.com/zendesk/ruby-kafka#consuming-mes

Consuming topic name is used for event tag. So when the target topic name is `app_event`, the tag is `app_event`. If you want to modify tag, use `add_prefix` or `add_suffix` parameter. With `add_prefix kafka`, the tag is `kafka.app_event`.

### Input plugin (@type 'kafka_group', supports kafka group, uses rdkafka-ruby)
### Input plugin (@type 'rdkafka_group', supports kafka consumer groups, uses rdkafka-ruby)

Consume events by kafka consumer group features..
:warning: **The in_rdkafka_group consumer was not yet tested under heavy production load. Use it at your own risk!**

With the introduction of the rdkafka-ruby based input plugin we hope to support Kafka brokers above version 2.1 where we saw [compatibility issues](https://github.com/fluent/fluent-plugin-kafka/issues/315) when using the ruby-kafka based @kafka_group input type. The rdkafka-ruby lib wraps the highly performant and production ready librdkafka C lib.

<source>
@type rdkafka_group
Expand Down
4 changes: 3 additions & 1 deletion lib/fluent/plugin/in_rdkafka_group.rb
Original file line number Diff line number Diff line change
Expand Up @@ -82,7 +82,9 @@ def multi_workers_ready?
def configure(conf)
super

$log.info "Will watch for topics #{@topics} at brokers " \
log.warn "The in_rdkafka_group consumer was not yet tested under heavy production load. Use it at your own risk!"

log.info "Will watch for topics #{@topics} at brokers " \
"#{@kafka_configs["bootstrap.servers"]} and '#{@kafka_configs["group.id"]}' group"

@topics = _config_to_array(@topics)
Expand Down

0 comments on commit 7e65adc

Please sign in to comment.