Proposal: kafka output #942
Conversation
urso
added
enhancement
in progress
urso
force-pushed
the
feature/kafka-output
branch
from
f046234
to
0b3d584
Compare
urso
force-pushed
the
feature/kafka-output
branch
3 times, most recently
from
a905db4
to
1b938be
Compare
| } | ||
| debugf("hosts: %v", hosts) | ||
|
|
||
| useType := kafkaDefaultTopicsFromType |
There was a problem hiding this comment.
I think this configuration option is not documented.
|
LGTM. I suggest some integration tests for a few of the common configuration (TLS/no-TLS, ACK/no-ACK), but those can come in a different PR. |
urso
force-pushed
the
feature/kafka-output
branch
from
1ab0527
to
2f64b7e
Compare
|
History cleanup finished |
|
Is there a need for implementing other PR's or can we start using kafka output in beats framework. |
|
This is great news on providing a Kafka output for beats. When is v5.0.0-GA targeted to be released? In the meantime I have built from master to start testing it out. Any tips on how to configure the Kafka output? |
|
Docs: https://www.elastic.co/guide/en/beats/filebeat/master/kafka-output.html |
|
Thanks for sharing the docs. Kafka output with filebeat is working for me. |
|
Could anyone @elastic confirms if beat -> kafka is going to be available for version 5? |
|
Yes, Kafka will be available in the 5.0 release. You can already tests it with the 5.0.0-alpha releases. |
Kafka output basically wrapping github.com/Shopify/sarama library in libbeat + make it configurable.
Depends on: #927 and #940