-
Notifications
You must be signed in to change notification settings - Fork 180
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
environment variable usage in kafka_configs for rdkafka_group input #434
Comments
Hmm, probably we need to modify fluentd core to realize it. |
@ashie
and when i run my docker the following:
the |
@shyimo it works to me. Super. |
Here is how I worked it out:
|
Hi @ashie, what's the status of this issue? I found that you were able to resolve it for the out_rdkafka and out_rdkafka2 module. (https://github.com/fluent/fluent-plugin-kafka/blob/master/ChangeLog#L28) Why does it need modification in FluentD core? (#434 (comment)) Can I try to create a PR that adds this to in_rdkafka_group as well? Or would it be possible to do it generically (at least for all rdkafka modules)? I would need to get this functionality into release as soon as possible. |
Is your feature request related to a problem? Please describe.
It seems like there is no way to pass environment variables for kafka_configs hash in rdkafka_group input.
for example:
the bootstrap.servers will not parse the
BROKER_ADDRESS
environment variable.Describe the solution you'd like
This will be great if there was a way to parse those environment variables inside the
kafka_configs
hash.At the current situation, we are not able to fully use all librdkafka features since hard coded values are not possible for some of the fields.
Describe alternatives you've considered
any parsing method that will able to get dynamic fields and not hard coded values
Additional context
No response
The text was updated successfully, but these errors were encountered: