Skip to content

Commit

Permalink
Increase Fluentd Buffer Queue Size
Browse files Browse the repository at this point in the history
This increases the number of chunks that can be queued to be sent to
S3. The [documentation][1] claims that this number is unlimited when
not set, but the default was in fact [recently set][2] to `1`, which
causes a backlog of chunks to build up when there is a larger number
of log files.

[1]: https://docs.fluentd.org/v1.0/articles/buffer-section#buffering-parameters
[2]: fluent/fluentd#2173

Signed-off-by: Christian Berg <[email protected]>
Signed-off-by: njuettner <[email protected]>
  • Loading branch information
christianberg authored and njuettner committed Mar 7, 2019
1 parent 6ff623a commit edd8bb2
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions cluster/manifests/logging-agent/config.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -82,6 +82,7 @@ data:
timekey_use_utc true
chunk_limit_size 4MB
total_limit_size 1GB
queued_chunks_limit_size 100
flush_at_shutdown true
</buffer>
<format>
Expand Down

0 comments on commit edd8bb2

Please sign in to comment.