Skip to content

Commit

Permalink
Increase Fluentd Buffer Queue Size
Browse files Browse the repository at this point in the history
This increases the number of chunks that can be queued to be sent to
S3. The [documentation][1] claims that this number is unlimited when
not set, but the default was in fact [recently set][2] to `1`, which
causes a backlog of chunks to build up when there is a larger number
of log files.

[1]: https://docs.fluentd.org/v1.0/articles/buffer-section#buffering-parameters
[2]: fluent/fluentd#2173
  • Loading branch information
christianberg committed Mar 5, 2019
1 parent 033a9ad commit 3c59f2c
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions cluster/manifests/logging-agent/config.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -82,6 +82,7 @@ data:
timekey_use_utc true
chunk_limit_size 4MB
total_limit_size 1GB
queued_chunks_limit_size 100
flush_at_shutdown true
</buffer>
<format>
Expand Down

0 comments on commit 3c59f2c

Please sign in to comment.