Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compression for buf_file plugin not used on restore (master) #2618

Closed
berlincount opened this issue Sep 17, 2019 · 0 comments · Fixed by #2620
Closed

Compression for buf_file plugin not used on restore (master) #2618

berlincount opened this issue Sep 17, 2019 · 0 comments · Fixed by #2620
Labels
bug Something isn't working

Comments

@berlincount
Copy link
Contributor

Describe the bug

While buffering a chunk on disk it can be compressed using gzip, but when restoring it, is isn't uncompressed, leading to a broken chunk that's possibly send further on.

To Reproduce

  <buffer>
    @type file
    path /var/log/shopify-fluentd/fluentd/example.buffer
    chunk_limit_size 10M
    total_limit_size 1280M
    flush_interval 5s
    retry_max_interval 30
    retry_forever true
    flush_thread_count 4
    overflow_action block
    compress gzip
  </buffer>

Cause a chunk to be buffered, restart fluentd. The latter should cause the chunk to be unbuffered and uncompressed, but it's loaded in compressed form.

Expected behavior

Chunks should be buffered and unbuffered correctly regardless of compression setting.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant