Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Snappy Compression #6

Closed
kzk opened this issue Nov 12, 2012 · 2 comments
Closed

Add Snappy Compression #6

kzk opened this issue Nov 12, 2012 · 2 comments

Comments

@kzk
Copy link
Member

kzk commented Nov 12, 2012

The backplane ( http://thebackplane.com/ ) team asked me to add Snappy compression feature to this plugin.
@suzukaze
Copy link
Member

I want to add Snappy compression feature to this plugin.

  • What is the mime type of Snappy? For instance, "application/x-snappy".
  • What is the extension of Snappy file? For instance, ".snappy" or ".sn"

@suzukaze suzukaze mentioned this issue Nov 2, 2013
Closed
@repeatedly
Copy link
Member

https://github.com/fluent/fluent-plugin-s3#use-your-compression-algorithm

We now have pluggable compression mechanizm.
No need built-in support.

chillaxd pushed a commit to chillaxd/fluent-plugin-s3 that referenced this issue Dec 19, 2016
@chillaxd
# This is a combination of 2 commits.
af5d40a 
# This is the 1st commit message:

# This is a combination of 3 commits.
# This is the 1st commit message:
# This is a combination of 3 commits.
# This is the 1st commit message:
Out S3 change

so that user can use minimal policy at AWS, to work with fluentd
like S3:PutObject

# This is the commit message fluent#2:

Spacing handled in out-S3 plugin

# This is the commit message fluent#3:

Identation modified

# This is the commit message fluent#4:

Introduce check_bucket paramater
To skip the using of auto_create_bucket for bucket existence checking

# This is the commit message fluent#5:

Fixes:

Test cases added.
README has been modified with check_bucket's usage and sample AWS policy.

# This is the commit message fluent#6:

Fixes:

Issues for extra spoaces. Modified

# This is the commit message fluent#7:

Spacing issues

# This is the commit message fluent#8:

Update test_out_s3.rb

# This is the commit message fluent#9:

time slicer modified for utc also

# This is the commit message fluent#10:

removing test cases

# This is the commit message fluent#1:

renaming time_slicer variable

# This is the commit message fluent#2:

Test casees added

Test cases for out_s3 plugin has been added. This feature will work with hardened
S3 policy like with only PutObject permission. As it will not check bucket existence
not even object existence, as for each object creation it will name it with timestamp.
So anyhow it will be unique everytime.

Only thing it willl assume that bucket is created already.

# This is the commit message fluent#3:

Some variable renamed

# This is the commit message fluent#2:

Clean up dependencies

# This is the commit message fluent#3:

Update README for placeholders

# This is the commit message fluent#2:

v0.8.0.rc1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@repeatedly @kzk @suzukaze