Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BREAKING/cli-flags] feat(bulk): Use snappy compression by default. #6697

Merged
merged 1 commit into from
Oct 12, 2020

Conversation

danielmai
Copy link
Contributor

@danielmai danielmai commented Oct 10, 2020

Like #6616, add a --badger.compression flag to dgraph bulk which allows changing
the compression algorithm.

This changes the default from Zstd (level 1) to Snappy.

 $ dgraph bulk --help
 ...
 Flags:
 ...
        --badger.compression string        [none, zstd:level, snappy] Specifies the compression algorithm and the compressionlevel (if applicable) for the postings directory. none would disable compression, while zstd:1 would set zstd compression at level 1. (default "snappy")

This change is Reviewable

Like #6616, add a --badger.compression flag to dgraph bulk which allows changing
the compression algorithm.

This changes the default from Zstd (level 1) to Snappy.

     $ dgraph bulk --help
     ...
     Flags:
     ...
            --badger.compression string        [none, zstd:level, snappy] Specifies the compression algorithm and the compressionlevel (if applicable) for the postings directory. none would disable compression, while zstd:1 would set zstd compression at level 1. (default "snappy")
@github-actions github-actions bot added the area/bulk-loader Issues related to bulk loading. label Oct 10, 2020
Copy link
Contributor

@manishrjain manishrjain left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm:

Reviewed 3 of 3 files at r1.
Reviewable status: :shipit: complete! all files reviewed, all discussions resolved (waiting on @vvbalaji-dgraph)

@danielmai danielmai changed the title [BREAKING] feat(bulk): Use snappy compression by default. [BREAKING/cli-flags] feat(bulk): Use snappy compression by default. Oct 12, 2020
@danielmai danielmai merged commit a852d3c into master Oct 12, 2020
@danielmai danielmai deleted the danielmai/bulk-snappy branch October 12, 2020 16:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/bulk-loader Issues related to bulk loading.
Development

Successfully merging this pull request may close these issues.

2 participants