-
-
Notifications
You must be signed in to change notification settings - Fork 125
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add lz4 compression to planetiler #1104
Conversation
flymarq
commented
Nov 17, 2024
- lz4 compressed files can be generated with libosmium based tools like osmium or python scripts using pyosmium like pyosmium-up-to-date
- lz4 compressed files are bigger (~15-20%) then zlib compressed files but much faster to produce and process
- this patch is in use by us for several month without any problems
- lz4 compressed files can be generated with libosmium based tools like osmium or python scripts using pyosmium like pyosmium-up-to-date - lz4 compressed files are bigger (~15-20%) then zlib compressed files but much faster to produce and process - this patch is in use by us for several month without any problems
planetiler-core/src/main/java/com/onthegomap/planetiler/reader/osm/PbfDecoder.java
Show resolved
Hide resolved
Full logs: https://github.com/onthegomap/planetiler/actions/runs/11988189472 |
planetiler-core/src/main/java/com/onthegomap/planetiler/reader/osm/PbfDecoder.java
Outdated
Show resolved
Hide resolved
planetiler-core/src/main/java/com/onthegomap/planetiler/reader/osm/PbfDecoder.java
Outdated
Show resolved
Hide resolved
|
Thank you for fixing all open issues - I didn't find free time to do it so quickly. I successfully tested the current main branch without any additional patches on a LZ4 compressed planet file. |