Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade rs-async-zip to support data descriptors #2809

Merged
merged 5 commits into from
Apr 4, 2024

Conversation

charliermarsh
Copy link
Member

@charliermarsh charliermarsh commented Apr 3, 2024

Summary

Upgrading rs-async-zip enables us to support data descriptors in streaming. This both greatly improves performance for indexes that use data descriptors and ensures that we support them in a few other places (e.g., zipped source distributions created in Finder).

Closes #2808.

@charliermarsh charliermarsh force-pushed the charlie/async-zip branch 3 times, most recently from a65cd2a to f3b68b3 Compare April 3, 2024 22:05
@charliermarsh
Copy link
Member Author

I've fixed all the perf regressions (and now see improvements, and significant improvements for files that use data descriptors), but I'm now seeing a very rare and sporadic "end of file" failure in some cases for files that contain data descriptors (Majored/rs-async-zip#122 (comment)).

@charliermarsh charliermarsh marked this pull request as ready for review April 4, 2024 01:26
@charliermarsh charliermarsh enabled auto-merge (squash) April 4, 2024 01:27
@charliermarsh charliermarsh merged commit dc2c289 into main Apr 4, 2024
15 checks passed
@charliermarsh charliermarsh deleted the charlie/async-zip branch April 4, 2024 01:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Upgrade rs-async-zip to support data descriptors
1 participant