Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support ZSTD on Parquet Preview #7675

Open
3 tasks done
aersam opened this issue Jan 15, 2024 · 3 comments
Open
3 tasks done

Support ZSTD on Parquet Preview #7675

aersam opened this issue Jan 15, 2024 · 3 comments
Labels
💡 feature request New feature or request
Milestone

Comments

@aersam
Copy link

aersam commented Jan 15, 2024

Preflight Checklist

Problem

When previewing a parquet file with ZSTD Compression, I get this error: { "name": null, "message": "\"invalid compression method: ZSTD\"" }

Desired Solution

Support ZSTD, I guess it will be used more and more often since it's often better than snappy

Alternatives and Workarounds

No response

Additional Context

No response

@JasonYeMSFT JasonYeMSFT added the 💡 feature request New feature or request label Jan 18, 2024
@MRayermannMSFT
Copy link
Member

Existing issue in the library we use asking for this as well: LibertyDSNP/parquetjs#77

@MRayermannMSFT MRayermannMSFT added this to the Near Future milestone Jan 22, 2024
@MRayermannMSFT
Copy link
Member

We're going to put this in near future for now, given the work required to support ZSTD compression. If you are interested in this, please thumbs up react to this issue, and if possible, leave a comment detailing anything additional regarding your interest.
image

@ravitalize
Copy link

Yes. A preview option over the ZSTD parquet would really help.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
💡 feature request New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants