Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove aws-java-sdk-bundle from release #204

Merged
merged 1 commit into from
Jun 1, 2023
Merged

Remove aws-java-sdk-bundle from release #204

merged 1 commit into from
Jun 1, 2023

Conversation

ismailsimsek
Copy link
Member

@ismailsimsek ismailsimsek commented Jun 1, 2023

remove s3 bundle dependency which is very large in size.

as an alternative S3FileIO could be used this is the recommended file IO for s3.

S3FileIO adopts the latest AWS clients and S3 features for optimized security and performance and is thus recommended for S3 use cases rather than the S3A FileSystem.

further details:
https://iceberg.apache.org/docs/1.4.0/aws/#s3-fileio

https://iceberg.apache.org/docs/1.4.0/aws/#hadoop-s3a-filesystem

@ismailsimsek ismailsimsek changed the title Remove hadoop (and aws-java-sdk-bundle) dependencies from release Remove aws-java-sdk-bundle dependency from release Jun 1, 2023
@ismailsimsek ismailsimsek changed the title Remove aws-java-sdk-bundle dependency from release Remove aws-java-sdk-bundle from release Jun 1, 2023
@ismailsimsek ismailsimsek merged commit 85abcd7 into memiiso:master Jun 1, 2023
@ismailsimsek ismailsimsek deleted the remove_aws_bundle_dep branch June 1, 2023 10:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant