Skip to content

Conversation

@nastra
Copy link
Contributor

@nastra nastra commented Feb 19, 2025

This reverts the AWS SDK back to 2.29.52.
AWS SDK 2.30.0 added changes to the default integrity protection (see aws/aws-sdk-java-v2#5802, which negatively affects S3-compliant object storage solutions

Copy link
Contributor

@sullis sullis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Fokko
Copy link
Contributor

Fokko commented Feb 19, 2025

@nastra We should update the version in {LICENSE,NOTICE} as well 👍

Copy link
Contributor

@ebyhr ebyhr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you Eduard, I confirmed this PR fixes checksum failures on MinIO pre-2025.

@nastra nastra merged commit 673192d into apache:1.8.x Feb 20, 2025
46 checks passed
@nastra nastra deleted the revert-sdk-bump branch February 20, 2025 07:19
yaooqinn pushed a commit to apache/spark that referenced this pull request Apr 27, 2025
### What changes were proposed in this pull request?

This PR aims to upgrade AWS SDK v2 to 2.29.52.

### Why are the changes needed?

Like [Apache Iceberg v1.8.1](https://iceberg.apache.org/releases/#181-release) and Apache Hadoop 3.4.2 (HADOOP-19485), Apache Spark 4.1.0 had better use the latest one.
- apache/hadoop#7479
- apache/iceberg#12339

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #50731 from dongjoon-hyun/SPARK-51929.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Kent Yao <[email protected]>
yhuang-db pushed a commit to yhuang-db/spark that referenced this pull request Jun 9, 2025
### What changes were proposed in this pull request?

This PR aims to upgrade AWS SDK v2 to 2.29.52.

### Why are the changes needed?

Like [Apache Iceberg v1.8.1](https://iceberg.apache.org/releases/#181-release) and Apache Hadoop 3.4.2 (HADOOP-19485), Apache Spark 4.1.0 had better use the latest one.
- apache/hadoop#7479
- apache/iceberg#12339

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#50731 from dongjoon-hyun/SPARK-51929.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Kent Yao <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants