Skip to content

Pin boto3<1.36.0 because 1.36 introduces breaking changes#270

Merged
psrok1 merged 1 commit intomasterfrom
fix/pin-boto3-before-1.36
Jan 22, 2025
Merged

Pin boto3<1.36.0 because 1.36 introduces breaking changes#270
psrok1 merged 1 commit intomasterfrom
fix/pin-boto3-before-1.36

Conversation

@psrok1
Copy link
Member

@psrok1 psrok1 commented Jan 22, 2025

boto3 1.36.0 introduces incompatible changes with non-AWS S3 providers related with integrity checksums: boto/boto3#4392

In our case, it resulted in MissingContentMD5 error thrown by MinIO on DeleteObjects call #269 because boto3 1.36.0 completely removes Content-MD5 evaluation and that's a required header by our MinIO version. Evaluation removal was done here: boto/botocore@590103b#diff-6430b10ddffa7de73a08acc48a810a748dc2b01197c28fc974699d3d1fe9e4ffL1362

MinIO adds support for new integrity checksums in fresh release:

but as we don't explicitly require a specific S3 provider and boto3 has still compatibility issues with non-AWS ones, it's much more safe to pin to the previous version for a while and wait until issues are resolved.

closes #269

@psrok1 psrok1 merged commit fc7f0b2 into master Jan 22, 2025
7 checks passed
@psrok1 psrok1 deleted the fix/pin-boto3-before-1.36 branch January 22, 2025 15:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

GC: An error occurred (MissingContentMD5) when calling the DeleteObjects operation: Missing required header for this request: Content-Md5.

1 participant