Skip to content

Conversation

@wendigo
Copy link
Contributor

@wendigo wendigo commented Jan 22, 2025

This solves an issue with connection leaks that are happening for Azure Storage SDK
when OkHttp is used. OkHttp is not actively maintained, which makes the default,
Netty implementation, a better choice for the future as it's actively maintained
and tested.

Fixes #24116

Description

Additional context and related issues

Release notes

( ) This is not user-visible or is docs only, and no release notes are required.
( ) Release notes are required. Please propose a release note for me.
( ) Release notes are required, with the following suggested text:

## Section
* Fix some things. ({issue}`issuenumber`)

@cla-bot cla-bot bot added the cla-signed label Jan 22, 2025
@github-actions github-actions bot added the delta-lake Delta Lake connector label Jan 22, 2025
@wendigo wendigo force-pushed the serafin/switch-to-netty branch 3 times, most recently from dc763a8 to e92b714 Compare January 27, 2025 15:58
@wendigo wendigo requested a review from losipiuk January 29, 2025 13:20
Copy link
Member

@losipiuk losipiuk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This requires some testing. I do not have confidence changed config are fine. Possible those are but I do not have experience with azure.

@wendigo
Copy link
Contributor Author

wendigo commented Jan 29, 2025

@losipiuk I'm testing this internally

@wendigo wendigo changed the title Switch Azure FS http client to netty Fix connection leakage in native Azure filesystem Jan 30, 2025
This solves an issue with connection leaks that are happening for Azure Storage SDK
when OkHttp is used. OkHttp is not actively maintained, which makes the default,
Netty implementation, a better choice for the future as it's actively maintained
and tested.
@wendigo wendigo force-pushed the serafin/switch-to-netty branch from e92b714 to 29f89d8 Compare January 30, 2025 10:24
Event loop group/maximum number of concurrent requests are already configured
so the removed setting was a noop.
@wendigo wendigo merged commit cb6a940 into master Jan 30, 2025
103 of 104 checks passed
@wendigo wendigo deleted the serafin/switch-to-netty branch January 30, 2025 11:38
@github-actions github-actions bot added this to the 470 milestone Jan 30, 2025
@mosabua
Copy link
Member

mosabua commented Jan 30, 2025

Release notes entry needed?

@wendigo
Copy link
Contributor Author

wendigo commented Jan 30, 2025

@mosabua yes please

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla-signed delta-lake Delta Lake connector

Development

Successfully merging this pull request may close these issues.

Connection leaks on native Azure filesystem

4 participants