Skip to content

Track active requests in S3FileSystemExchangeStorage#14574

Merged
arhimondr merged 1 commit intotrinodb:masterfrom
arhimondr:instrument-aws-client
Oct 13, 2022
Merged

Track active requests in S3FileSystemExchangeStorage#14574
arhimondr merged 1 commit intotrinodb:masterfrom
arhimondr:instrument-aws-client

Conversation

@arhimondr
Copy link
Copy Markdown
Contributor

Description

To help diagnose the issue described in #14496

Non-technical explanation

N/A

Release notes

(X) This is not user-visible or docs only and no release notes are required.
( ) Release notes are required, please propose a release note for me.
( ) Release notes are required, with the following suggested text:

# Section
* Fix some things. ({issue}`issuenumber`)

@cla-bot cla-bot bot added the cla-signed label Oct 11, 2022
@arhimondr arhimondr force-pushed the instrument-aws-client branch from ce3639b to ec2b884 Compare October 11, 2022 18:50
@arhimondr arhimondr force-pushed the instrument-aws-client branch from ec2b884 to 7f7aec3 Compare October 11, 2022 21:52
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

where exactly are the separate requests for pages handled?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is done by passing the reference to the wrapper to the ListObjectsV2Publisher

return new ListObjectsV2Publisher(this, applyPaginatorUserAgent(listObjectsV2Request));

@arhimondr arhimondr force-pushed the instrument-aws-client branch from 7f7aec3 to 1119993 Compare October 12, 2022 14:28
@arhimondr arhimondr changed the title Log active requests summary in S3FileSystemExchangeStorage Track active requests in S3FileSystemExchangeStorage Oct 12, 2022
@linzebing
Copy link
Copy Markdown
Member

We no longer need this PR, right?

@losipiuk
Copy link
Copy Markdown
Member

We no longer need this PR, right?

Exposing stats via JMX is still nice. I would keep it.

@arhimondr arhimondr merged commit a55fa83 into trinodb:master Oct 13, 2022
@arhimondr arhimondr deleted the instrument-aws-client branch October 13, 2022 15:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

4 participants