Skip to content

Conversation

@DaveCTurner
Copy link
Contributor

Today TransportRolloverAction$RolloverExecutor captures a RolloverResult for each task for use in the publication success callback. These things contain a cluster state which can be huge, and isn't necessary for the callback. With this commit we extract the fields we need instead, avoiding capturing the complete cluster state.

Closes #90620

Today `TransportRolloverAction$RolloverExecutor` captures a
`RolloverResult` for each task for use in the publication success
callback. These things contain a cluster state which can be huge, and
isn't necessary for the callback. With this commit we extract the fields
we need instead, avoiding capturing the complete cluster state.

Closes elastic#90620
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-data-management (Team:Data Management)

@elasticsearchmachine
Copy link
Collaborator

Hi @DaveCTurner, I've created a changelog YAML for you.

@elasticsearchmachine elasticsearchmachine added the Team:Data Management Meta label for data/management team label Oct 4, 2022
Copy link
Contributor

@andreidan andreidan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing this David, and thanks Armin for finding this issue (great catch!)

LGTM

@DaveCTurner DaveCTurner merged commit 62d2eee into elastic:main Oct 4, 2022
@DaveCTurner DaveCTurner deleted the 2022-10-04-avoid-RolloverResult-capture branch October 4, 2022 10:32
@elasticsearchmachine
Copy link
Collaborator

💚 Backport successful

Status Branch Result
8.5

DaveCTurner added a commit to DaveCTurner/elasticsearch that referenced this pull request Oct 4, 2022
Today `TransportRolloverAction$RolloverExecutor` captures a
`RolloverResult` for each task for use in the publication success
callback. These things contain a cluster state which can be huge, and
isn't necessary for the callback. With this commit we extract the fields
we need instead, avoiding capturing the complete cluster state.

Closes elastic#90620
elasticsearchmachine pushed a commit that referenced this pull request Oct 4, 2022
Today `TransportRolloverAction$RolloverExecutor` captures a
`RolloverResult` for each task for use in the publication success
callback. These things contain a cluster state which can be huge, and
isn't necessary for the callback. With this commit we extract the fields
we need instead, avoiding capturing the complete cluster state.

Closes #90620
@csoulios csoulios added v8.5.0 and removed v8.5.1 labels Nov 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

>bug :Data Management/Indices APIs APIs to create and manage indices and templates Team:Data Management Meta label for data/management team v8.5.0 v8.6.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

TransportRolloverAction retains as many cluster state as there are rollover tasks waiting in a batch consuming too much memory

5 participants