Add new DLM Frozen Tier Transition execution plugin and service#144595
Merged
lukewhiting merged 17 commits intoelastic:mainfrom Mar 26, 2026
Merged
Add new DLM Frozen Tier Transition execution plugin and service#144595lukewhiting merged 17 commits intoelastic:mainfrom
lukewhiting merged 17 commits intoelastic:mainfrom
Conversation
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR adds a new X-Pack plugin for the DLM frozen tier and creates an execution framework for that transition.
Essentially there's a scheduler thread that checks for new indices with the "To transition" metadata maker every X minutes.
If it finds any, it checks if that index is already being transitioned and that there's available threads to execute the transition. If there is, it starts the transition on a thread in it's managed, fixed size thread pool. If not, the index is skipped if executing or all remaining indices are skipped if the thread pool is at capacity.
All this is gated behind a feature flag.
Also depends on #144511 to make Datas Streams plugin extensible / module exposed.
Fixes elastic/elasticsearch-team#2433