[Upgrade Assistant] Remove index_mapper_dynamic setting when reindexing#119008
Closed
sabarasaba wants to merge 4 commits intoelastic:mainfrom
Closed
[Upgrade Assistant] Remove index_mapper_dynamic setting when reindexing#119008sabarasaba wants to merge 4 commits intoelastic:mainfrom
sabarasaba wants to merge 4 commits intoelastic:mainfrom
Conversation
sabarasaba
added
Feature:Upgrade Assistant
release_note:skip
Member
Author
|
@elasticmachine merge upstream |
Contributor
|
Pinging @elastic/kibana-stack-management (Team:Stack Management) |
sabarasaba
added
the
auto-backport
Member
Author
|
@elasticmachine merge upstream |
💚 Build Succeeded
Metrics [docs]
History
To update your PR or re-run it, just comment with: cc @sabarasaba |
Member
Author
|
Closed in favour of #119441 that points to 7.16 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
As surfaced by #116212, when updating from 5.5 to 6.20 to 7.16 and attempting to reindex
.reindexed-v6-kibana-6users get an error sayingSetting index.mapper.dynamic was removed after version 6.0.0. This is a manual deprecation that needs to be solved before running the reindex process. Turns out that within the UA reindexing code there's a list of blacklisted settings that get removed before the reindexing runs and this particular setting, that was removed with elasticsearch#51718, is not there.How to test
yarn es snapshot -E path.data=/path/to/5.5-data-snapshot. This contains indices from 5.5 that where migrated to 6.8 and then to 7.16.Stack Management->Upgrade Assistant->ES deprecation issues.reindexed-v6-kibana-6there are two critical deprecations:Index created before 7.0andSetting [index.mapper.dynamic] is deprecatedIndex created before 7.0deprecation and verify that it can be successfully re-indexedRefreshCTA from theES deprecation issuespage, theSetting [index.mapper.dynamic] is deprecateddeprecation is gone.If after following the steps you don't see any deprecations for es in upgrade assistant, try unzipping the folder in the
kibana/.esfolder and starting up es with:yarn es snapshot -E path.data=../5.5-data-snapshotScreenshots
before/after
// With error
// Solved deprecation
