Skip to content

Conversation

@hendrikmuhs
Copy link

@hendrikmuhs hendrikmuhs commented Mar 10, 2021

The node attribute transform.node has been introduced in #52712 (7.7) to implement dedicated transform nodes. A technical limitation in the stack made it necessary to use this workaround. This limitation has been removed by #54998 (7.9). It is now possible to find out, if a node is a transform node without using the node attribute. This PR deprecates the node attribute and bases the placement decision on the node role. The attribute gets unused for placement, however we can not remove the node attribute yet, because in a mixed version cluster the attribute might still be used, especially when master gets updated last. The node attribute will be completely removed in 8, as the upgrade path requires to upgrade to 7.last before upgrading to 8.x.

Note: transform.node is an internal implementation detail, setting this attribute from outside is prohibited (throws an exception).

…ead.

For BWC the node attribute must still be set in 7.x but can be removed in 8.0
@elasticmachine elasticmachine added the Team:ML Meta label for the ML team label Mar 10, 2021
@elasticsearchmachine elasticsearchmachine added the external-contributor Pull request authored by a developer outside the Elasticsearch team label Mar 10, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (Team:ML)

@hendrikmuhs hendrikmuhs removed the external-contributor Pull request authored by a developer outside the Elasticsearch team label Mar 10, 2021
Copy link
Contributor

@przemekwitek przemekwitek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@hendrikmuhs hendrikmuhs merged commit cff770b into elastic:master Mar 11, 2021
@hendrikmuhs hendrikmuhs deleted the deprecate-transform-node-attribute branch March 11, 2021 07:00
hendrikmuhs pushed a commit that referenced this pull request Mar 11, 2021
…70291)

The node attribute transform.node has been introduced in #52712 (7.7) to implement dedicated
transform nodes. A technical limitation in the stack made it necessary to use this workaround.
This limitation has been removed by #54998 (7.9). It is now possible to find out, if a node is a
transform node without using the node attribute. This PR deprecates the node attribute and bases
the placement decision on the node role. The attribute gets unused for placement, however we can
not remove the node attribute yet, because in a mixed version cluster the attribute might still
be used, especially when master gets updated last. The node attribute will be completely removed
in 8, as the upgrade path requires to upgrade to 7.last before upgrading to 8.x.

backport #70234
probakowski pushed a commit to probakowski/elasticsearch that referenced this pull request Mar 15, 2021
The node attribute transform.node has been introduced in elastic#52712 (7.7) to implement dedicated
transform nodes. A technical limitation in the stack made it necessary to use this workaround.
This limitation has been removed by elastic#54998 (7.9). It is now possible to find out, if a node is a
transform node without using the node attribute. This PR deprecates the node attribute and bases
the placement decision on the node role. The attribute gets unused for placement, however we can
not remove the node attribute yet, because in a mixed version cluster the attribute might still
be used, especially when master gets updated last. The node attribute will be completely removed
in 8, as the upgrade path requires to upgrade to 7.last before upgrading to 8.x.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants