Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Transform] prevent assignment to nodes older than 7.4 #48044

Closed

Conversation

hendrikmuhs
Copy link

do not allow assignment of transforms to nodes older than 7.4 (in mixed clusters).

fixes #48019

@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (:ml/Transform)

Copy link
Contributor

@droberts195 droberts195 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@hendrikmuhs
Copy link
Author

run elasticsearch-ci/2

@hendrikmuhs
Copy link
Author

run elasticsearch-ci/bwc

node.isDataNode() &&
// see gh#48019 older nodes might not be able to read documents
node.getVersion().onOrAfter(Version.V_7_4_0) &&
node.getVersion().onOrAfter(params.getVersion())
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should not allow assignment at all in a mixed cluster where a <= 7.3 node is present. If the task is running and somebody makes a stats call, that stats call could be made against a 7.3 node which queries the wrong index and incorrectly says that the transform does not exist.

@hendrikmuhs
Copy link
Author

superseeded by #48055

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Transform] transform jobs on nodes < 7.4.0 mixed with nodes > 7.4 might fail
5 participants