Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

csi: missing plugins during node delete are not an error #8619

Merged
merged 1 commit into from
Aug 10, 2020

Conversation

tgross
Copy link
Member

@tgross tgross commented Aug 10, 2020

Fixes #8121

When deregistering a client, CSI plugins running on that client may not get a
chance to fingerprint before being stopped. Account for the case where a
plugin allocation is the last instance of the plugin and has been deleted from
the state store to avoid errors during node deregistration.

When deregistering a client, CSI plugins running on that client may not get a
chance to fingerprint before being stopped. Account for the case where a
plugin allocation is the last instance of the plugin and has been deleted from
the state store to avoid errors during node deregistration.
Copy link
Contributor

@langmartin langmartin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Doublecheck: the alloc was already GC'd, which is what deleted the plugin. After the alloc is already gone, the final fingerprint CSIInfo is sent to the server. There's no other race in play?

@tgross
Copy link
Member Author

tgross commented Aug 10, 2020

Doublecheck: the alloc was already GC'd, which is what deleted the plugin. After the alloc is already gone, the final fingerprint CSIInfo is sent to the server. There's no other race in play?

The original report didn't have a lot of detail and the person seems to have abandoned the issue, but that's what looks like happened. The fingerprint happens on the node fingerprint timer (every 30s IIRC, which is also the cause of #7296), whereas the plugin cleanup for the allocs happens immediately.

@tgross tgross merged commit bf67737 into master Aug 10, 2020
@tgross tgross deleted the b-csi-node-delete branch August 10, 2020 15:02
@drewbailey
Copy link
Contributor

Should this have a changelog entry?

@tgross
Copy link
Member Author

tgross commented Aug 10, 2020

It's in #8620

@drewbailey
Copy link
Contributor

My mistake, thanks!

@github-actions
Copy link

I'm going to lock this pull request because it has been closed for 120 days ⏳. This helps our maintainers find and focus on the active contributions.
If you have found a problem that seems related to this change, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Dec 25, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

After removing aws-ebs0 from the cluster deleting nodes fails
3 participants