Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Possible issue with multiple calls of detaching disk or detaching already detached disk #31

Open
chrisvdg opened this issue Nov 8, 2019 · 0 comments
Labels
bug Something isn't working
Milestone

Comments

@chrisvdg
Copy link
Contributor

chrisvdg commented Nov 8, 2019

This is possibly happening when deleting a pvc that has not been published onto a node, causing the delete of it triggering a detach which OVC will respond with an error as it is already detached (an incorrect state for this action).

If this is the case, a check is needed to see if the volume is already detached and not raise an error.

Logs from the csi-plugin container of the provisioner pod.

I1108 14:22:09.309888       1 controller.go:1040] provision "default/konijnen-kopen-dot-be-wordpress" class "gig.tech-ovc-k8s-storage-provider": trying to save persistentvolume "pvc-65a530db-d6a8-44a6-a9f8-27c12384733b"
I1108 14:22:09.313585       1 controller.go:1047] provision "default/konijnen-kopen-dot-be-wordpress" class "gig.tech-ovc-k8s-storage-provider": persistentvolume "pvc-65a530db-d6a8-44a6-a9f8-27c12384733b" saved
I1108 14:22:09.314163       1 controller.go:1088] provision "default/konijnen-kopen-dot-be-wordpress" class "gig.tech-ovc-k8s-storage-provider": succeeded
I1108 14:22:09.314461       1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"konijnen-kopen-dot-be-wordpress", UID:"65a530db-d6a8-44a6-a9f8-27c12384733b", APIVersion:"v1", ResourceVersion:"153409", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-65a530db-d6a8-44a6-a9f8-27c12384733b
I1108 14:25:02.221876       1 controller.go:1097] delete "pvc-65a530db-d6a8-44a6-a9f8-27c12384733b": started
E1108 14:25:10.341677       1 controller.go:1120] delete "pvc-65a530db-d6a8-44a6-a9f8-27c12384733b": volume deletion failed: rpc error: code = Internal desc = "Can only detach disks from machines in states RUNNING, PAUSED, HALTED: state of 7039 is DETACHING_DISK"
W1108 14:25:10.341776       1 controller.go:726] Retrying syncing volume "pvc-65a530db-d6a8-44a6-a9f8-27c12384733b" because failures 0 < threshold 15
E1108 14:25:10.341821       1 controller.go:741] error syncing volume "pvc-65a530db-d6a8-44a6-a9f8-27c12384733b": rpc error: code = Internal desc = "Can only detach disks from machines in states RUNNING, PAUSED, HALTED: state of 7039 is DETACHING_DISK"
I1108 14:25:10.341959       1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-65a530db-d6a8-44a6-a9f8-27c12384733b", UID:"a6c0bfa9-9968-40e6-bf00-86d6b5631ea7", APIVersion:"v1", ResourceVersion:"153914", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' rpc error: code = Internal desc = "Can only detach disks from machines in states RUNNING, PAUSED, HALTED: state of 7039 is DETACHING_DISK"
@chrisvdg chrisvdg added the bug Something isn't working label Nov 8, 2019
@FastGeert FastGeert added this to the 1.0.1 milestone Mar 2, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants