Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[operator] Automatic updates are broken since 7.15.1 #17556

Closed
3 of 10 tasks
ibuziuk opened this issue Aug 4, 2020 · 11 comments
Closed
3 of 10 tasks

[operator] Automatic updates are broken since 7.15.1 #17556

ibuziuk opened this issue Aug 4, 2020 · 11 comments
Labels
area/che-operator Issues and PRs related to Eclipse Che Kubernetes Operator kind/bug Outline of a bug - must adhere to the bug report template. new&noteworthy For new and/or noteworthy issues that deserve a blog post, new docs, or emphasis in release notes severity/P1 Has a major impact to usage or development of the system.
Milestone

Comments

@ibuziuk
Copy link
Member

ibuziuk commented Aug 4, 2020

Describe the bug

Reproduced against dogfooding instance on OSD v4 where automatic updates are enabled:

  • che-operator version on the cluster - 7.16.2
  • che version on the cluster - 7.15.0

Che version

  • latest
  • nightly
  • other: please specify

Steps to reproduce

Expected behavior

both che and operator versions and identical

Runtime

  • kubernetes (include output of kubectl version)
  • Openshift / OSD v4 (include output of oc version)
  • minikube (include output of minikube version and kubectl version)
  • minishift (include output of minishift version and oc version)
  • docker-desktop + K8S (include output of docker version and kubectl version)
  • other: (please specify)

Screenshots

Logs

Not sure if related but there are multiple logs:

time="2020-08-04T09:45:39Z" level=error msg="Failed to detect if self-signed certificate used. Cause: routes.route.openshift.io \"test\" already exists"
time="2020-08-03T20:11:32Z" level=error msg="Failed to create test route 'test': routes.route.openshift.io \"test\" already exists"

might be broken due to test route creation:

	if len(endpointURL) < 1 {
		// Create test route to get certificates chain.
		// Note, it is not possible to use SyncRouteToCluster here as it may cause infinite reconcile loop.
		routeSpec, err := GetSpecRoute(instance, "test", "test", 8080, clusterAPI)
		if err != nil {
			return nil, err
		}

Installation method

  • OperatorHub
@ibuziuk ibuziuk added the kind/bug Outline of a bug - must adhere to the bug report template. label Aug 4, 2020
@che-bot che-bot added the status/need-triage An issue that needs to be prioritized by the curator responsible for the triage. See https://github. label Aug 4, 2020
@ibuziuk ibuziuk added severity/P1 Has a major impact to usage or development of the system. area/che-operator Issues and PRs related to Eclipse Che Kubernetes Operator and removed status/need-triage An issue that needs to be prioritized by the curator responsible for the triage. See https://github. labels Aug 4, 2020
@tolusha
Copy link
Contributor

tolusha commented Aug 4, 2020

That's strange.
I've just checked updating from 7.15.0 to 7.16.2 and it works.
Could you just remove test route?
oc delete route test -n <namespace>

@ibuziuk
Copy link
Member Author

ibuziuk commented Aug 4, 2020

@tolusha well it is definitely an issue with updates on OSD v4 Dogfooding instance - you can check it there. Also, the same issue was reported against OCP v4

@tolusha
Copy link
Contributor

tolusha commented Aug 4, 2020

I see. This this the case when a real (not a self-signed) certificate is used.

@tolusha
Copy link
Contributor

tolusha commented Aug 4, 2020

Meanwhile pls use the workaround to proceed the installation.

@tolusha
Copy link
Contributor

tolusha commented Aug 4, 2020

Fixed by eclipse-che/che-operator@08c51a4

@tolusha tolusha closed this as completed Aug 4, 2020
@tolusha tolusha added this to the 7.17 milestone Aug 4, 2020
@ibuziuk
Copy link
Member Author

ibuziuk commented Aug 4, 2020

@tolusha will wait for 7.17.0 and verify it against. Is there any impact on CRW 2.2 -> 2.3 update cc: @rhopp ?

@tolusha
Copy link
Contributor

tolusha commented Aug 4, 2020

@ibuziuk
that's a good question.
it is better to apply the same fix for 7.16.x branch.

@alexeykazakov
Copy link

Meanwhile pls use the workaround to proceed the installation.

What is the workaround?

@tolusha
Copy link
Contributor

tolusha commented Aug 5, 2020

The workaround is to delete test route
oc delete route test -n <namespace>

@alexeykazakov
Copy link

I've deleted the test route but the che server was not re-deployed. It's still running an old version.

@tolusha
Copy link
Contributor

tolusha commented Aug 6, 2020

Scale down/up che-operator deployment.
Eclipse Che will start deploying from the beginning.

@l0rd l0rd added the new&noteworthy For new and/or noteworthy issues that deserve a blog post, new docs, or emphasis in release notes label Aug 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/che-operator Issues and PRs related to Eclipse Che Kubernetes Operator kind/bug Outline of a bug - must adhere to the bug report template. new&noteworthy For new and/or noteworthy issues that deserve a blog post, new docs, or emphasis in release notes severity/P1 Has a major impact to usage or development of the system.
Projects
None yet
Development

No branches or pull requests

5 participants