-
Notifications
You must be signed in to change notification settings - Fork 54
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Flake in operator-developer-e2e: unexpected status conditions for the operator #481
Comments
I suspect it might be related to #444 or some other recent changes because I do not see anything similar in job history from two weeks ago. |
It would help to have the test failure error include the condition reason and message. |
Agreed. I created #483 for this |
We somehow end up with two Note that the message is the same almost as if we are writing condition to the wrong operator CR.
|
Resolution is global, so unsat resolutions will propogate to all |
Didn't know that, but this makes sense! |
I think it is a combination of two things:
Here are two green runs. Note that after #444 Before #444 (commit c9d387e)# Before #444
# kubectl get operators -o yaml -w
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:22:29Z"
generation: 1
name: registry-operator
resourceVersion: "1200"
uid: 27fb53ca-9c3e-42e4-be06-030f072bf1e2
spec:
packageName: registry-operator
upgradeConstraintPolicy: Enforce
version: 0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:22:29Z"
generation: 1
name: registry-operator
resourceVersion: "1202"
uid: 27fb53ca-9c3e-42e4-be06-030f072bf1e2
spec:
packageName: registry-operator
upgradeConstraintPolicy: Enforce
version: 0.1.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:22:29Z"
message: resolved to "localhost:5001/registry-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Resolved
- lastTransitionTime: "2023-10-24T13:22:29Z"
message: bundledeployment status is unknown
observedGeneration: 1
reason: InstallationStatusUnknown
status: Unknown
type: Installed
resolvedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:22:29Z"
generation: 1
name: registry-operator
resourceVersion: "1270"
uid: 27fb53ca-9c3e-42e4-be06-030f072bf1e2
spec:
packageName: registry-operator
upgradeConstraintPolicy: Enforce
version: 0.1.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:22:29Z"
message: resolved to "localhost:5001/registry-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Resolved
- lastTransitionTime: "2023-10-24T13:22:34Z"
message: installed from "localhost:5001/registry-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Installed
installedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
resolvedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:22:29Z"
generation: 2
name: registry-operator
resourceVersion: "1281"
uid: 27fb53ca-9c3e-42e4-be06-030f072bf1e2
spec:
packageName: registry-operator
upgradeConstraintPolicy: Enforce
version: 0.2.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:22:29Z"
message: resolved to "localhost:5001/registry-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Resolved
- lastTransitionTime: "2023-10-24T13:22:34Z"
message: installed from "localhost:5001/registry-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Installed
installedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
resolvedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:22:29Z"
generation: 2
name: registry-operator
resourceVersion: "1283"
uid: 27fb53ca-9c3e-42e4-be06-030f072bf1e2
spec:
packageName: registry-operator
upgradeConstraintPolicy: Enforce
version: 0.2.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:22:29Z"
message: resolved to "localhost:5001/registry-operator-bundle:v0.2.0"
observedGeneration: 2
reason: Success
status: "True"
type: Resolved
- lastTransitionTime: "2023-10-24T13:22:34Z"
message: installed from "localhost:5001/registry-operator-bundle:v0.2.0"
observedGeneration: 2
reason: Success
status: "True"
type: Installed
installedBundleResource: localhost:5001/registry-operator-bundle:v0.2.0
resolvedBundleResource: localhost:5001/registry-operator-bundle:v0.2.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:22:29Z"
generation: 2
name: registry-operator
resourceVersion: "1284"
uid: 27fb53ca-9c3e-42e4-be06-030f072bf1e2
spec:
packageName: registry-operator
upgradeConstraintPolicy: Enforce
version: 0.2.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:22:29Z"
message: resolved to "localhost:5001/registry-operator-bundle:v0.2.0"
observedGeneration: 2
reason: Success
status: "True"
type: Resolved
- lastTransitionTime: "2023-10-24T13:22:34Z"
message: installed from "localhost:5001/registry-operator-bundle:v0.2.0"
observedGeneration: 2
reason: Success
status: "True"
type: Installed
installedBundleResource: localhost:5001/registry-operator-bundle:v0.2.0
resolvedBundleResource: localhost:5001/registry-operator-bundle:v0.2.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:22:48Z"
generation: 1
name: plain-operator
resourceVersion: "1377"
uid: ecd7cfaa-c693-4bf7-894a-3957526a657b
spec:
packageName: plain-operator
upgradeConstraintPolicy: Enforce
version: 0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:22:48Z"
generation: 1
name: plain-operator
resourceVersion: "1379"
uid: ecd7cfaa-c693-4bf7-894a-3957526a657b
spec:
packageName: plain-operator
upgradeConstraintPolicy: Enforce
version: 0.1.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:22:48Z"
message: resolved to "localhost:5001/plain-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Resolved
- lastTransitionTime: "2023-10-24T13:22:48Z"
message: bundledeployment status is unknown
observedGeneration: 1
reason: InstallationStatusUnknown
status: Unknown
type: Installed
resolvedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:22:48Z"
generation: 1
name: plain-operator
resourceVersion: "1445"
uid: ecd7cfaa-c693-4bf7-894a-3957526a657b
spec:
packageName: plain-operator
upgradeConstraintPolicy: Enforce
version: 0.1.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:22:48Z"
message: resolved to "localhost:5001/plain-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Resolved
- lastTransitionTime: "2023-10-24T13:22:52Z"
message: installed from "localhost:5001/plain-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Installed
installedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
resolvedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:22:48Z"
generation: 2
name: plain-operator
resourceVersion: "1466"
uid: ecd7cfaa-c693-4bf7-894a-3957526a657b
spec:
packageName: plain-operator
upgradeConstraintPolicy: Enforce
version: 0.2.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:22:48Z"
message: resolved to "localhost:5001/plain-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Resolved
- lastTransitionTime: "2023-10-24T13:22:52Z"
message: installed from "localhost:5001/plain-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Installed
installedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
resolvedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:22:48Z"
generation: 2
name: plain-operator
resourceVersion: "1468"
uid: ecd7cfaa-c693-4bf7-894a-3957526a657b
spec:
packageName: plain-operator
upgradeConstraintPolicy: Enforce
version: 0.2.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:22:48Z"
message: resolved to "localhost:5001/plain-operator-bundle:v0.2.0"
observedGeneration: 2
reason: Success
status: "True"
type: Resolved
- lastTransitionTime: "2023-10-24T13:22:52Z"
message: installed from "localhost:5001/plain-operator-bundle:v0.2.0"
observedGeneration: 2
reason: Success
status: "True"
type: Installed
installedBundleResource: localhost:5001/plain-operator-bundle:v0.2.0
resolvedBundleResource: localhost:5001/plain-operator-bundle:v0.2.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:22:48Z"
generation: 2
name: plain-operator
resourceVersion: "1469"
uid: ecd7cfaa-c693-4bf7-894a-3957526a657b
spec:
packageName: plain-operator
upgradeConstraintPolicy: Enforce
version: 0.2.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:22:48Z"
message: resolved to "localhost:5001/plain-operator-bundle:v0.2.0"
observedGeneration: 2
reason: Success
status: "True"
type: Resolved
- lastTransitionTime: "2023-10-24T13:22:52Z"
message: installed from "localhost:5001/plain-operator-bundle:v0.2.0"
observedGeneration: 2
reason: Success
status: "True"
type: Installed
installedBundleResource: localhost:5001/plain-operator-bundle:v0.2.0
resolvedBundleResource: localhost:5001/plain-operator-bundle:v0.2.0 After #444 (commit a00a93f)# After #444
# kubectl get operators -o yaml -w
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:14:34Z"
generation: 1
name: plain-operator
resourceVersion: "1161"
uid: bb10ccfc-3bbd-4f35-9c2d-1ec3581120d4
spec:
packageName: plain-operator
upgradeConstraintPolicy: Enforce
version: 0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:14:34Z"
generation: 1
name: plain-operator
resourceVersion: "1163"
uid: bb10ccfc-3bbd-4f35-9c2d-1ec3581120d4
spec:
packageName: plain-operator
upgradeConstraintPolicy: Enforce
version: 0.1.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:14:34Z"
message: resolved to "localhost:5001/plain-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Resolved
- lastTransitionTime: "2023-10-24T13:14:34Z"
message: bundledeployment status is unknown
observedGeneration: 1
reason: InstallationStatusUnknown
status: Unknown
type: Installed
resolvedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:14:34Z"
generation: 1
name: plain-operator
resourceVersion: "1232"
uid: bb10ccfc-3bbd-4f35-9c2d-1ec3581120d4
spec:
packageName: plain-operator
upgradeConstraintPolicy: Enforce
version: 0.1.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:14:34Z"
message: resolved to "localhost:5001/plain-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Resolved
- lastTransitionTime: "2023-10-24T13:14:39Z"
message: installed from "localhost:5001/plain-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Installed
installedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
resolvedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:14:34Z"
generation: 2
name: plain-operator
resourceVersion: "1251"
uid: bb10ccfc-3bbd-4f35-9c2d-1ec3581120d4
spec:
packageName: plain-operator
upgradeConstraintPolicy: Enforce
version: 0.2.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:14:34Z"
message: resolved to "localhost:5001/plain-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Resolved
- lastTransitionTime: "2023-10-24T13:14:39Z"
message: installed from "localhost:5001/plain-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Installed
installedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
resolvedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:14:34Z"
generation: 2
name: plain-operator
resourceVersion: "1252"
uid: bb10ccfc-3bbd-4f35-9c2d-1ec3581120d4
spec:
packageName: plain-operator
upgradeConstraintPolicy: Enforce
version: 0.2.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:14:40Z"
message: 'constraints not satisfiable: installed package plain-operator is mandatory;
installed package plain-operator requires at least one of plain-operator-catalog-plain-operator-plain-operator.v0.1.0;
plain-operator package uniqueness permits at most 1 of plain-operator-catalog-plain-operator-plain-operator.v0.2.0,
plain-operator-catalog-plain-operator-plain-operator.v0.1.0; required package
plain-operator is mandatory; required package plain-operator requires at least
one of plain-operator-catalog-plain-operator-plain-operator.v0.2.0'
observedGeneration: 2
reason: ResolutionFailed
status: "False"
type: Resolved
- lastTransitionTime: "2023-10-24T13:14:40Z"
message: installation has not been attempted as resolution is unsatisfiable
observedGeneration: 2
reason: InstallationStatusUnknown
status: Unknown
type: Installed
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:14:34Z"
generation: 2
name: plain-operator
resourceVersion: "1253"
uid: bb10ccfc-3bbd-4f35-9c2d-1ec3581120d4
spec:
packageName: plain-operator
upgradeConstraintPolicy: Enforce
version: 0.2.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:14:40Z"
message: 'constraints not satisfiable: installed package plain-operator is mandatory;
installed package plain-operator requires at least one of plain-operator-catalog-plain-operator-plain-operator.v0.1.0;
plain-operator package uniqueness permits at most 1 of plain-operator-catalog-plain-operator-plain-operator.v0.2.0,
plain-operator-catalog-plain-operator-plain-operator.v0.1.0; required package
plain-operator is mandatory; required package plain-operator requires at least
one of plain-operator-catalog-plain-operator-plain-operator.v0.2.0'
observedGeneration: 2
reason: ResolutionFailed
status: "False"
type: Resolved
- lastTransitionTime: "2023-10-24T13:14:40Z"
message: installation has not been attempted as resolution is unsatisfiable
observedGeneration: 2
reason: InstallationStatusUnknown
status: Unknown
type: Installed
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:15:05Z"
generation: 1
name: registry-operator
resourceVersion: "1378"
uid: 181493f6-d102-4f1b-8e63-03775d595278
spec:
packageName: registry-operator
upgradeConstraintPolicy: Enforce
version: 0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:15:05Z"
generation: 1
name: registry-operator
resourceVersion: "1380"
uid: 181493f6-d102-4f1b-8e63-03775d595278
spec:
packageName: registry-operator
upgradeConstraintPolicy: Enforce
version: 0.1.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:15:05Z"
message: resolved to "localhost:5001/registry-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Resolved
- lastTransitionTime: "2023-10-24T13:15:05Z"
message: bundledeployment status is unknown
observedGeneration: 1
reason: InstallationStatusUnknown
status: Unknown
type: Installed
resolvedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:15:05Z"
generation: 1
name: registry-operator
resourceVersion: "1445"
uid: 181493f6-d102-4f1b-8e63-03775d595278
spec:
packageName: registry-operator
upgradeConstraintPolicy: Enforce
version: 0.1.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:15:05Z"
message: resolved to "localhost:5001/registry-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Resolved
- lastTransitionTime: "2023-10-24T13:15:10Z"
message: installed from "localhost:5001/registry-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Installed
installedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
resolvedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:15:05Z"
generation: 2
name: registry-operator
resourceVersion: "1456"
uid: 181493f6-d102-4f1b-8e63-03775d595278
spec:
packageName: registry-operator
upgradeConstraintPolicy: Enforce
version: 0.2.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:15:05Z"
message: resolved to "localhost:5001/registry-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Resolved
- lastTransitionTime: "2023-10-24T13:15:10Z"
message: installed from "localhost:5001/registry-operator-bundle:v0.1.0"
observedGeneration: 1
reason: Success
status: "True"
type: Installed
installedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
resolvedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:15:05Z"
generation: 2
name: registry-operator
resourceVersion: "1457"
uid: 181493f6-d102-4f1b-8e63-03775d595278
spec:
packageName: registry-operator
upgradeConstraintPolicy: Enforce
version: 0.2.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:15:10Z"
message: 'constraints not satisfiable: installed package registry-operator is
mandatory; installed package registry-operator requires at least one of registry-operator-catalog-registry-operator-registry-operator.v0.1.0;
registry-operator package uniqueness permits at most 1 of registry-operator-catalog-registry-operator-registry-operator.v0.2.0,
registry-operator-catalog-registry-operator-registry-operator.v0.1.0; required
package registry-operator is mandatory; required package registry-operator requires
at least one of registry-operator-catalog-registry-operator-registry-operator.v0.2.0'
observedGeneration: 2
reason: ResolutionFailed
status: "False"
type: Resolved
- lastTransitionTime: "2023-10-24T13:15:10Z"
message: installation has not been attempted as resolution is unsatisfiable
observedGeneration: 2
reason: InstallationStatusUnknown
status: Unknown
type: Installed
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
creationTimestamp: "2023-10-24T13:15:05Z"
generation: 2
name: registry-operator
resourceVersion: "1459"
uid: 181493f6-d102-4f1b-8e63-03775d595278
spec:
packageName: registry-operator
upgradeConstraintPolicy: Enforce
version: 0.2.0
status:
conditions:
- lastTransitionTime: "2023-10-24T13:15:10Z"
message: 'constraints not satisfiable: installed package registry-operator is
mandatory; installed package registry-operator requires at least one of registry-operator-catalog-registry-operator-registry-operator.v0.1.0;
registry-operator package uniqueness permits at most 1 of registry-operator-catalog-registry-operator-registry-operator.v0.2.0,
registry-operator-catalog-registry-operator-registry-operator.v0.1.0; required
package registry-operator is mandatory; required package registry-operator requires
at least one of registry-operator-catalog-registry-operator-registry-operator.v0.2.0'
observedGeneration: 2
reason: ResolutionFailed
status: "False"
type: Resolved
- lastTransitionTime: "2023-10-24T13:15:10Z"
message: installation has not been attempted as resolution is unsatisfiable
observedGeneration: 2
reason: InstallationStatusUnknown
status: Unknown
type: Installed |
I created #485 for false negatives. Will submit the PR which updates test data shortly. |
#488 should address this issue |
As of a00a93f I see an uptick in
operator-developer-e2e
job flakes which look like this:Example:
The text was updated successfully, but these errors were encountered: