A fresh install of runtime almost always involves a restart of the controller

[thedadams]

1. Install runtime on a fresh cluster
2. Watch the logs of the installed acorn-controller
3. Nearly every time, a log like level=fatal msg="leader callback error: no matches for kind \"EventInstance\" in version \"internal.acorn.io/v1\"" (not always the EventInstance) will appear and the controller will restart.

The controller shouldn't restart on a fresh install.

[sangee2004]

Tested with acorn version - v0.8.0-alpha7-98-gbb130866+bb130866

Fresh install of runtime does not result in restart of controller. No error messages relating to level=fatal msg="leader callback error: no matches for kind \"EventInstance\" in version \"internal.acorn.io/v1\ is seen in controller logs.

kubectl logs acorn-controller-85b55ffd6-zvzt7  -n acorn-system
time="2023-07-17T20:23:18Z" level=info msg="Applying CRD serviceinstances.internal.acorn.io"
time="2023-07-17T20:23:19Z" level=info msg="Applying CRD builderinstances.internal.acorn.io"
time="2023-07-17T20:23:19Z" level=info msg="Applying CRD devsessioninstances.internal.acorn.io"
time="2023-07-17T20:23:19Z" level=info msg="Applying CRD projectinstances.internal.acorn.io"
time="2023-07-17T20:23:19Z" level=info msg="Applying CRD imageinstances.internal.acorn.io"
time="2023-07-17T20:23:19Z" level=info msg="Applying CRD appinstances.internal.acorn.io"
time="2023-07-17T20:23:19Z" level=info msg="Applying CRD eventinstances.internal.acorn.io"
time="2023-07-17T20:23:19Z" level=info msg="Applying CRD acornimagebuildinstances.internal.acorn.io"
time="2023-07-17T20:23:19Z" level=info msg="Applying CRD imageallowruleinstances.internal.acorn.io"
time="2023-07-17T20:23:20Z" level=info msg="Waiting for CRD imageallowruleinstances.internal.acorn.io to become available"
time="2023-07-17T20:23:20Z" level=info msg="Done waiting for CRD imageallowruleinstances.internal.acorn.io to become available"
time="2023-07-17T20:23:20Z" level=info msg="Applying CRD projectcomputeclassinstances.internal.admin.acorn.io"
time="2023-07-17T20:23:20Z" level=info msg="Applying CRD quotarequestinstances.internal.admin.acorn.io"
time="2023-07-17T20:23:20Z" level=info msg="Applying CRD projectvolumeclassinstances.internal.admin.acorn.io"
time="2023-07-17T20:23:20Z" level=info msg="Applying CRD clustercomputeclassinstances.internal.admin.acorn.io"
time="2023-07-17T20:23:21Z" level=info msg="Applying CRD clustervolumeclassinstances.internal.admin.acorn.io"
time="2023-07-17T20:23:21Z" level=info msg="Waiting for CRD clustervolumeclassinstances.internal.admin.acorn.io to become available"
time="2023-07-17T20:23:21Z" level=info msg="Done waiting for CRD clustervolumeclassinstances.internal.admin.acorn.io to become available"
I0717 20:23:21.840246       1 leaderelection.go:245] attempting to acquire leader lease kube-system/acorn-controller...
I0717 20:23:21.843585       1 leaderelection.go:255] successfully acquired lease kube-system/acorn-controller
time="2023-07-17T20:23:22Z" level=info msg="Renewing and syncing AcornDNS..."
time="2023-07-17T20:23:22Z" level=info msg="Starting internal.acorn.io/v1, Kind=ServiceInstance controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting internal.acorn.io/v1, Kind=AppInstance controller"
time="2023-07-17T20:23:22Z" level=error msg="Failed to get DNS secret: DNS secret acorn-system/acorn-dns not found, not proceeding with DNS renewal"
time="2023-07-17T20:23:22Z" level=info msg="Listening on \x00logserver"
time="2023-07-17T20:23:22Z" level=info msg="Starting apps/v1, Kind=Deployment controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting internal.acorn.io/v1, Kind=DevSessionInstance controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting /v1, Kind=Namespace controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting storage.k8s.io/v1, Kind=StorageClass controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting /v1, Kind=PersistentVolume controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting /v1, Kind=ConfigMap controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting internal.acorn.io/v1, Kind=ProjectInstance controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting internal.acorn.io/v1, Kind=BuilderInstance controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting /v1, Kind=Service controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting networking.k8s.io/v1, Kind=NetworkPolicy controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting batch/v1, Kind=Job controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting internal.acorn.io/v1, Kind=AcornImageBuildInstance controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting networking.k8s.io/v1, Kind=Ingress controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting policy/v1, Kind=PodDisruptionBudget controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRole controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting /v1, Kind=PersistentVolumeClaim controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting /v1, Kind=Secret controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting internal.acorn.io/v1, Kind=EventInstance controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting /v1, Kind=Pod controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting /v1, Kind=Node controller"
time="2023-07-17T20:23:22Z" level=info msg="Starting internal.admin.acorn.io/v1, Kind=ClusterVolumeClassInstance controller"
time="2023-07-17T20:23:23Z" level=info msg="Renewing and syncing AcornDNS..."
time="2023-07-17T20:23:23Z" level=error msg="Failed to get DNS secret: DNS secret acorn-system/acorn-dns not found, not proceeding with DNS renewal"
time="2023-07-17T20:23:23Z" level=info msg="Obtained AcornDNS domain: .lrylr2.oss-acorn.io"
time="2023-07-17T20:23:25Z" level=info msg="Renewing and syncing AcornDNS..."
time="2023-07-17T20:23:25Z" level=info msg="Renewed and synced AcornDNS!"