* * ==> Audit <== * |---------|------------------------------------------------------------------------|----------|----------|---------|---------------------|----------| | Command | Args | Profile | User | Version | Start Time | End Time | |---------|------------------------------------------------------------------------|----------|----------|---------|---------------------|----------| | start | --image-repository=registry.cn-hangzhou.aliyuncs.com/google_containers | minikube | chensq20 | v1.26.1 | 18 Aug 22 21:32 CST | | |---------|------------------------------------------------------------------------|----------|----------|---------|---------------------|----------| * * ==> Last Start <== * Log file created at: 2022/08/18 21:32:13 Running on machine: dev-nmg-huhehaote4-devtest-214 Binary: Built with gc go1.18.3 for linux/amd64 Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg I0818 21:32:13.040244 313848 out.go:296] Setting OutFile to fd 1 ... I0818 21:32:13.040427 313848 out.go:343] TERM=xterm,COLORTERM=, which probably does not support color I0818 21:32:13.040431 313848 out.go:309] Setting ErrFile to fd 2... I0818 21:32:13.040435 313848 out.go:343] TERM=xterm,COLORTERM=, which probably does not support color I0818 21:32:13.040535 313848 root.go:333] Updating PATH: /home/chensq20/.minikube/bin W0818 21:32:13.040712 313848 root.go:310] Error reading config file at /home/chensq20/.minikube/config/config.json: open /home/chensq20/.minikube/config/config.json: no such file or directory I0818 21:32:13.041088 313848 out.go:303] Setting JSON to false I0818 21:32:13.056889 313848 start.go:115] hostinfo: {"hostname":"dev-nmg-huhehaote4-devtest-214.in.ctcdn.cn","uptime":99982,"bootTime":1660729551,"procs":164,"os":"linux","platform":"centos","platformFamily":"rhel","platformVersion":"7.9.2009","kernelVersion":"3.10.0-1160.36.2.el7.x86_64","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"guest","hostId":"bc597ffd-b7bf-43f3-9f77-770cfac5796d"} I0818 21:32:13.056941 313848 start.go:125] virtualization: guest I0818 21:32:13.062342 313848 out.go:177] * minikube v1.26.1 on Centos 7.9.2009 (amd64) I0818 21:32:13.067539 313848 driver.go:365] Setting default libvirt URI to qemu:///system I0818 21:32:13.067550 313848 notify.go:193] Checking for updates... I0818 21:32:13.067577 313848 global.go:111] Querying for installed drivers using PATH=/home/chensq20/.minikube/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/home/chensq20/.local/bin:/home/chensq20/bin I0818 21:32:13.123390 313848 docker.go:137] docker version: linux-20.10.17 I0818 21:32:13.123490 313848 cli_runner.go:164] Run: docker system info --format "{{json .}}" I0818 21:32:13.254161 313848 info.go:265] docker info: {ID:J7Z2:QDBY:YSKA:X6SG:7ADO:MJUU:RH2T:M2W4:EX2K:BHVL:5F2V:SSRP Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem xfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:27 OomKillDisable:true NGoroutines:37 SystemTime:2022-08-18 21:32:13.158596828 +0800 CST LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:3.10.0-1160.36.2.el7.x86_64 OperatingSystem:CentOS Linux 7 (Core) OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:4 MemTotal:8198963200 GenericResources: DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:dev-nmg-huhehaote4-devtest-214.in.ctcdn.cn Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:0197261a30bf81f1ee8e6a4dd2dea0ef95d67ccb Expected:0197261a30bf81f1ee8e6a4dd2dea0ef95d67ccb} RuncCommit:{ID:v1.1.3-0-g6724737 Expected:v1.1.3-0-g6724737} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings: ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:}} I0818 21:32:13.254258 313848 docker.go:254] overlay module found I0818 21:32:13.254274 313848 global.go:119] docker default: true priority: 9, state: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc: Version:} I0818 21:32:13.254315 313848 global.go:119] kvm2 default: true priority: 8, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "virsh": executable file not found in $PATH Reason: Fix:Install libvirt Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/kvm2/ Version:} I0818 21:32:14.088068 313848 global.go:119] none default: false priority: 4, state: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc: Version:} I0818 21:32:14.088201 313848 global.go:119] podman default: true priority: 7, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "podman": executable file not found in $PATH Reason: Fix:Install Podman Doc:https://minikube.sigs.k8s.io/docs/drivers/podman/ Version:} I0818 21:32:14.088238 313848 global.go:119] qemu2 default: true priority: 3, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "qemu-system-x86_64": executable file not found in $PATH Reason: Fix:Install qemu-system Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/qemu2/ Version:} I0818 21:32:14.088248 313848 global.go:119] ssh default: false priority: 4, state: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc: Version:} I0818 21:32:14.088286 313848 global.go:119] virtualbox default: true priority: 6, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:unable to find VBoxManage in $PATH Reason: Fix:Install VirtualBox Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/virtualbox/ Version:} I0818 21:32:14.088311 313848 global.go:119] vmware default: true priority: 7, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "docker-machine-driver-vmware": executable file not found in $PATH Reason: Fix:Install docker-machine-driver-vmware Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/vmware/ Version:} I0818 21:32:14.088375 313848 driver.go:300] not recommending "none" due to default: false I0818 21:32:14.088384 313848 driver.go:300] not recommending "ssh" due to default: false I0818 21:32:14.088397 313848 driver.go:335] Picked: docker I0818 21:32:14.088406 313848 driver.go:336] Alternatives: [none ssh] I0818 21:32:14.088410 313848 driver.go:337] Rejects: [kvm2 podman qemu2 virtualbox vmware] I0818 21:32:14.094926 313848 out.go:177] * Automatically selected the docker driver. Other choices: none, ssh I0818 21:32:14.098412 313848 start.go:284] selected driver: docker I0818 21:32:14.098436 313848 start.go:808] validating driver "docker" against I0818 21:32:14.098470 313848 start.go:819] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc: Version:} I0818 21:32:14.098691 313848 cli_runner.go:164] Run: docker system info --format "{{json .}}" I0818 21:32:14.214695 313848 info.go:265] docker info: {ID:J7Z2:QDBY:YSKA:X6SG:7ADO:MJUU:RH2T:M2W4:EX2K:BHVL:5F2V:SSRP Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem xfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:27 OomKillDisable:true NGoroutines:37 SystemTime:2022-08-18 21:32:14.132266545 +0800 CST LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:3.10.0-1160.36.2.el7.x86_64 OperatingSystem:CentOS Linux 7 (Core) OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:4 MemTotal:8198963200 GenericResources: DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:dev-nmg-huhehaote4-devtest-214.in.ctcdn.cn Labels:[] ExperimentalBuild:false ServerVersion:20.10.17 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:0197261a30bf81f1ee8e6a4dd2dea0ef95d67ccb Expected:0197261a30bf81f1ee8e6a4dd2dea0ef95d67ccb} RuncCommit:{ID:v1.1.3-0-g6724737 Expected:v1.1.3-0-g6724737} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings: ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.6.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:}} I0818 21:32:14.214842 313848 start_flags.go:296] no existing cluster config was found, will generate one from the flags I0818 21:32:14.215393 313848 start_flags.go:377] Using suggested 2200MB memory alloc based on sys=7819MB, container=7819MB I0818 21:32:14.219496 313848 out.go:177] * Using image repository registry.cn-hangzhou.aliyuncs.com/google_containers I0818 21:32:14.222827 313848 start_flags.go:835] Wait components to verify : map[apiserver:true system_pods:true] I0818 21:32:14.226206 313848 out.go:177] * Using Docker driver with root privileges I0818 21:32:14.229409 313848 cni.go:95] Creating CNI manager for "" I0818 21:32:14.229426 313848 cni.go:169] CNI unnecessary in this configuration, recommending no CNI I0818 21:32:14.229440 313848 start_flags.go:310] config: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.33@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository:registry.cn-hangzhou.aliyuncs.com/google_containers LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/chensq20:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} I0818 21:32:14.235618 313848 out.go:177] * Starting control plane node minikube in cluster minikube I0818 21:32:14.238713 313848 cache.go:120] Beginning downloading kic base image for docker with docker I0818 21:32:14.242605 313848 out.go:177] * Pulling base image ... I0818 21:32:14.247382 313848 image.go:75] Checking for registry.cn-hangzhou.aliyuncs.com/google_containers/kicbase:v0.0.33@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 in local docker daemon I0818 21:32:14.247571 313848 profile.go:148] Saving config to /home/chensq20/.minikube/profiles/minikube/config.json ... I0818 21:32:14.247606 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/profiles/minikube/config.json: {Name:mk7643af0d127500bbc2285227fca1d927c0e1a0 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:14.247702 313848 cache.go:107] acquiring lock: {Name:mk9da282856eb51ce1db8460689b09e94651b97d Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0818 21:32:14.247713 313848 cache.go:107] acquiring lock: {Name:mke9fa46cca8520841517234021b829092a0f25d Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0818 21:32:14.247800 313848 cache.go:107] acquiring lock: {Name:mk433c6341ecdbb72876e879a963f40a4e0a7ad7 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0818 21:32:14.247863 313848 cache.go:107] acquiring lock: {Name:mk8c7820eab66f74f4ff45a5fcdb290183b2580a Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0818 21:32:14.247996 313848 image.go:134] retrieving image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager:v1.24.3 I0818 21:32:14.247998 313848 image.go:134] retrieving image: registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner:v5 I0818 21:32:14.247997 313848 image.go:134] retrieving image: registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.7 I0818 21:32:14.248195 313848 cache.go:107] acquiring lock: {Name:mk247c6a86f0005a348a006a81470bdc25133a39 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0818 21:32:14.248197 313848 cache.go:107] acquiring lock: {Name:mk7cb2877168912526948e04728d895259babfce Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0818 21:32:14.248198 313848 cache.go:107] acquiring lock: {Name:mkb1764305b64023f137f9bef1dbbc9735d695ff Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0818 21:32:14.248217 313848 cache.go:107] acquiring lock: {Name:mk7155cf5e357e1e377a24bc7d602f80f28a378e Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0818 21:32:14.248252 313848 image.go:134] retrieving image: registry.cn-hangzhou.aliyuncs.com/google_containers/etcd:3.5.3-0 I0818 21:32:14.248263 313848 image.go:134] retrieving image: registry.cn-hangzhou.aliyuncs.com/google_containers/coredns:v1.8.6 I0818 21:32:14.248323 313848 image.go:134] retrieving image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy:v1.24.3 I0818 21:32:14.248360 313848 image.go:134] retrieving image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.24.3 I0818 21:32:14.248404 313848 image.go:134] retrieving image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler:v1.24.3 I0818 21:32:14.249752 313848 image.go:177] daemon lookup for registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.7: Error: No such image: registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.7 I0818 21:32:14.249752 313848 image.go:177] daemon lookup for registry.cn-hangzhou.aliyuncs.com/google_containers/coredns:v1.8.6: Error: No such image: registry.cn-hangzhou.aliyuncs.com/google_containers/coredns:v1.8.6 I0818 21:32:14.249787 313848 image.go:177] daemon lookup for registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy:v1.24.3: Error: No such image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy:v1.24.3 I0818 21:32:14.249806 313848 image.go:177] daemon lookup for registry.cn-hangzhou.aliyuncs.com/google_containers/etcd:3.5.3-0: Error: No such image: registry.cn-hangzhou.aliyuncs.com/google_containers/etcd:3.5.3-0 I0818 21:32:14.249832 313848 image.go:177] daemon lookup for registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler:v1.24.3: Error: No such image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler:v1.24.3 I0818 21:32:14.249861 313848 image.go:177] daemon lookup for registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager:v1.24.3: Error: No such image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager:v1.24.3 I0818 21:32:14.249752 313848 image.go:177] daemon lookup for registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner:v5: Error: No such image: registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner:v5 I0818 21:32:14.250427 313848 image.go:177] daemon lookup for registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.24.3: Error: No such image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.24.3 I0818 21:32:14.283641 313848 image.go:79] Found registry.cn-hangzhou.aliyuncs.com/google_containers/kicbase:v0.0.33@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 in local docker daemon, skipping pull I0818 21:32:14.283660 313848 cache.go:142] registry.cn-hangzhou.aliyuncs.com/google_containers/kicbase:v0.0.33@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 exists in daemon, skipping load I0818 21:32:14.283676 313848 cache.go:208] Successfully downloaded all kic artifacts I0818 21:32:14.283754 313848 start.go:371] acquiring machines lock for minikube: {Name:mk26ffff313a14ba6e10a27fa3a7b038389a9f36 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0818 21:32:14.283838 313848 start.go:375] acquired machines lock for "minikube" in 63.124µs I0818 21:32:14.283858 313848 start.go:92] Provisioning new machine with config: &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:registry.cn-hangzhou.aliyuncs.com/google_containers/kicbase:v0.0.33@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository:registry.cn-hangzhou.aliyuncs.com/google_containers LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/chensq20:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.24.3 ContainerRuntime:docker ControlPlane:true Worker:true} I0818 21:32:14.283929 313848 start.go:132] createHost starting for "" (driver="docker") I0818 21:32:14.290528 313848 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ... I0818 21:32:14.290831 313848 start.go:166] libmachine.API.Create for "minikube" (driver="docker") I0818 21:32:14.290864 313848 client.go:168] LocalClient.Create starting I0818 21:32:14.290961 313848 main.go:134] libmachine: Creating CA: /home/chensq20/.minikube/certs/ca.pem I0818 21:32:14.456055 313848 main.go:134] libmachine: Creating client certificate: /home/chensq20/.minikube/certs/cert.pem I0818 21:32:14.562775 313848 cli_runner.go:164] Run: docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" W0818 21:32:14.600815 313848 cli_runner.go:211] docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1 I0818 21:32:14.600891 313848 network_create.go:272] running [docker network inspect minikube] to gather additional debugging logs... I0818 21:32:14.600905 313848 cli_runner.go:164] Run: docker network inspect minikube W0818 21:32:14.636589 313848 cli_runner.go:211] docker network inspect minikube returned with exit code 1 I0818 21:32:14.636611 313848 network_create.go:275] error running [docker network inspect minikube]: docker network inspect minikube: exit status 1 stdout: [] stderr: Error: No such network: minikube I0818 21:32:14.636621 313848 network_create.go:277] output of [docker network inspect minikube]: -- stdout -- [] -- /stdout -- ** stderr ** Error: No such network: minikube ** /stderr ** I0818 21:32:14.636655 313848 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" I0818 21:32:14.674483 313848 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc000529800] misses:0} I0818 21:32:14.674528 313848 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}} I0818 21:32:14.674544 313848 network_create.go:115] attempt to create docker network minikube 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ... I0818 21:32:14.674583 313848 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=minikube minikube I0818 21:32:14.928550 313848 network_create.go:99] docker network minikube 192.168.49.0/24 created I0818 21:32:14.928581 313848 kic.go:106] calculated static IP "192.168.49.2" for the "minikube" container I0818 21:32:14.928636 313848 cli_runner.go:164] Run: docker ps -a --format {{.Names}} I0818 21:32:14.969537 313848 cli_runner.go:164] Run: docker volume create minikube --label name.minikube.sigs.k8s.io=minikube --label created_by.minikube.sigs.k8s.io=true I0818 21:32:15.012714 313848 oci.go:103] Successfully created a docker volume minikube I0818 21:32:15.012770 313848 cli_runner.go:164] Run: docker run --rm --name minikube-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=minikube --entrypoint /usr/bin/test -v minikube:/var registry.cn-hangzhou.aliyuncs.com/google_containers/kicbase:v0.0.33@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 -d /var/lib I0818 21:32:15.209596 313848 cache.go:161] opening: /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy_v1.24.3 I0818 21:32:15.214741 313848 cache.go:161] opening: /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/pause_3.7 I0818 21:32:15.219524 313848 cache.go:161] opening: /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver_v1.24.3 I0818 21:32:15.220350 313848 cache.go:161] opening: /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler_v1.24.3 I0818 21:32:15.223621 313848 cache.go:161] opening: /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/etcd_3.5.3-0 I0818 21:32:15.231033 313848 cache.go:161] opening: /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager_v1.24.3 I0818 21:32:15.248889 313848 cache.go:161] opening: /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner_v5 I0818 21:32:15.283483 313848 cache.go:161] opening: /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/coredns_v1.8.6 I0818 21:32:15.516483 313848 cache.go:156] /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/pause_3.7 exists I0818 21:32:15.516523 313848 cache.go:96] cache image "registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.7" -> "/home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/pause_3.7" took 1.268713594s I0818 21:32:15.516534 313848 cache.go:80] save to tar file registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.7 -> /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/pause_3.7 succeeded I0818 21:32:15.866143 313848 oci.go:107] Successfully prepared a docker volume minikube I0818 21:32:15.866193 313848 preload.go:132] Checking if preload exists for k8s version v1.24.3 and runtime docker I0818 21:32:15.866227 313848 preload.go:148] Found local preload: /home/chensq20/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.3-docker-overlay2-amd64.tar.lz4 I0818 21:32:15.866237 313848 kic.go:179] Starting extracting preloaded images to volume ... I0818 21:32:15.866306 313848 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/chensq20/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.3-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v minikube:/extractDir registry.cn-hangzhou.aliyuncs.com/google_containers/kicbase:v0.0.33@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 -I lz4 -xf /preloaded.tar -C /extractDir I0818 21:32:16.252910 313848 cache.go:156] /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner_v5 exists I0818 21:32:16.252939 313848 cache.go:96] cache image "registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner:v5" -> "/home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner_v5" took 2.005253198s I0818 21:32:16.252952 313848 cache.go:80] save to tar file registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner:v5 -> /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner_v5 succeeded W0818 21:32:16.547197 313848 cli_runner.go:211] docker run --rm --entrypoint /usr/bin/tar -v /home/chensq20/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.3-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v minikube:/extractDir registry.cn-hangzhou.aliyuncs.com/google_containers/kicbase:v0.0.33@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 -I lz4 -xf /preloaded.tar -C /extractDir returned with exit code 2 I0818 21:32:16.547225 313848 kic.go:186] Unable to extract preloaded tarball to volume: docker run --rm --entrypoint /usr/bin/tar -v /home/chensq20/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.3-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v minikube:/extractDir registry.cn-hangzhou.aliyuncs.com/google_containers/kicbase:v0.0.33@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 -I lz4 -xf /preloaded.tar -C /extractDir: exit status 2 stdout: stderr: tar (child): /preloaded.tar: Cannot read: Is a directory tar (child): At beginning of tape, quitting now tar (child): Error is not recoverable: exiting now /usr/bin/tar: Child returned status 2 /usr/bin/tar: Error is not recoverable: exiting now W0818 21:32:16.547499 313848 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted. I0818 21:32:16.547580 313848 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'" I0818 21:32:16.695841 313848 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname minikube --name minikube --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=minikube --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=minikube --network minikube --ip 192.168.49.2 --volume minikube:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 registry.cn-hangzhou.aliyuncs.com/google_containers/kicbase:v0.0.33@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 I0818 21:32:16.807124 313848 cache.go:156] /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/coredns_v1.8.6 exists I0818 21:32:16.807156 313848 cache.go:96] cache image "registry.cn-hangzhou.aliyuncs.com/google_containers/coredns:v1.8.6" -> "/home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/coredns_v1.8.6" took 2.558937561s I0818 21:32:16.807168 313848 cache.go:80] save to tar file registry.cn-hangzhou.aliyuncs.com/google_containers/coredns:v1.8.6 -> /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/coredns_v1.8.6 succeeded I0818 21:32:17.408309 313848 cache.go:156] /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler_v1.24.3 exists I0818 21:32:17.408347 313848 cache.go:96] cache image "registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler:v1.24.3" -> "/home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler_v1.24.3" took 3.160152097s I0818 21:32:17.408360 313848 cache.go:80] save to tar file registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler:v1.24.3 -> /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler_v1.24.3 succeeded I0818 21:32:17.513230 313848 cli_runner.go:164] Run: docker container inspect minikube --format={{.State.Running}} I0818 21:32:17.559246 313848 cli_runner.go:164] Run: docker container inspect minikube --format={{.State.Status}} I0818 21:32:17.602665 313848 cli_runner.go:164] Run: docker exec minikube stat /var/lib/dpkg/alternatives/iptables I0818 21:32:17.684363 313848 oci.go:144] the created container "minikube" has a running status. I0818 21:32:17.684387 313848 kic.go:210] Creating ssh key for kic: /home/chensq20/.minikube/machines/minikube/id_rsa... I0818 21:32:17.807845 313848 kic_runner.go:191] docker (temp): /home/chensq20/.minikube/machines/minikube/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes) I0818 21:32:17.973481 313848 cli_runner.go:164] Run: docker container inspect minikube --format={{.State.Status}} I0818 21:32:18.010355 313848 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys I0818 21:32:18.010372 313848 kic_runner.go:114] Args: [docker exec --privileged minikube chown docker:docker /home/docker/.ssh/authorized_keys] I0818 21:32:18.060273 313848 cache.go:156] /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager_v1.24.3 exists I0818 21:32:18.060301 313848 cache.go:96] cache image "registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager:v1.24.3" -> "/home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager_v1.24.3" took 3.812441545s I0818 21:32:18.060316 313848 cache.go:80] save to tar file registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager:v1.24.3 -> /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager_v1.24.3 succeeded I0818 21:32:18.066374 313848 cache.go:156] /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy_v1.24.3 exists I0818 21:32:18.066400 313848 cache.go:96] cache image "registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy:v1.24.3" -> "/home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy_v1.24.3" took 3.818719022s I0818 21:32:18.066412 313848 cache.go:80] save to tar file registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy:v1.24.3 -> /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy_v1.24.3 succeeded I0818 21:32:18.087795 313848 cli_runner.go:164] Run: docker container inspect minikube --format={{.State.Status}} I0818 21:32:18.123244 313848 machine.go:88] provisioning docker machine ... I0818 21:32:18.123292 313848 ubuntu.go:169] provisioning hostname "minikube" I0818 21:32:18.123345 313848 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0818 21:32:18.161782 313848 main.go:134] libmachine: Using SSH client type: native I0818 21:32:18.162022 313848 main.go:134] libmachine: &{{{ 0 [] [] []} docker [0x7daec0] 0x7ddf20 [] 0s} 127.0.0.1 49182 } I0818 21:32:18.162032 313848 main.go:134] libmachine: About to run SSH command: sudo hostname minikube && echo "minikube" | sudo tee /etc/hostname I0818 21:32:18.162627 313848 main.go:134] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50586->127.0.0.1:49182: read: connection reset by peer I0818 21:32:18.532045 313848 cache.go:156] /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver_v1.24.3 exists I0818 21:32:18.532072 313848 cache.go:96] cache image "registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.24.3" -> "/home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver_v1.24.3" took 4.283877587s I0818 21:32:18.532088 313848 cache.go:80] save to tar file registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.24.3 -> /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver_v1.24.3 succeeded I0818 21:32:21.287616 313848 main.go:134] libmachine: SSH cmd err, output: : minikube I0818 21:32:21.287716 313848 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0818 21:32:21.325892 313848 main.go:134] libmachine: Using SSH client type: native I0818 21:32:21.326117 313848 main.go:134] libmachine: &{{{ 0 [] [] []} docker [0x7daec0] 0x7ddf20 [] 0s} 127.0.0.1 49182 } I0818 21:32:21.326130 313848 main.go:134] libmachine: About to run SSH command: if ! grep -xq '.*\sminikube' /etc/hosts; then if grep -xq '127.0.1.1\s.*' /etc/hosts; then sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 minikube/g' /etc/hosts; else echo '127.0.1.1 minikube' | sudo tee -a /etc/hosts; fi fi I0818 21:32:21.438296 313848 main.go:134] libmachine: SSH cmd err, output: : I0818 21:32:21.438351 313848 ubuntu.go:175] set auth options {CertDir:/home/chensq20/.minikube CaCertPath:/home/chensq20/.minikube/certs/ca.pem CaPrivateKeyPath:/home/chensq20/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/chensq20/.minikube/machines/server.pem ServerKeyPath:/home/chensq20/.minikube/machines/server-key.pem ClientKeyPath:/home/chensq20/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/chensq20/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/chensq20/.minikube} I0818 21:32:21.438378 313848 ubuntu.go:177] setting up certificates I0818 21:32:21.438404 313848 provision.go:83] configureAuth start I0818 21:32:21.438449 313848 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" minikube I0818 21:32:21.474668 313848 provision.go:138] copyHostCerts I0818 21:32:21.474733 313848 exec_runner.go:151] cp: /home/chensq20/.minikube/certs/key.pem --> /home/chensq20/.minikube/key.pem (1679 bytes) I0818 21:32:21.474861 313848 exec_runner.go:151] cp: /home/chensq20/.minikube/certs/ca.pem --> /home/chensq20/.minikube/ca.pem (1082 bytes) I0818 21:32:21.474932 313848 exec_runner.go:151] cp: /home/chensq20/.minikube/certs/cert.pem --> /home/chensq20/.minikube/cert.pem (1127 bytes) I0818 21:32:21.474999 313848 provision.go:112] generating server cert: /home/chensq20/.minikube/machines/server.pem ca-key=/home/chensq20/.minikube/certs/ca.pem private-key=/home/chensq20/.minikube/certs/ca-key.pem org=chensq20.minikube san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube minikube] I0818 21:32:21.605821 313848 provision.go:172] copyRemoteCerts I0818 21:32:21.605906 313848 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker I0818 21:32:21.605949 313848 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0818 21:32:21.642049 313848 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49182 SSHKeyPath:/home/chensq20/.minikube/machines/minikube/id_rsa Username:docker} I0818 21:32:21.725741 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes) I0818 21:32:21.747316 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/machines/server.pem --> /etc/docker/server.pem (1204 bytes) I0818 21:32:21.768213 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes) I0818 21:32:21.788616 313848 provision.go:86] duration metric: configureAuth took 350.188858ms I0818 21:32:21.788632 313848 ubuntu.go:193] setting minikube options for container-runtime I0818 21:32:21.788843 313848 config.go:180] Loaded profile config "minikube": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.3 I0818 21:32:21.788883 313848 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0818 21:32:21.828054 313848 main.go:134] libmachine: Using SSH client type: native I0818 21:32:21.828186 313848 main.go:134] libmachine: &{{{ 0 [] [] []} docker [0x7daec0] 0x7ddf20 [] 0s} 127.0.0.1 49182 } I0818 21:32:21.828194 313848 main.go:134] libmachine: About to run SSH command: df --output=fstype / | tail -n 1 I0818 21:32:21.940601 313848 main.go:134] libmachine: SSH cmd err, output: : overlay I0818 21:32:21.940622 313848 ubuntu.go:71] root file system type: overlay I0818 21:32:21.940844 313848 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ... I0818 21:32:21.940895 313848 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0818 21:32:21.977531 313848 main.go:134] libmachine: Using SSH client type: native I0818 21:32:21.977681 313848 main.go:134] libmachine: &{{{ 0 [] [] []} docker [0x7daec0] 0x7ddf20 [] 0s} 127.0.0.1 49182 } I0818 21:32:21.977743 313848 main.go:134] libmachine: About to run SSH command: sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com BindsTo=containerd.service After=network-online.target firewalld.service containerd.service Wants=network-online.target Requires=docker.socket StartLimitBurst=3 StartLimitIntervalSec=60 [Service] Type=notify Restart=on-failure # This file is a systemd drop-in unit that inherits from the base dockerd configuration. # The base configuration already specifies an 'ExecStart=...' command. The first directive # here is to clear out that command inherited from the base configuration. Without this, # the command from the base configuration and the command specified here are treated as # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd # will catch this invalid input and refuse to start the service with an error like: # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other # container runtimes. If left unlimited, it may result in OOM issues with MySQL. ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP \$MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity # Uncomment TasksMax if your systemd version supports it. # Only systemd 226 and above support this version. TasksMax=infinity TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process [Install] WantedBy=multi-user.target " | sudo tee /lib/systemd/system/docker.service.new I0818 21:32:22.099682 313848 main.go:134] libmachine: SSH cmd err, output: : [Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com BindsTo=containerd.service After=network-online.target firewalld.service containerd.service Wants=network-online.target Requires=docker.socket StartLimitBurst=3 StartLimitIntervalSec=60 [Service] Type=notify Restart=on-failure # This file is a systemd drop-in unit that inherits from the base dockerd configuration. # The base configuration already specifies an 'ExecStart=...' command. The first directive # here is to clear out that command inherited from the base configuration. Without this, # the command from the base configuration and the command specified here are treated as # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd # will catch this invalid input and refuse to start the service with an error like: # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other # container runtimes. If left unlimited, it may result in OOM issues with MySQL. ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP $MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity # Uncomment TasksMax if your systemd version supports it. # Only systemd 226 and above support this version. TasksMax=infinity TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process [Install] WantedBy=multi-user.target I0818 21:32:22.099743 313848 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0818 21:32:22.136573 313848 main.go:134] libmachine: Using SSH client type: native I0818 21:32:22.136711 313848 main.go:134] libmachine: &{{{ 0 [] [] []} docker [0x7daec0] 0x7ddf20 [] 0s} 127.0.0.1 49182 } I0818 21:32:22.136727 313848 main.go:134] libmachine: About to run SSH command: sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; } I0818 21:32:22.998776 313848 cache.go:156] /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/etcd_3.5.3-0 exists I0818 21:32:22.998829 313848 cache.go:96] cache image "registry.cn-hangzhou.aliyuncs.com/google_containers/etcd:3.5.3-0" -> "/home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/etcd_3.5.3-0" took 8.750629387s I0818 21:32:22.998844 313848 cache.go:80] save to tar file registry.cn-hangzhou.aliyuncs.com/google_containers/etcd:3.5.3-0 -> /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/etcd_3.5.3-0 succeeded I0818 21:32:22.998851 313848 cache.go:87] Successfully saved all images to host disk. I0818 21:32:23.159447 313848 main.go:134] libmachine: SSH cmd err, output: : --- /lib/systemd/system/docker.service 2022-06-06 23:01:03.000000000 +0000 +++ /lib/systemd/system/docker.service.new 2022-08-18 13:32:22.097806301 +0000 @@ -1,30 +1,32 @@ [Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com -After=network-online.target docker.socket firewalld.service containerd.service +BindsTo=containerd.service +After=network-online.target firewalld.service containerd.service Wants=network-online.target -Requires=docker.socket containerd.service +Requires=docker.socket +StartLimitBurst=3 +StartLimitIntervalSec=60 [Service] Type=notify -# the default is not to use systemd for cgroups because the delegate issues still -# exists and systemd currently does not support the cgroup feature set required -# for containers run by docker -ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock -ExecReload=/bin/kill -s HUP $MAINPID -TimeoutSec=0 -RestartSec=2 -Restart=always - -# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229. -# Both the old, and new location are accepted by systemd 229 and up, so using the old location -# to make them work for either version of systemd. -StartLimitBurst=3 +Restart=on-failure -# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230. -# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make -# this option work for either version of systemd. -StartLimitInterval=60s + + +# This file is a systemd drop-in unit that inherits from the base dockerd configuration. +# The base configuration already specifies an 'ExecStart=...' command. The first directive +# here is to clear out that command inherited from the base configuration. Without this, +# the command from the base configuration and the command specified here are treated as +# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd +# will catch this invalid input and refuse to start the service with an error like: +# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. + +# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other +# container runtimes. If left unlimited, it may result in OOM issues with MySQL. +ExecStart= +ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 +ExecReload=/bin/kill -s HUP $MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. @@ -32,16 +34,16 @@ LimitNPROC=infinity LimitCORE=infinity -# Comment TasksMax if your systemd version does not support it. -# Only systemd 226 and above support this option. +# Uncomment TasksMax if your systemd version supports it. +# Only systemd 226 and above support this version. TasksMax=infinity +TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process -OOMScoreAdjust=-500 [Install] WantedBy=multi-user.target Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install. Executing: /lib/systemd/systemd-sysv-install enable docker I0818 21:32:23.159463 313848 machine.go:91] provisioned docker machine in 5.036207505s I0818 21:32:23.159472 313848 client.go:171] LocalClient.Create took 8.868604414s I0818 21:32:23.159487 313848 start.go:174] duration metric: libmachine.API.Create for "minikube" took 8.868657029s I0818 21:32:23.159507 313848 start.go:307] post-start starting for "minikube" (driver="docker") I0818 21:32:23.159512 313848 start.go:335] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs] I0818 21:32:23.159555 313848 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs I0818 21:32:23.159593 313848 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0818 21:32:23.199051 313848 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49182 SSHKeyPath:/home/chensq20/.minikube/machines/minikube/id_rsa Username:docker} I0818 21:32:23.281790 313848 ssh_runner.go:195] Run: cat /etc/os-release I0818 21:32:23.284884 313848 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found I0818 21:32:23.284895 313848 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found I0818 21:32:23.284904 313848 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found I0818 21:32:23.284924 313848 info.go:137] Remote host: Ubuntu 20.04.4 LTS I0818 21:32:23.284938 313848 filesync.go:126] Scanning /home/chensq20/.minikube/addons for local assets ... I0818 21:32:23.284986 313848 filesync.go:126] Scanning /home/chensq20/.minikube/files for local assets ... I0818 21:32:23.285002 313848 start.go:310] post-start completed in 125.490539ms I0818 21:32:23.285286 313848 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" minikube I0818 21:32:23.321803 313848 profile.go:148] Saving config to /home/chensq20/.minikube/profiles/minikube/config.json ... I0818 21:32:23.321997 313848 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'" I0818 21:32:23.322029 313848 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0818 21:32:23.359022 313848 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49182 SSHKeyPath:/home/chensq20/.minikube/machines/minikube/id_rsa Username:docker} I0818 21:32:23.438392 313848 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'" I0818 21:32:23.442965 313848 start.go:135] duration metric: createHost completed in 9.159028482s I0818 21:32:23.442982 313848 start.go:82] releasing machines lock for "minikube", held for 9.159136828s I0818 21:32:23.443040 313848 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" minikube I0818 21:32:23.478012 313848 ssh_runner.go:195] Run: systemctl --version I0818 21:32:23.478048 313848 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0818 21:32:23.478083 313848 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.cn-hangzhou.aliyuncs.com/google_containers/ I0818 21:32:23.478165 313848 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0818 21:32:23.517811 313848 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49182 SSHKeyPath:/home/chensq20/.minikube/machines/minikube/id_rsa Username:docker} I0818 21:32:23.519964 313848 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49182 SSHKeyPath:/home/chensq20/.minikube/machines/minikube/id_rsa Username:docker} I0818 21:32:23.597016 313848 ssh_runner.go:195] Run: sudo systemctl cat docker.service I0818 21:32:23.815120 313848 cruntime.go:273] skipping containerd shutdown because we are bound to it I0818 21:32:23.815216 313848 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio I0818 21:32:23.826488 313848 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock image-endpoint: unix:///var/run/cri-dockerd.sock " | sudo tee /etc/crictl.yaml" I0818 21:32:23.842020 313848 ssh_runner.go:195] Run: sudo systemctl unmask docker.service I0818 21:32:23.918873 313848 ssh_runner.go:195] Run: sudo systemctl enable docker.socket I0818 21:32:23.995195 313848 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0818 21:32:24.071430 313848 ssh_runner.go:195] Run: sudo systemctl restart docker I0818 21:32:24.348482 313848 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket I0818 21:32:24.433101 313848 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0818 21:32:24.506103 313848 ssh_runner.go:195] Run: sudo systemctl start cri-docker.socket I0818 21:32:24.526255 313848 start.go:450] Will wait 60s for socket path /var/run/cri-dockerd.sock I0818 21:32:24.526296 313848 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock I0818 21:32:24.530295 313848 start.go:471] Will wait 60s for crictl version I0818 21:32:24.530321 313848 ssh_runner.go:195] Run: sudo crictl version I0818 21:32:24.665725 313848 start.go:480] Version: 0.1.0 RuntimeName: docker RuntimeVersion: 20.10.17 RuntimeApiVersion: 1.41.0 I0818 21:32:24.665769 313848 ssh_runner.go:195] Run: docker version --format {{.Server.Version}} I0818 21:32:24.726387 313848 ssh_runner.go:195] Run: docker version --format {{.Server.Version}} I0818 21:32:24.775212 313848 out.go:204] * Preparing Kubernetes v1.24.3 on Docker 20.10.17 ... I0818 21:32:24.775346 313848 cli_runner.go:164] Run: docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" I0818 21:32:24.810765 313848 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts I0818 21:32:24.814730 313848 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts"" I0818 21:32:24.826051 313848 preload.go:132] Checking if preload exists for k8s version v1.24.3 and runtime docker I0818 21:32:24.826101 313848 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}} I0818 21:32:24.862078 313848 docker.go:611] Got preloaded images: I0818 21:32:24.862089 313848 docker.go:617] registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.24.3 wasn't preloaded I0818 21:32:24.862125 313848 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json I0818 21:32:24.870424 313848 ssh_runner.go:195] Run: which lz4 I0818 21:32:24.873758 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.3-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (6 bytes) I0818 21:32:24.888840 313848 kubeadm.go:922] preload failed, will try to load cached images: copying file: sudo test -d / && sudo scp -t / && sudo touch -d "2022-08-18 21:01:13.375380212 +0800" /preloaded.tar.lz4: Process exited with status 1 output: scp: Broken pipe I0818 21:32:24.888896 313848 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}} I0818 21:32:24.924809 313848 docker.go:611] Got preloaded images: I0818 21:32:24.924822 313848 docker.go:617] registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.24.3 wasn't preloaded I0818 21:32:24.924837 313848 cache_images.go:88] LoadImages start: [registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.24.3 registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager:v1.24.3 registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler:v1.24.3 registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy:v1.24.3 registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.7 registry.cn-hangzhou.aliyuncs.com/google_containers/etcd:3.5.3-0 registry.cn-hangzhou.aliyuncs.com/google_containers/coredns:v1.8.6 registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner:v5] I0818 21:32:24.926463 313848 image.go:134] retrieving image: registry.cn-hangzhou.aliyuncs.com/google_containers/etcd:3.5.3-0 I0818 21:32:24.926511 313848 image.go:134] retrieving image: registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner:v5 I0818 21:32:24.926610 313848 image.go:134] retrieving image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.24.3 I0818 21:32:24.926661 313848 image.go:134] retrieving image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager:v1.24.3 I0818 21:32:24.926822 313848 image.go:134] retrieving image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler:v1.24.3 I0818 21:32:24.926886 313848 image.go:134] retrieving image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy:v1.24.3 I0818 21:32:24.926904 313848 image.go:177] daemon lookup for registry.cn-hangzhou.aliyuncs.com/google_containers/etcd:3.5.3-0: Error: No such image: registry.cn-hangzhou.aliyuncs.com/google_containers/etcd:3.5.3-0 I0818 21:32:24.926987 313848 image.go:177] daemon lookup for registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.24.3: Error: No such image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.24.3 I0818 21:32:24.927070 313848 image.go:177] daemon lookup for registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner:v5: Error: No such image: registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner:v5 I0818 21:32:24.927172 313848 image.go:177] daemon lookup for registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager:v1.24.3: Error: No such image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager:v1.24.3 I0818 21:32:24.927226 313848 image.go:134] retrieving image: registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.7 I0818 21:32:24.927356 313848 image.go:177] daemon lookup for registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler:v1.24.3: Error: No such image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler:v1.24.3 I0818 21:32:24.927512 313848 image.go:177] daemon lookup for registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy:v1.24.3: Error: No such image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy:v1.24.3 I0818 21:32:24.927601 313848 image.go:134] retrieving image: registry.cn-hangzhou.aliyuncs.com/google_containers/coredns:v1.8.6 I0818 21:32:24.927783 313848 image.go:177] daemon lookup for registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.7: Error: No such image: registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.7 I0818 21:32:24.928040 313848 image.go:177] daemon lookup for registry.cn-hangzhou.aliyuncs.com/google_containers/coredns:v1.8.6: Error: No such image: registry.cn-hangzhou.aliyuncs.com/google_containers/coredns:v1.8.6 I0818 21:32:25.304139 313848 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.cn-hangzhou.aliyuncs.com/google_containers/etcd:3.5.3-0 I0818 21:32:25.313920 313848 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy:v1.24.3 I0818 21:32:25.342123 313848 cache_images.go:116] "registry.cn-hangzhou.aliyuncs.com/google_containers/etcd:3.5.3-0" needs transfer: "registry.cn-hangzhou.aliyuncs.com/google_containers/etcd:3.5.3-0" does not exist at hash "aebe758cef4cd05b9f8cee39758227714d02f42ef3088023c1e3cd454f927a2b" in container runtime I0818 21:32:25.342188 313848 docker.go:292] Removing image: registry.cn-hangzhou.aliyuncs.com/google_containers/etcd:3.5.3-0 I0818 21:32:25.342218 313848 ssh_runner.go:195] Run: docker rmi registry.cn-hangzhou.aliyuncs.com/google_containers/etcd:3.5.3-0 I0818 21:32:25.350900 313848 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler:v1.24.3 I0818 21:32:25.358494 313848 cache_images.go:116] "registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy:v1.24.3" needs transfer: "registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy:v1.24.3" does not exist at hash "2ae1ba6417cbcd0b381139277508ddbebd0cf055344b710f7ea16e4da954a302" in container runtime I0818 21:32:25.358532 313848 docker.go:292] Removing image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy:v1.24.3 I0818 21:32:25.358562 313848 ssh_runner.go:195] Run: docker rmi registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy:v1.24.3 I0818 21:32:25.361273 313848 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager:v1.24.3 I0818 21:32:25.392251 313848 cache_images.go:286] Loading image from: /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/etcd_3.5.3-0 I0818 21:32:25.392315 313848 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.5.3-0 I0818 21:32:25.401941 313848 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.7 I0818 21:32:25.404097 313848 cache_images.go:286] Loading image from: /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy_v1.24.3 I0818 21:32:25.404151 313848 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.24.3 I0818 21:32:25.404191 313848 cache_images.go:116] "registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler:v1.24.3" needs transfer: "registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler:v1.24.3" does not exist at hash "3a5aa3a515f5d28b31ac5410cfaa56ddbbec1c4e88cbdf711db9de6bbf6b00b0" in container runtime I0818 21:32:25.404215 313848 docker.go:292] Removing image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler:v1.24.3 I0818 21:32:25.404230 313848 ssh_runner.go:195] Run: docker rmi registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler:v1.24.3 I0818 21:32:25.407059 313848 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner:v5 I0818 21:32:25.407535 313848 ssh_runner.go:352] existence check for /var/lib/minikube/images/etcd_3.5.3-0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.5.3-0: Process exited with status 1 stdout: stderr: stat: cannot stat '/var/lib/minikube/images/etcd_3.5.3-0': No such file or directory I0818 21:32:25.407550 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/etcd_3.5.3-0 --> /var/lib/minikube/images/etcd_3.5.3-0 (102146560 bytes) I0818 21:32:25.407562 313848 cache_images.go:116] "registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager:v1.24.3" needs transfer: "registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager:v1.24.3" does not exist at hash "586c112956dfc2de95aef392cbfcbfa2b579c332993079ed4d13108ff2409f2f" in container runtime I0818 21:32:25.407589 313848 docker.go:292] Removing image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager:v1.24.3 I0818 21:32:25.407610 313848 ssh_runner.go:195] Run: docker rmi registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager:v1.24.3 I0818 21:32:25.412564 313848 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.cn-hangzhou.aliyuncs.com/google_containers/coredns:v1.8.6 I0818 21:32:25.413645 313848 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.24.3 I0818 21:32:25.495297 313848 cache_images.go:116] "registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.7" needs transfer: "registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.7" does not exist at hash "221177c6082a88ea4f6240ab2450d540955ac6f4d5454f0e15751b653ebda165" in container runtime I0818 21:32:25.495338 313848 docker.go:292] Removing image: registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.7 I0818 21:32:25.495372 313848 ssh_runner.go:195] Run: docker rmi registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.7 I0818 21:32:25.496502 313848 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-proxy_v1.24.3: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.24.3: Process exited with status 1 stdout: stderr: stat: cannot stat '/var/lib/minikube/images/kube-proxy_v1.24.3': No such file or directory I0818 21:32:25.496530 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy_v1.24.3 --> /var/lib/minikube/images/kube-proxy_v1.24.3 (39518208 bytes) I0818 21:32:25.496576 313848 cache_images.go:286] Loading image from: /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler_v1.24.3 I0818 21:32:25.496634 313848 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.24.3 I0818 21:32:25.510687 313848 cache_images.go:116] "registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner:v5" needs transfer: "registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner:v5" does not exist at hash "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562" in container runtime I0818 21:32:25.510717 313848 docker.go:292] Removing image: registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner:v5 I0818 21:32:25.510746 313848 ssh_runner.go:195] Run: docker rmi registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner:v5 I0818 21:32:25.510816 313848 cache_images.go:286] Loading image from: /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager_v1.24.3 I0818 21:32:25.510859 313848 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.24.3 I0818 21:32:25.621401 313848 cache_images.go:116] "registry.cn-hangzhou.aliyuncs.com/google_containers/coredns:v1.8.6" needs transfer: "registry.cn-hangzhou.aliyuncs.com/google_containers/coredns:v1.8.6" does not exist at hash "a4ca41631cc7ac19ce1be3ebf0314ac5f47af7c711f17066006db82ee3b75b03" in container runtime I0818 21:32:25.621434 313848 docker.go:292] Removing image: registry.cn-hangzhou.aliyuncs.com/google_containers/coredns:v1.8.6 I0818 21:32:25.621432 313848 cache_images.go:116] "registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.24.3" needs transfer: "registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.24.3" does not exist at hash "d521dd763e2e345a72534dd1503df3f5a14645ccb3fb0c0dd672fdd6da8853db" in container runtime I0818 21:32:25.621457 313848 docker.go:292] Removing image: registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.24.3 I0818 21:32:25.621466 313848 ssh_runner.go:195] Run: docker rmi registry.cn-hangzhou.aliyuncs.com/google_containers/coredns:v1.8.6 I0818 21:32:25.621483 313848 ssh_runner.go:195] Run: docker rmi registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver:v1.24.3 I0818 21:32:25.623169 313848 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-scheduler_v1.24.3: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.24.3: Process exited with status 1 stdout: stderr: stat: cannot stat '/var/lib/minikube/images/kube-scheduler_v1.24.3': No such file or directory I0818 21:32:25.623186 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler_v1.24.3 --> /var/lib/minikube/images/kube-scheduler_v1.24.3 (15491584 bytes) I0818 21:32:25.623220 313848 cache_images.go:286] Loading image from: /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/pause_3.7 I0818 21:32:25.623270 313848 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.7 I0818 21:32:25.681421 313848 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-controller-manager_v1.24.3: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.24.3: Process exited with status 1 stdout: stderr: stat: cannot stat '/var/lib/minikube/images/kube-controller-manager_v1.24.3': No such file or directory I0818 21:32:25.681441 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager_v1.24.3 --> /var/lib/minikube/images/kube-controller-manager_v1.24.3 (31038464 bytes) I0818 21:32:25.681479 313848 cache_images.go:286] Loading image from: /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner_v5 I0818 21:32:25.681541 313848 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5 I0818 21:32:25.795399 313848 cache_images.go:286] Loading image from: /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/coredns_v1.8.6 I0818 21:32:25.795467 313848 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_v1.8.6 I0818 21:32:25.795527 313848 ssh_runner.go:352] existence check for /var/lib/minikube/images/pause_3.7: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.7: Process exited with status 1 stdout: stderr: stat: cannot stat '/var/lib/minikube/images/pause_3.7': No such file or directory I0818 21:32:25.795537 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/pause_3.7 --> /var/lib/minikube/images/pause_3.7 (311296 bytes) I0818 21:32:25.795554 313848 ssh_runner.go:352] existence check for /var/lib/minikube/images/storage-provisioner_v5: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5: Process exited with status 1 stdout: stderr: stat: cannot stat '/var/lib/minikube/images/storage-provisioner_v5': No such file or directory I0818 21:32:25.795560 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner_v5 --> /var/lib/minikube/images/storage-provisioner_v5 (9060352 bytes) I0818 21:32:25.795605 313848 cache_images.go:286] Loading image from: /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver_v1.24.3 I0818 21:32:25.795636 313848 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.24.3 I0818 21:32:25.824853 313848 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-apiserver_v1.24.3: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.24.3: Process exited with status 1 stdout: stderr: stat: cannot stat '/var/lib/minikube/images/kube-apiserver_v1.24.3': No such file or directory I0818 21:32:25.824876 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver_v1.24.3 --> /var/lib/minikube/images/kube-apiserver_v1.24.3 (33799168 bytes) I0818 21:32:25.826452 313848 ssh_runner.go:352] existence check for /var/lib/minikube/images/coredns_v1.8.6: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_v1.8.6: Process exited with status 1 stdout: stderr: stat: cannot stat '/var/lib/minikube/images/coredns_v1.8.6': No such file or directory I0818 21:32:25.826463 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/coredns_v1.8.6 --> /var/lib/minikube/images/coredns_v1.8.6 (13586432 bytes) I0818 21:32:25.872345 313848 docker.go:259] Loading image: /var/lib/minikube/images/pause_3.7 I0818 21:32:25.872364 313848 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/pause_3.7 | docker load" I0818 21:32:28.132656 313848 ssh_runner.go:235] Completed: /bin/bash -c "sudo cat /var/lib/minikube/images/pause_3.7 | docker load": (2.260267449s) I0818 21:32:28.132677 313848 cache_images.go:315] Transferred and loaded /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/pause_3.7 from cache I0818 21:32:28.132704 313848 docker.go:259] Loading image: /var/lib/minikube/images/kube-scheduler_v1.24.3 I0818 21:32:28.132715 313848 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/kube-scheduler_v1.24.3 | docker load" I0818 21:32:29.064575 313848 cache_images.go:315] Transferred and loaded /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-scheduler_v1.24.3 from cache I0818 21:32:29.064607 313848 docker.go:259] Loading image: /var/lib/minikube/images/storage-provisioner_v5 I0818 21:32:29.064619 313848 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/storage-provisioner_v5 | docker load" I0818 21:32:29.472315 313848 cache_images.go:315] Transferred and loaded /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/storage-provisioner_v5 from cache I0818 21:32:29.472360 313848 docker.go:259] Loading image: /var/lib/minikube/images/coredns_v1.8.6 I0818 21:32:29.472378 313848 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/coredns_v1.8.6 | docker load" I0818 21:32:30.099595 313848 cache_images.go:315] Transferred and loaded /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/coredns_v1.8.6 from cache I0818 21:32:30.099625 313848 docker.go:259] Loading image: /var/lib/minikube/images/kube-controller-manager_v1.24.3 I0818 21:32:30.099638 313848 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/kube-controller-manager_v1.24.3 | docker load" I0818 21:32:31.120253 313848 ssh_runner.go:235] Completed: /bin/bash -c "sudo cat /var/lib/minikube/images/kube-controller-manager_v1.24.3 | docker load": (1.020592785s) I0818 21:32:31.120276 313848 cache_images.go:315] Transferred and loaded /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-controller-manager_v1.24.3 from cache I0818 21:32:31.120317 313848 docker.go:259] Loading image: /var/lib/minikube/images/kube-proxy_v1.24.3 I0818 21:32:31.120345 313848 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/kube-proxy_v1.24.3 | docker load" I0818 21:32:32.523258 313848 ssh_runner.go:235] Completed: /bin/bash -c "sudo cat /var/lib/minikube/images/kube-proxy_v1.24.3 | docker load": (1.40289493s) I0818 21:32:32.523275 313848 cache_images.go:315] Transferred and loaded /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-proxy_v1.24.3 from cache I0818 21:32:32.523294 313848 docker.go:259] Loading image: /var/lib/minikube/images/kube-apiserver_v1.24.3 I0818 21:32:32.523302 313848 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/kube-apiserver_v1.24.3 | docker load" I0818 21:32:33.521865 313848 cache_images.go:315] Transferred and loaded /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/kube-apiserver_v1.24.3 from cache I0818 21:32:33.521887 313848 docker.go:259] Loading image: /var/lib/minikube/images/etcd_3.5.3-0 I0818 21:32:33.521897 313848 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/etcd_3.5.3-0 | docker load" I0818 21:32:38.247885 313848 ssh_runner.go:235] Completed: /bin/bash -c "sudo cat /var/lib/minikube/images/etcd_3.5.3-0 | docker load": (4.725966651s) I0818 21:32:38.247906 313848 cache_images.go:315] Transferred and loaded /home/chensq20/.minikube/cache/images/amd64/registry.cn-hangzhou.aliyuncs.com/google_containers/etcd_3.5.3-0 from cache I0818 21:32:38.247929 313848 cache_images.go:123] Successfully loaded all cached images I0818 21:32:38.247933 313848 cache_images.go:92] LoadImages completed in 13.323083827s I0818 21:32:38.248019 313848 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}} I0818 21:32:38.376394 313848 cni.go:95] Creating CNI manager for "" I0818 21:32:38.376413 313848 cni.go:169] CNI unnecessary in this configuration, recommending no CNI I0818 21:32:38.376447 313848 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16 I0818 21:32:38.376466 313848 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.24.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:minikube NodeName:minikube DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository:registry.cn-hangzhou.aliyuncs.com/google_containers ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]} I0818 21:32:38.376645 313848 kubeadm.go:162] kubeadm config: apiVersion: kubeadm.k8s.io/v1beta3 kind: InitConfiguration localAPIEndpoint: advertiseAddress: 192.168.49.2 bindPort: 8443 bootstrapTokens: - groups: - system:bootstrappers:kubeadm:default-node-token ttl: 24h0m0s usages: - signing - authentication nodeRegistration: criSocket: /var/run/cri-dockerd.sock name: "minikube" kubeletExtraArgs: node-ip: 192.168.49.2 taints: [] --- apiVersion: kubeadm.k8s.io/v1beta3 kind: ClusterConfiguration imageRepository: registry.cn-hangzhou.aliyuncs.com/google_containers apiServer: certSANs: ["127.0.0.1", "localhost", "192.168.49.2"] extraArgs: enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota" controllerManager: extraArgs: allocate-node-cidrs: "true" leader-elect: "false" scheduler: extraArgs: leader-elect: "false" certificatesDir: /var/lib/minikube/certs clusterName: mk controlPlaneEndpoint: control-plane.minikube.internal:8443 etcd: local: dataDir: /var/lib/minikube/etcd extraArgs: proxy-refresh-interval: "70000" kubernetesVersion: v1.24.3 networking: dnsDomain: cluster.local podSubnet: "10.244.0.0/16" serviceSubnet: 10.96.0.0/12 --- apiVersion: kubelet.config.k8s.io/v1beta1 kind: KubeletConfiguration authentication: x509: clientCAFile: /var/lib/minikube/certs/ca.crt cgroupDriver: cgroupfs clusterDomain: "cluster.local" # disable disk resource management by default imageGCHighThresholdPercent: 100 evictionHard: nodefs.available: "0%!"(MISSING) nodefs.inodesFree: "0%!"(MISSING) imagefs.available: "0%!"(MISSING) failSwapOn: false staticPodPath: /etc/kubernetes/manifests --- apiVersion: kubeproxy.config.k8s.io/v1alpha1 kind: KubeProxyConfiguration clusterCIDR: "10.244.0.0/16" metricsBindAddress: 0.0.0.0:10249 conntrack: maxPerCore: 0 # Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established" tcpEstablishedTimeout: 0s # Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close" tcpCloseWaitTimeout: 0s I0818 21:32:38.376775 313848 kubeadm.go:961] kubelet [Unit] Wants=docker.socket [Service] ExecStart= ExecStart=/var/lib/minikube/binaries/v1.24.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=/var/run/cri-dockerd.sock --hostname-override=minikube --image-service-endpoint=/var/run/cri-dockerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2 --pod-infra-container-image=registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.7 --runtime-request-timeout=15m [Install] config: {KubernetesVersion:v1.24.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository:registry.cn-hangzhou.aliyuncs.com/google_containers LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} I0818 21:32:38.376831 313848 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.3 I0818 21:32:38.387205 313848 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.24.3: Process exited with status 2 stdout: stderr: ls: cannot access '/var/lib/minikube/binaries/v1.24.3': No such file or directory Initiating transfer... I0818 21:32:38.387259 313848 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.24.3 I0818 21:32:38.397259 313848 download.go:101] Downloading: https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.24.3/bin/linux/amd64/kubectl?checksum=file:https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.24.3/bin/linux/amd64/kubectl.sha256 -> /home/chensq20/.minikube/cache/linux/amd64/v1.24.3/kubectl I0818 21:32:38.397266 313848 download.go:101] Downloading: https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.24.3/bin/linux/amd64/kubelet?checksum=file:https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.24.3/bin/linux/amd64/kubelet.sha256 -> /home/chensq20/.minikube/cache/linux/amd64/v1.24.3/kubelet I0818 21:32:38.397605 313848 download.go:101] Downloading: https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.24.3/bin/linux/amd64/kubeadm?checksum=file:https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.24.3/bin/linux/amd64/kubeadm.sha256 -> /home/chensq20/.minikube/cache/linux/amd64/v1.24.3/kubeadm I0818 21:32:41.323246 313848 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.24.3/kubeadm I0818 21:32:41.328471 313848 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.24.3/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.24.3/kubeadm: Process exited with status 1 stdout: stderr: stat: cannot stat '/var/lib/minikube/binaries/v1.24.3/kubeadm': No such file or directory I0818 21:32:41.328492 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/cache/linux/amd64/v1.24.3/kubeadm --> /var/lib/minikube/binaries/v1.24.3/kubeadm (44376064 bytes) I0818 21:32:41.394168 313848 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.24.3/kubectl I0818 21:32:41.404296 313848 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.24.3/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.24.3/kubectl: Process exited with status 1 stdout: stderr: stat: cannot stat '/var/lib/minikube/binaries/v1.24.3/kubectl': No such file or directory I0818 21:32:41.404316 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/cache/linux/amd64/v1.24.3/kubectl --> /var/lib/minikube/binaries/v1.24.3/kubectl (45711360 bytes) I0818 21:32:44.450092 313848 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet I0818 21:32:45.024595 313848 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.24.3/kubelet I0818 21:32:45.028503 313848 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.24.3/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.24.3/kubelet: Process exited with status 1 stdout: stderr: stat: cannot stat '/var/lib/minikube/binaries/v1.24.3/kubelet': No such file or directory I0818 21:32:45.028521 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/cache/linux/amd64/v1.24.3/kubelet --> /var/lib/minikube/binaries/v1.24.3/kubelet (116013432 bytes) I0818 21:32:46.329002 313848 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube I0818 21:32:46.338096 313848 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (560 bytes) I0818 21:32:46.705365 313848 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes) I0818 21:32:46.723082 313848 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2100 bytes) I0818 21:32:46.739762 313848 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts I0818 21:32:46.743794 313848 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts"" I0818 21:32:46.755130 313848 certs.go:54] Setting up /home/chensq20/.minikube/profiles/minikube for IP: 192.168.49.2 I0818 21:32:46.755168 313848 certs.go:187] generating minikubeCA CA: /home/chensq20/.minikube/ca.key I0818 21:32:47.078945 313848 crypto.go:156] Writing cert to /home/chensq20/.minikube/ca.crt ... I0818 21:32:47.078960 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/ca.crt: {Name:mk437a7d469ad05e27f99ab5c18a9079bee12624 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.079162 313848 crypto.go:164] Writing key to /home/chensq20/.minikube/ca.key ... I0818 21:32:47.079168 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/ca.key: {Name:mk532552802f8673f18b1d9880401206b0e5d950 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.079273 313848 certs.go:187] generating proxyClientCA CA: /home/chensq20/.minikube/proxy-client-ca.key I0818 21:32:47.253641 313848 crypto.go:156] Writing cert to /home/chensq20/.minikube/proxy-client-ca.crt ... I0818 21:32:47.253656 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/proxy-client-ca.crt: {Name:mk1be8b8cb5952a31abc60d1bc8c8f33f356d3e0 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.253863 313848 crypto.go:164] Writing key to /home/chensq20/.minikube/proxy-client-ca.key ... I0818 21:32:47.253869 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/proxy-client-ca.key: {Name:mk6118c07eba2de0814a7a581ed6d3317172217f Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.254030 313848 certs.go:302] generating minikube-user signed cert: /home/chensq20/.minikube/profiles/minikube/client.key I0818 21:32:47.254047 313848 crypto.go:68] Generating cert /home/chensq20/.minikube/profiles/minikube/client.crt with IP's: [] I0818 21:32:47.446200 313848 crypto.go:156] Writing cert to /home/chensq20/.minikube/profiles/minikube/client.crt ... I0818 21:32:47.446215 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/profiles/minikube/client.crt: {Name:mk74f5f9c6060b1b85ad4d2d5fe39f5e591dcb7a Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.446423 313848 crypto.go:164] Writing key to /home/chensq20/.minikube/profiles/minikube/client.key ... I0818 21:32:47.446429 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/profiles/minikube/client.key: {Name:mkf4ba52783165daa15018125df61c54d91c7426 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.446516 313848 certs.go:302] generating minikube signed cert: /home/chensq20/.minikube/profiles/minikube/apiserver.key.dd3b5fb2 I0818 21:32:47.446529 313848 crypto.go:68] Generating cert /home/chensq20/.minikube/profiles/minikube/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1] I0818 21:32:47.578832 313848 crypto.go:156] Writing cert to /home/chensq20/.minikube/profiles/minikube/apiserver.crt.dd3b5fb2 ... I0818 21:32:47.578846 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/profiles/minikube/apiserver.crt.dd3b5fb2: {Name:mkc9b0ce79bceaa349f61fda59dab7759147db5c Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.579001 313848 crypto.go:164] Writing key to /home/chensq20/.minikube/profiles/minikube/apiserver.key.dd3b5fb2 ... I0818 21:32:47.579007 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/profiles/minikube/apiserver.key.dd3b5fb2: {Name:mk2a6de824f789d01a818139a449e2676463b24e Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.579091 313848 certs.go:320] copying /home/chensq20/.minikube/profiles/minikube/apiserver.crt.dd3b5fb2 -> /home/chensq20/.minikube/profiles/minikube/apiserver.crt I0818 21:32:47.579188 313848 certs.go:324] copying /home/chensq20/.minikube/profiles/minikube/apiserver.key.dd3b5fb2 -> /home/chensq20/.minikube/profiles/minikube/apiserver.key I0818 21:32:47.579247 313848 certs.go:302] generating aggregator signed cert: /home/chensq20/.minikube/profiles/minikube/proxy-client.key I0818 21:32:47.579261 313848 crypto.go:68] Generating cert /home/chensq20/.minikube/profiles/minikube/proxy-client.crt with IP's: [] I0818 21:32:47.903200 313848 crypto.go:156] Writing cert to /home/chensq20/.minikube/profiles/minikube/proxy-client.crt ... I0818 21:32:47.903218 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/profiles/minikube/proxy-client.crt: {Name:mk2c5a4e3166834fad7e89b6fbd6e3a5882e7f4d Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.903444 313848 crypto.go:164] Writing key to /home/chensq20/.minikube/profiles/minikube/proxy-client.key ... I0818 21:32:47.903450 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/profiles/minikube/proxy-client.key: {Name:mkcea6bd810f17ff98a91ec5b2819dc83789ae3d Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.903645 313848 certs.go:388] found cert: /home/chensq20/.minikube/certs/home/chensq20/.minikube/certs/ca-key.pem (1679 bytes) I0818 21:32:47.903679 313848 certs.go:388] found cert: /home/chensq20/.minikube/certs/home/chensq20/.minikube/certs/ca.pem (1082 bytes) I0818 21:32:47.903750 313848 certs.go:388] found cert: /home/chensq20/.minikube/certs/home/chensq20/.minikube/certs/cert.pem (1127 bytes) I0818 21:32:47.903779 313848 certs.go:388] found cert: /home/chensq20/.minikube/certs/home/chensq20/.minikube/certs/key.pem (1679 bytes) I0818 21:32:47.904566 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/profiles/minikube/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes) I0818 21:32:47.928309 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/profiles/minikube/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes) I0818 21:32:47.951258 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/profiles/minikube/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes) I0818 21:32:47.975071 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/profiles/minikube/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes) I0818 21:32:47.999716 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes) I0818 21:32:48.023451 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes) I0818 21:32:48.046518 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes) I0818 21:32:48.069805 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes) I0818 21:32:48.092393 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes) I0818 21:32:48.122498 313848 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes) I0818 21:32:48.141232 313848 ssh_runner.go:195] Run: openssl version I0818 21:32:48.147371 313848 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem" I0818 21:32:48.157766 313848 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem I0818 21:32:48.162015 313848 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Aug 18 13:32 /usr/share/ca-certificates/minikubeCA.pem I0818 21:32:48.162043 313848 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem I0818 21:32:48.169983 313848 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0" I0818 21:32:48.182946 313848 kubeadm.go:395] StartCluster: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:registry.cn-hangzhou.aliyuncs.com/google_containers/kicbase:v0.0.33@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository:registry.cn-hangzhou.aliyuncs.com/google_containers LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.24.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/chensq20:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} I0818 21:32:48.183044 313848 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}} I0818 21:32:48.223878 313848 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd I0818 21:32:48.232734 313848 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml I0818 21:32:48.240947 313848 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver I0818 21:32:48.240976 313848 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf I0818 21:32:48.248818 313848 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2 stdout: stderr: ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory I0818 21:32:48.248849 313848 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables" I0818 21:32:48.634566 313848 out.go:204] - Generating certificates and keys ... I0818 21:32:51.435003 313848 out.go:204] - Booting up control plane ... W0818 21:36:51.443611 313848 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1 stdout: [init] Using Kubernetes version: v1.24.3 [preflight] Running pre-flight checks [preflight] The system verification failed. Printing the output from the verification: KERNEL_VERSION: 3.10.0-1160.36.2.el7.x86_64 OS: Linux CGROUPS_CPU: enabled CGROUPS_CPUACCT: enabled CGROUPS_CPUSET: enabled CGROUPS_DEVICES: enabled CGROUPS_FREEZER: enabled CGROUPS_MEMORY: enabled CGROUPS_PIDS: enabled CGROUPS_HUGETLB: enabled CGROUPS_BLKIO: enabled [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' [certs] Using certificateDir folder "/var/lib/minikube/certs" [certs] Using existing ca certificate authority [certs] Using existing apiserver certificate and key on disk [certs] Generating "apiserver-kubelet-client" certificate and key [certs] Generating "front-proxy-ca" certificate and key [certs] Generating "front-proxy-client" certificate and key [certs] Generating "etcd/ca" certificate and key [certs] Generating "etcd/server" certificate and key [certs] etcd/server serving cert is signed for DNS names [localhost minikube] and IPs [192.168.49.2 127.0.0.1 ::1] [certs] Generating "etcd/peer" certificate and key [certs] etcd/peer serving cert is signed for DNS names [localhost minikube] and IPs [192.168.49.2 127.0.0.1 ::1] [certs] Generating "etcd/healthcheck-client" certificate and key [certs] Generating "apiserver-etcd-client" certificate and key [certs] Generating "sa" key and public key [kubeconfig] Using kubeconfig folder "/etc/kubernetes" [kubeconfig] Writing "admin.conf" kubeconfig file [kubeconfig] Writing "kubelet.conf" kubeconfig file [kubeconfig] Writing "controller-manager.conf" kubeconfig file [kubeconfig] Writing "scheduler.conf" kubeconfig file [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" [kubelet-start] Starting the kubelet [control-plane] Using manifest folder "/etc/kubernetes/manifests" [control-plane] Creating static Pod manifest for "kube-apiserver" [control-plane] Creating static Pod manifest for "kube-controller-manager" [control-plane] Creating static Pod manifest for "kube-scheduler" [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests" [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s [kubelet-check] Initial timeout of 40s passed. Unfortunately, an error has occurred: timed out waiting for the condition This error is likely caused by: - The kubelet is not running - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled) If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands: - 'systemctl status kubelet' - 'journalctl -xeu kubelet' Additionally, a control plane component may have crashed or exited when started by the container runtime. To troubleshoot, list all containers using your preferred container runtimes CLI. Here is one example how you may list all running Kubernetes containers by using crictl: - 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock ps -a | grep kube | grep -v pause' Once you have found the failing container, you can inspect its logs with: - 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock logs CONTAINERID' stderr: W0818 13:32:48.291504 1717 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration! [WARNING FileContent--proc-sys-net-bridge-bridge-nf-call-iptables]: /proc/sys/net/bridge/bridge-nf-call-iptables does not exist [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/3.10.0-1160.36.2.el7.x86_64\n", err: exit status 1 [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster To see the stack trace of this error execute with --v=5 or higher I0818 21:36:51.443814 313848 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.3:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force" I0818 21:36:52.390344 313848 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet I0818 21:36:52.401653 313848 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver I0818 21:36:52.401685 313848 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf I0818 21:36:52.409771 313848 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2 stdout: stderr: ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory I0818 21:36:52.409800 313848 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables" I0818 21:36:53.293323 313848 out.go:204] - Generating certificates and keys ... I0818 21:36:53.731987 313848 out.go:204] - Booting up control plane ... * * ==> Docker <== * -- Logs begin at Thu 2022-08-18 13:32:18 UTC, end at Thu 2022-08-18 13:39:48 UTC. -- Aug 18 13:37:39 minikube dockerd[685]: time="2022-08-18T13:37:39.261218322Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:37:39 minikube dockerd[685]: time="2022-08-18T13:37:39.261258339Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:37:39 minikube dockerd[685]: time="2022-08-18T13:37:39.394256785Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:37:39 minikube dockerd[685]: time="2022-08-18T13:37:39.394288975Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:37:39 minikube dockerd[685]: time="2022-08-18T13:37:39.541405997Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:37:39 minikube dockerd[685]: time="2022-08-18T13:37:39.545829165Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:37:41 minikube dockerd[685]: time="2022-08-18T13:37:41.061617939Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:37:41 minikube dockerd[685]: time="2022-08-18T13:37:41.061645642Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:37:41 minikube dockerd[685]: time="2022-08-18T13:37:41.066500345Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:37:41 minikube dockerd[685]: time="2022-08-18T13:37:41.197921726Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:37:41 minikube dockerd[685]: time="2022-08-18T13:37:41.197947323Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:37:41 minikube dockerd[685]: time="2022-08-18T13:37:41.203032950Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:06 minikube dockerd[685]: time="2022-08-18T13:38:06.062513819Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": dial tcp 74.125.203.82:443: i/o timeout" Aug 18 13:38:06 minikube dockerd[685]: time="2022-08-18T13:38:06.062541702Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": dial tcp 74.125.203.82:443: i/o timeout" Aug 18 13:38:06 minikube dockerd[685]: time="2022-08-18T13:38:06.067791269Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": dial tcp 74.125.203.82:443: i/o timeout" Aug 18 13:38:09 minikube dockerd[685]: time="2022-08-18T13:38:09.096251824Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:09 minikube dockerd[685]: time="2022-08-18T13:38:09.096297282Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:09 minikube dockerd[685]: time="2022-08-18T13:38:09.101540138Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:10 minikube dockerd[685]: time="2022-08-18T13:38:10.058634671Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:10 minikube dockerd[685]: time="2022-08-18T13:38:10.058671374Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:10 minikube dockerd[685]: time="2022-08-18T13:38:10.064015611Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:11 minikube dockerd[685]: time="2022-08-18T13:38:11.736772587Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:11 minikube dockerd[685]: time="2022-08-18T13:38:11.736879069Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:11 minikube dockerd[685]: time="2022-08-18T13:38:11.742201845Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:36 minikube dockerd[685]: time="2022-08-18T13:38:36.094707613Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:36 minikube dockerd[685]: time="2022-08-18T13:38:36.094740932Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:36 minikube dockerd[685]: time="2022-08-18T13:38:36.101894108Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:38 minikube dockerd[685]: time="2022-08-18T13:38:38.065442403Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:38 minikube dockerd[685]: time="2022-08-18T13:38:38.065477917Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:38 minikube dockerd[685]: time="2022-08-18T13:38:38.070379155Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:39 minikube dockerd[685]: time="2022-08-18T13:38:39.059255971Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:39 minikube dockerd[685]: time="2022-08-18T13:38:39.059378879Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:39 minikube dockerd[685]: time="2022-08-18T13:38:39.064870703Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:39 minikube dockerd[685]: time="2022-08-18T13:38:39.195031426Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:39 minikube dockerd[685]: time="2022-08-18T13:38:39.195059401Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:38:39 minikube dockerd[685]: time="2022-08-18T13:38:39.200027904Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:05 minikube dockerd[685]: time="2022-08-18T13:39:05.055301617Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:05 minikube dockerd[685]: time="2022-08-18T13:39:05.055350989Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:05 minikube dockerd[685]: time="2022-08-18T13:39:05.060067569Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:05 minikube dockerd[685]: time="2022-08-18T13:39:05.231361371Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:05 minikube dockerd[685]: time="2022-08-18T13:39:05.231393342Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:05 minikube dockerd[685]: time="2022-08-18T13:39:05.236482699Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:05 minikube dockerd[685]: time="2022-08-18T13:39:05.320848086Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:05 minikube dockerd[685]: time="2022-08-18T13:39:05.320873544Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:05 minikube dockerd[685]: time="2022-08-18T13:39:05.325592576Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:08 minikube dockerd[685]: time="2022-08-18T13:39:08.063267783Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:08 minikube dockerd[685]: time="2022-08-18T13:39:08.063311562Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:08 minikube dockerd[685]: time="2022-08-18T13:39:08.068314342Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:32 minikube dockerd[685]: time="2022-08-18T13:39:32.056052361Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:32 minikube dockerd[685]: time="2022-08-18T13:39:32.056086703Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:32 minikube dockerd[685]: time="2022-08-18T13:39:32.061201933Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:34 minikube dockerd[685]: time="2022-08-18T13:39:34.216996220Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:34 minikube dockerd[685]: time="2022-08-18T13:39:34.217035372Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:34 minikube dockerd[685]: time="2022-08-18T13:39:34.332984933Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:35 minikube dockerd[685]: time="2022-08-18T13:39:35.057065693Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:35 minikube dockerd[685]: time="2022-08-18T13:39:35.057106300Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:35 minikube dockerd[685]: time="2022-08-18T13:39:35.062141002Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:36 minikube dockerd[685]: time="2022-08-18T13:39:36.058515358Z" level=warning msg="Error getting v2 registry: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:36 minikube dockerd[685]: time="2022-08-18T13:39:36.058593918Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Aug 18 13:39:36 minikube dockerd[685]: time="2022-08-18T13:39:36.730007770Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://k8s.gcr.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" * * ==> container status <== * CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID * * ==> describe nodes <== * * ==> dmesg <== * [Aug17 09:45] ACPI: RSDP 00000000000f6210 00014 (v00 BOCHS ) [ +0.000000] ACPI: RSDT 00000000bffe2510 00030 (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001) [ +0.000000] ACPI: FACP 00000000bffe21dc 00074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001) [ +0.000000] ACPI: DSDT 00000000bffdfd00 024DC (v01 BOCHS BXPCDSDT 00000001 BXPC 00000001) [ +0.000000] ACPI: FACS 00000000bffdfcc0 00040 [ +0.000000] ACPI: APIC 00000000bffe2250 000F0 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001) [ +0.000000] ACPI: SRAT 00000000bffe2340 001D0 (v01 BOCHS BXPCSRAT 00000001 BXPC 00000001) [ +0.000000] Zone ranges: [ +0.000000] DMA [mem 0x00001000-0x00ffffff] [ +0.000000] DMA32 [mem 0x01000000-0xffffffff] [ +0.000000] Normal [mem 0x100000000-0x23fffffff] [ +0.000000] Movable zone start for each node [ +0.000000] Early memory node ranges [ +0.000000] node 0: [mem 0x00001000-0x0009efff] [ +0.000000] node 0: [mem 0x00100000-0xbffdbfff] [ +0.000000] node 0: [mem 0x100000000-0x23fffffff] [ +0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 2064229 [ +0.000000] Policy zone: Normal [ +0.000000] ACPI: All ACPI Tables successfully acquired [ +0.167757] ACPI: Enabled 3 GPEs in block 00 to 0F [ +0.005463] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ +0.107571] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11 [ +0.311251] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ +0.281407] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 10 [ +0.055266] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10 [ +0.028149] ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 11 [ +0.152939] sd 2:0:0:0: Power-on or device reset occurred [Aug18 05:41] TECH PREVIEW: Overlay filesystem may not be fully supported. Please review provided documentation for limitations. * * ==> kernel <== * 13:39:51 up 1 day, 3:53, 0 users, load average: 0.12, 0.22, 0.22 Linux minikube 3.10.0-1160.36.2.el7.x86_64 #1 SMP Wed Jul 21 11:57:15 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux PRETTY_NAME="Ubuntu 20.04.4 LTS" * * ==> kubelet <== * -- Logs begin at Thu 2022-08-18 13:32:18 UTC, end at Thu 2022-08-18 13:39:51 UTC. -- Aug 18 13:39:45 minikube kubelet[3586]: E0818 13:39:45.925776 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:46 minikube kubelet[3586]: E0818 13:39:46.026602 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:46 minikube kubelet[3586]: E0818 13:39:46.127362 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:46 minikube kubelet[3586]: E0818 13:39:46.227934 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:46 minikube kubelet[3586]: E0818 13:39:46.328831 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:46 minikube kubelet[3586]: E0818 13:39:46.429621 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:46 minikube kubelet[3586]: E0818 13:39:46.530370 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:46 minikube kubelet[3586]: E0818 13:39:46.630950 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:46 minikube kubelet[3586]: E0818 13:39:46.731537 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:46 minikube kubelet[3586]: E0818 13:39:46.832351 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:46 minikube kubelet[3586]: E0818 13:39:46.933003 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:47 minikube kubelet[3586]: E0818 13:39:47.034082 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:47 minikube kubelet[3586]: E0818 13:39:47.134833 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:47 minikube kubelet[3586]: W0818 13:39:47.160628 3586 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)minikube&limit=500&resourceVersion=0": dial tcp 192.168.49.2:8443: connect: connection refused Aug 18 13:39:47 minikube kubelet[3586]: E0818 13:39:47.160693 3586 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)minikube&limit=500&resourceVersion=0": dial tcp 192.168.49.2:8443: connect: connection refused Aug 18 13:39:47 minikube kubelet[3586]: E0818 13:39:47.234920 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:47 minikube kubelet[3586]: E0818 13:39:47.335942 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:47 minikube kubelet[3586]: E0818 13:39:47.436556 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:47 minikube kubelet[3586]: E0818 13:39:47.481322 3586 controller.go:144] failed to ensure lease exists, will retry in 7s, error: Get "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/minikube?timeout=10s": dial tcp 192.168.49.2:8443: connect: connection refused Aug 18 13:39:47 minikube kubelet[3586]: E0818 13:39:47.537600 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:47 minikube kubelet[3586]: E0818 13:39:47.638155 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:47 minikube kubelet[3586]: E0818 13:39:47.738786 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:47 minikube kubelet[3586]: E0818 13:39:47.839516 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:47 minikube kubelet[3586]: I0818 13:39:47.870430 3586 kubelet_node_status.go:70] "Attempting to register node" node="minikube" Aug 18 13:39:47 minikube kubelet[3586]: E0818 13:39:47.870799 3586 kubelet_node_status.go:92] "Unable to register node with API server" err="Post \"https://control-plane.minikube.internal:8443/api/v1/nodes\": dial tcp 192.168.49.2:8443: connect: connection refused" node="minikube" Aug 18 13:39:47 minikube kubelet[3586]: E0818 13:39:47.940281 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:48 minikube kubelet[3586]: E0818 13:39:48.041435 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:48 minikube kubelet[3586]: E0818 13:39:48.142046 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:48 minikube kubelet[3586]: E0818 13:39:48.242671 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:48 minikube kubelet[3586]: E0818 13:39:48.343766 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:48 minikube kubelet[3586]: E0818 13:39:48.444788 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:48 minikube kubelet[3586]: E0818 13:39:48.545324 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:48 minikube kubelet[3586]: E0818 13:39:48.646338 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:48 minikube kubelet[3586]: E0818 13:39:48.746948 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:48 minikube kubelet[3586]: E0818 13:39:48.847799 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:48 minikube kubelet[3586]: E0818 13:39:48.948546 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:49 minikube kubelet[3586]: E0818 13:39:49.049301 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:49 minikube kubelet[3586]: E0818 13:39:49.149873 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:49 minikube kubelet[3586]: E0818 13:39:49.250135 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:49 minikube kubelet[3586]: E0818 13:39:49.350771 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:49 minikube kubelet[3586]: E0818 13:39:49.451433 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:49 minikube kubelet[3586]: E0818 13:39:49.552067 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:49 minikube kubelet[3586]: E0818 13:39:49.652634 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:49 minikube kubelet[3586]: E0818 13:39:49.753372 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:49 minikube kubelet[3586]: E0818 13:39:49.853456 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:49 minikube kubelet[3586]: E0818 13:39:49.954425 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:50 minikube kubelet[3586]: E0818 13:39:50.054986 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:50 minikube kubelet[3586]: E0818 13:39:50.145725 3586 event.go:276] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.170c73ea9506bd88", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ZZZ_DeprecatedClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:time.Date(2022, time.August, 18, 13, 36, 53, 952658824, time.Local), LastTimestamp:time.Date(2022, time.August, 18, 13, 36, 53, 952658824, time.Local), Count:1, Type:"Normal", EventTime:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Post "https://control-plane.minikube.internal:8443/api/v1/namespaces/default/events": dial tcp 192.168.49.2:8443: connect: connection refused'(may retry after sleeping) Aug 18 13:39:50 minikube kubelet[3586]: E0818 13:39:50.155137 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:50 minikube kubelet[3586]: E0818 13:39:50.255447 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:50 minikube kubelet[3586]: E0818 13:39:50.356155 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:50 minikube kubelet[3586]: E0818 13:39:50.456880 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:50 minikube kubelet[3586]: E0818 13:39:50.557419 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:50 minikube kubelet[3586]: E0818 13:39:50.657939 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:50 minikube kubelet[3586]: E0818 13:39:50.758482 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:50 minikube kubelet[3586]: E0818 13:39:50.858941 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:50 minikube kubelet[3586]: E0818 13:39:50.960005 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:51 minikube kubelet[3586]: E0818 13:39:51.060736 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:51 minikube kubelet[3586]: E0818 13:39:51.161384 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found" Aug 18 13:39:51 minikube kubelet[3586]: E0818 13:39:51.261789 3586 kubelet.go:2424] "Error getting node" err="node \"minikube\" not found"