Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

unsupported graph driver: btrfs #6167

Closed
thorstenhirsch opened this issue Dec 27, 2019 · 10 comments
Closed

unsupported graph driver: btrfs #6167

thorstenhirsch opened this issue Dec 27, 2019 · 10 comments
Labels
co/kubeadm Issues relating to kubeadm co/none-driver good first issue Denotes an issue ready for a new contributor, according to the "help wanted" guidelines. help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. kind/documentation Categorizes issue or PR as related to documentation. lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. priority/backlog Higher priority than priority/awaiting-more-evidence.

Comments

@thorstenhirsch
Copy link

thorstenhirsch commented Dec 27, 2019 •
edited
Loading

The exact command to reproduce the issue:
$ sudo minikube start --vm-driver=none

The full output of the command that failed:

😄  minikube v1.6.2 on Arch 
✨  Selecting 'none' driver from user configuration (alternates: [virtualbox])
🤹  Running on localhost (CPUs=12, Memory=16025MB, Disk=474830MB) ...
ℹ️   OS release is Arch Linux
⚠️  VM may be unable to resolve external DNS records
🐳  Preparing Kubernetes v1.17.0 on Docker '19.03.5-ce' ...
    ▪ kubelet.resolv-conf=/run/systemd/resolve/resolv.conf
🚜  Pulling images ...
🚀  Launching Kubernetes ... 

💣  Error starting cluster: init failed. cmd: "/bin/bash -c \"sudo env PATH=/var/lib/minikube/binaries/v1.17.0:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap\"": /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.17.0:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap": exit status 1
stdout:
[init] Using Kubernetes version: v1.17.0
[preflight] Running pre-flight checks
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 5.4.6-arch3-1
CONFIG_NAMESPACES: enabled
CONFIG_NET_NS: enabled
CONFIG_PID_NS: enabled
CONFIG_IPC_NS: enabled
CONFIG_UTS_NS: enabled
CONFIG_CGROUPS: enabled
CONFIG_CGROUP_CPUACCT: enabled
CONFIG_CGROUP_DEVICE: enabled
CONFIG_CGROUP_FREEZER: enabled
CONFIG_CGROUP_SCHED: enabled
CONFIG_CPUSETS: enabled
CONFIG_MEMCG: enabled
CONFIG_INET: enabled
CONFIG_EXT4_FS: enabled (as module)
CONFIG_PROC_FS: enabled
CONFIG_NETFILTER_XT_TARGET_REDIRECT: enabled (as module)
CONFIG_NETFILTER_XT_MATCH_COMMENT: enabled (as module)
CONFIG_OVERLAY_FS: enabled (as module)
CONFIG_AUFS_FS: not set - Required for aufs.
CONFIG_BLK_DEV_DM: enabled (as module)
DOCKER_VERSION: 19.03.5-ce
DOCKER_GRAPH_DRIVER: btrfs
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
CGROUPS_CPUSET: enabled
CGROUPS_DEVICES: enabled
CGROUPS_FREEZER: enabled
CGROUPS_MEMORY: enabled

stderr:
W1227 14:10:32.471302    2827 common.go:77] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta1". Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
W1227 14:10:32.471868    2827 common.go:77] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta1". Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
W1227 14:10:32.473338    2827 validation.go:28] Cannot validate kube-proxy config - no validator is available
W1227 14:10:32.473345    2827 validation.go:28] Cannot validate kubelet config - no validator is available
	[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
	[WARNING Swap]: running with swap on is not supported. Please disable swap
	[WARNING Hostname]: hostname "minikube" could not be reached
	[WARNING Hostname]: hostname "minikube": lookup minikube on 127.0.0.53:53: read udp 127.0.0.1:59066->127.0.0.53:53: i/o timeout
	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase preflight: [preflight] Some fatal errors occurred:
	[ERROR SystemVerification]: unsupported graph driver: btrfs
[preflight] If you know what you are doing, you can make a check non-fatal with `--ignore-preflight-errors=...`
To see the stack trace of this error execute with --v=5 or higher


😿  minikube is exiting due to an error. If the above message is not useful, open an issue:
👉  https://github.com/kubernetes/minikube/issues/new/choose

The output of the minikube logs command:

==> Docker <==
-- Logs begin at Sun 2019-04-28 18:40:28 CEST, end at Fri 2019-12-27 14:15:04 CET. --
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.221629777+01:00" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.221644094+01:00" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.221662388+01:00" level=warning msg="could not use snapshotter devmapper in metadata plugin" error="devmapper not configured"
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.221670854+01:00" level=info msg="metadata content store policy set" policy=shared
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222044865+01:00" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222061646+01:00" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222086242+01:00" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222098075+01:00" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222107703+01:00" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222118403+01:00" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222129113+01:00" level=info msg="loading plugin \"io.containerd.service.v1.leases-service\"..." type=io.containerd.service.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222140063+01:00" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222149872+01:00" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222162596+01:00" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222364204+01:00" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222412584+01:00" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222666280+01:00" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222688582+01:00" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222720471+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222732153+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222742523+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222751990+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222761568+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222772048+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222782177+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222791705+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222801373+01:00" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222969658+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222984717+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.222997661+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.223007179+01:00" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.223123286+01:00" level=info msg=serving... address=/var/run/docker/containerd/containerd-debug.sock
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.223153223+01:00" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock.ttrpc
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.223177969+01:00" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.223186244+01:00" level=info msg="containerd successfully booted in 0.025401s"
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.227667104+01:00" level=info msg="detected 127.0.0.53 nameserver, assuming systemd-resolved, so using resolv.conf: /run/systemd/resolve/resolv.conf"
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.228520123+01:00" level=info msg="parsed scheme: \"unix\"" module=grpc
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.228538839+01:00" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.228559137+01:00" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///var/run/docker/containerd/containerd.sock 0  <nil>}] <nil>}" module=grpc
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.228571530+01:00" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.228997719+01:00" level=info msg="parsed scheme: \"unix\"" module=grpc
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.229008709+01:00" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.229018197+01:00" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///var/run/docker/containerd/containerd.sock 0  <nil>}] <nil>}" module=grpc
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.229025060+01:00" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.232215601+01:00" level=info msg="[graphdriver] using prior storage driver: btrfs"
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.264182095+01:00" level=warning msg="Your kernel does not support cgroup rt period"
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.264198596+01:00" level=warning msg="Your kernel does not support cgroup rt runtime"
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.264204046+01:00" level=warning msg="Your kernel does not support cgroup blkio weight"
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.264208795+01:00" level=warning msg="Your kernel does not support cgroup blkio weight_device"
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.264316858+01:00" level=info msg="Loading containers: start."
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.458110624+01:00" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.514508769+01:00" level=info msg="Loading containers: done."
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.552658755+01:00" level=info msg="Docker daemon" commit=633a0ea838 graphdriver(s)=btrfs version=19.03.5-ce
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.552876683+01:00" level=info msg="Daemon has completed initialization"
Dez 27 14:09:48 myhostname dockerd[678]: time="2019-12-27T14:09:48.571824242+01:00" level=info msg="API listen on /run/docker.sock"
Dez 27 14:09:48 myhostname systemd[1]: Started Docker Application Container Engine.
Dez 27 14:09:48 myhostname dockerd[708]: time="2019-12-27T14:09:48.770089701+01:00" level=info msg="shim containerd-shim started" address=/containerd-shim/8dd960655a1ea05fcb1268ab596ea78581f7df78ee660ed89a996eeacff18200.sock debug=false pid=920
Dez 27 14:10:12 myhostname dockerd[708]: time="2019-12-27T14:10:12.579996032+01:00" level=info msg="shim reaped" id=9a0828f184e6b671afded996f1e2532160fb4799eb0703507735918d1499cd1f
Dez 27 14:10:12 myhostname dockerd[678]: time="2019-12-27T14:10:12.590332779+01:00" level=info msg="ignoring event" module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Dez 27 14:10:12 myhostname dockerd[678]: time="2019-12-27T14:10:12.801193680+01:00" level=warning msg="9a0828f184e6b671afded996f1e2532160fb4799eb0703507735918d1499cd1f cleanup: failed to unmount IPC: umount /var/lib/docker/containers/9a0828f184e6b671afded996f1e2532160fb4799eb0703507735918d1499cd1f/mounts/shm, flags: 0x2: no such file or directory"

==> container status <==
sudo: crictl: command not found
CONTAINER ID        IMAGE                        COMMAND                  CREATED             STATUS                      PORTS               NAMES
25b2c2d3c56e        sonarqube:latest             "./bin/run.sh"           6 weeks ago         Exited (143) 6 weeks ago                        sonarqube
8cec571b5ed5        postgres:latest              "docker-entrypoint.s…"   6 weeks ago         Exited (0) 6 weeks ago                          postgresql
a7bfc4575fd4        nats                         "/nats-server -c nat…"   3 months ago        Exited (2) 12 days ago                          nats
d288fb4423ec        redis:5                      "docker-entrypoint.s…"   3 months ago        Exited (0) 4 weeks ago                          redis
9a0828f184e6        portainer/portainer          "/portainer"             3 months ago        Exited (2) 4 minutes ago                        portainer
b702e84a8ce2        johnnypark/kafka-zookeeper   "supervisord -n"         3 months ago        Exited (0) 3 months ago                         kafka
8d970f3c9c06        mkroli/servicemix            "/opt/servicemix/bin…"   6 months ago        Exited (137) 6 months ago                       servicemix

==> dmesg <==
[Dez27 14:09] Expanded resource Reserved due to conflict with PCI Bus 0000:00
[  +0,243198]  PPR NX GT IA GA PC GA_vAPIC
[  +0,009845] [Firmware Bug]: ACPI MWAIT C-state 0x0 not supported by HW (0x0)
[  +0,000114] [Firmware Bug]: ACPI MWAIT C-state 0x0 not supported by HW (0x0)
[  +0,000064] [Firmware Bug]: ACPI MWAIT C-state 0x0 not supported by HW (0x0)
[  +0,000077] [Firmware Bug]: ACPI MWAIT C-state 0x0 not supported by HW (0x0)
[  +0,000082] [Firmware Bug]: ACPI MWAIT C-state 0x0 not supported by HW (0x0)
[  +0,000107] [Firmware Bug]: ACPI MWAIT C-state 0x0 not supported by HW (0x0)
[  +0,000079] [Firmware Bug]: ACPI MWAIT C-state 0x0 not supported by HW (0x0)
[  +0,000076] [Firmware Bug]: ACPI MWAIT C-state 0x0 not supported by HW (0x0)
[  +0,005771] [Firmware Bug]: ACPI MWAIT C-state 0x0 not supported by HW (0x0)
[  +0,000371] [Firmware Bug]: ACPI MWAIT C-state 0x0 not supported by HW (0x0)
[  +0,000124] [Firmware Bug]: ACPI MWAIT C-state 0x0 not supported by HW (0x0)
[  +0,000126] [Firmware Bug]: ACPI MWAIT C-state 0x0 not supported by HW (0x0)
[  +2,087890] ACPI: Invalid passive threshold
[  +0,000649] hpet_acpi_add: no address or irqs in _CRS
[  +0,212307] nvme nvme0: missing or invalid SUBNQN field.
[  +1,305495] usb: port power management may be unreliable
[  +1,780564] ata3: failed to resume link (SControl 0)
[  +1,033321] ata4: failed to resume link (SControl 0)
[  +1,860006] ata7: failed to resume link (SControl 0)
[  +1,033327] ata8: failed to resume link (SControl 0)
[  +0,841733] systemd-fstab-generator[400]: x-systemd.device-timeout ignored for //router/sda1
[  +0,086076] vboxdrv: loading out-of-tree module taints kernel.
[  +0,026121] VBoxNetAdp: Successfully started.
[  +0,002556] VBoxNetFlt: Successfully started.
[  +0,601330] ACPI Warning: SystemIO range 0x0000000000000B00-0x0000000000000B08 conflicts with OpRegion 0x0000000000000B00-0x0000000000000B0F (\GSA1.SMBI) (20190816/utaddress-204)
[  +0,001854] acpi PNP0C14:01: duplicate WMI GUID 05901221-D566-11D1-B2F0-00A0C9062910 (first instance was on PNP0C14:00)
[  +0,158267] snd_hda_intel 0000:09:00.0: CORB reset timeout#1, CORBRP = 0
[  +0,031529] uvcvideo 3-2:1.0: Entity type for entity Extension 5 was not initialized!
[  +0,000003] uvcvideo 3-2:1.0: Entity type for entity Extension 4 was not initialized!
[  +0,000001] uvcvideo 3-2:1.0: Entity type for entity Processing 3 was not initialized!
[  +0,000002] uvcvideo 3-2:1.0: Entity type for entity Camera 1 was not initialized!
[Dez27 14:10] systemd-fstab-generator[2519]: x-systemd.device-timeout ignored for //router/sda1

==> kernel <==
 14:15:04 up 5 min,  1 user,  load average: 0,74, 0,84, 0,42
Linux myhostname 5.4.6-arch3-1 #1 SMP PREEMPT Tue, 24 Dec 2019 04:36:53 +0000 x86_64 GNU/Linux
PRETTY_NAME="Arch Linux"

==> kubelet <==
-- Logs begin at Sun 2019-04-28 18:40:28 CEST, end at Fri 2019-12-27 14:15:04 CET. --
Dez 27 14:15:01 myhostname kubelet[9153]: Flag --resolv-conf has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:01 myhostname kubelet[9153]: F1227 14:15:01.243315    9153 server.go:198] failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file "/var/lib/kubelet/config.yaml", error: open /var/lib/kubelet/config.yaml: no such file or directory
Dez 27 14:15:01 myhostname systemd[1]: kubelet.service: Main process exited, code=exited, status=255/EXCEPTION
Dez 27 14:15:01 myhostname systemd[1]: kubelet.service: Failed with result 'exit-code'.
Dez 27 14:15:01 myhostname systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 367.
Dez 27 14:15:01 myhostname systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Dez 27 14:15:01 myhostname systemd[1]: Started kubelet: The Kubernetes Node Agent.
Dez 27 14:15:01 myhostname kubelet[9170]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:01 myhostname kubelet[9170]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:01 myhostname kubelet[9170]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:01 myhostname kubelet[9170]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:01 myhostname kubelet[9170]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:01 myhostname kubelet[9170]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:01 myhostname kubelet[9170]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:01 myhostname kubelet[9170]: Flag --resolv-conf has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:01 myhostname kubelet[9170]: F1227 14:15:01.994057    9170 server.go:198] failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file "/var/lib/kubelet/config.yaml", error: open /var/lib/kubelet/config.yaml: no such file or directory
Dez 27 14:15:01 myhostname systemd[1]: kubelet.service: Main process exited, code=exited, status=255/EXCEPTION
Dez 27 14:15:01 myhostname systemd[1]: kubelet.service: Failed with result 'exit-code'.
Dez 27 14:15:02 myhostname systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 368.
Dez 27 14:15:02 myhostname systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Dez 27 14:15:02 myhostname systemd[1]: Started kubelet: The Kubernetes Node Agent.
Dez 27 14:15:02 myhostname kubelet[9191]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:02 myhostname kubelet[9191]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:02 myhostname kubelet[9191]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:02 myhostname kubelet[9191]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:02 myhostname kubelet[9191]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:02 myhostname kubelet[9191]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:02 myhostname kubelet[9191]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:02 myhostname kubelet[9191]: Flag --resolv-conf has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:02 myhostname kubelet[9191]: F1227 14:15:02.742365    9191 server.go:198] failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file "/var/lib/kubelet/config.yaml", error: open /var/lib/kubelet/config.yaml: no such file or directory
Dez 27 14:15:02 myhostname systemd[1]: kubelet.service: Main process exited, code=exited, status=255/EXCEPTION
Dez 27 14:15:02 myhostname systemd[1]: kubelet.service: Failed with result 'exit-code'.
Dez 27 14:15:03 myhostname systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 369.
Dez 27 14:15:03 myhostname systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Dez 27 14:15:03 myhostname systemd[1]: Started kubelet: The Kubernetes Node Agent.
Dez 27 14:15:03 myhostname kubelet[9208]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:03 myhostname kubelet[9208]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:03 myhostname kubelet[9208]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:03 myhostname kubelet[9208]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:03 myhostname kubelet[9208]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:03 myhostname kubelet[9208]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:03 myhostname kubelet[9208]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:03 myhostname kubelet[9208]: Flag --resolv-conf has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:03 myhostname kubelet[9208]: F1227 14:15:03.493545    9208 server.go:198] failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file "/var/lib/kubelet/config.yaml", error: open /var/lib/kubelet/config.yaml: no such file or directory
Dez 27 14:15:03 myhostname systemd[1]: kubelet.service: Main process exited, code=exited, status=255/EXCEPTION
Dez 27 14:15:03 myhostname systemd[1]: kubelet.service: Failed with result 'exit-code'.
Dez 27 14:15:04 myhostname systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 370.
Dez 27 14:15:04 myhostname systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Dez 27 14:15:04 myhostname systemd[1]: Started kubelet: The Kubernetes Node Agent.
Dez 27 14:15:04 myhostname kubelet[9370]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:04 myhostname kubelet[9370]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:04 myhostname kubelet[9370]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:04 myhostname kubelet[9370]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:04 myhostname kubelet[9370]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:04 myhostname kubelet[9370]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:04 myhostname kubelet[9370]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:04 myhostname kubelet[9370]: Flag --resolv-conf has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dez 27 14:15:04 myhostname kubelet[9370]: F1227 14:15:04.168526    9370 server.go:198] failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file "/var/lib/kubelet/config.yaml", error: open /var/lib/kubelet/config.yaml: no such file or directory
Dez 27 14:15:04 myhostname systemd[1]: kubelet.service: Main process exited, code=exited, status=255/EXCEPTION
Dez 27 14:15:04 myhostname systemd[1]: kubelet.service: Failed with result 'exit-code'.

The operating system version:
Arch Linux with kernel 5.4.6
@thorstenhirsch
Copy link
Author

thorstenhirsch commented Dec 27, 2019 •
edited
Loading

All I could find so far is a hint to use --ignore-preflight-errors=all, which is an argument for kubeadm, but I don't know how to tell minikube to use it when calling kubeadm.

edit: ...and kubernetes v1.17.0 is the first version that fails with this error. I just checked v1.16.4 and it works fine.

@afbjorklund
Copy link
Collaborator

Sounds like an upstream (kubeadm) issue, apparently btrfs is not supported

@afbjorklund
Copy link
Collaborator

These are the currently supported Docker configurations: (not sure when it changed)

	RuntimeSpec: RuntimeSpec{
		DockerSpec: &DockerSpec{
			Version:     []string{`1\.1[1-3]\..*`, `17\.0[3,6,9]\..*`, `18\.0[6,9]\..*`, `19\.03\..*`},
			GraphDriver: []string{"aufs", "overlay", "overlay2", "devicemapper", "zfs"},
		},
	},

https://github.com/kubernetes/system-validators/blob/v1.0.4/validators/types_unix.go#L63

@afbjorklund
Copy link
Collaborator

From what I can tell, we only skipped the check for Kubernetes < 1.13 (not 1.16)

@afbjorklund afbjorklund added co/kubeadm Issues relating to kubeadm co/none-driver kind/feature Categorizes issue or PR as related to a new feature. priority/awaiting-more-evidence Lowest priority. Possibly useful, but not yet enough support to actually get it done. labels Dec 27, 2019
@rstacruz
Copy link

I just ran into this issue on Arch Linux with minikube v1.6.2. I can provide details if you like.

@afbjorklund
Copy link
Collaborator

Can you open an issue with upstream, if indeed kubernetes is working fine with the btrfs driver ?

This is really something with kubeadm, and not with minikube (since we are using overlay2 in VM)

If you want to use it anyway, you can use the mentioned ignore-preflight-errors option to kubeadm:

minikube start --extra-config=kubeadm.ignore-preflight-errors=SystemVerification

@afbjorklund afbjorklund added kind/documentation Categorizes issue or PR as related to documentation. priority/backlog Higher priority than priority/awaiting-more-evidence. and removed kind/feature Categorizes issue or PR as related to a new feature. priority/awaiting-more-evidence Lowest priority. Possibly useful, but not yet enough support to actually get it done. labels Jan 12, 2020
@priyawadhwa
Copy link

For this issue, I think the updates to the documentation we need are:

  • For the none driver, supported docker configurations can be found here.
  • The btrfs driver is not officially supported, but if you want to use the btrfs driver anyway, you can pass in the following flag so that kubeadm ignores preflight errors which check for btrfs:
minikube start --extra-config=kubeadm.ignore-preflight-errors=SystemVerification

The documentation should live on this page:
https://github.com/kubernetes/minikube/blob/master/site/content/en/docs/Reference/Drivers/none.md

If anyone is interested in taking this issue, please comment here and I can assign the issue to you. I'm happy to review any PRs.

@priyawadhwa priyawadhwa added good first issue Denotes an issue ready for a new contributor, according to the "help wanted" guidelines. help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. labels Mar 27, 2020
@afbjorklund afbjorklund mentioned this issue May 2, 2020
Closed
@afbjorklund afbjorklund mentioned this issue Jun 23, 2020
Merged
@fejta-bot
Copy link

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

@k8s-ci-robot k8s-ci-robot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Jun 25, 2020
@fejta-bot
Copy link

Stale issues rot after 30d of inactivity.
Mark the issue as fresh with /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle rotten

@k8s-ci-robot k8s-ci-robot added lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. and removed lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. labels Jul 25, 2020
@sharifelgamal
Copy link
Collaborator

This feels like a kubeadm issue, if it indeed isn't and needs work in minikube, please reopen this.

@priyawadhwa priyawadhwa mentioned this issue Feb 25, 2021
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
co/kubeadm Issues relating to kubeadm co/none-driver good first issue Denotes an issue ready for a new contributor, according to the "help wanted" guidelines. help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. kind/documentation Categorizes issue or PR as related to documentation. lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. priority/backlog Higher priority than priority/awaiting-more-evidence.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
7 participants
@rstacruz @thorstenhirsch @afbjorklund @priyawadhwa @k8s-ci-robot @sharifelgamal @fejta-bot