Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unable to start minikube from fresh installation on Ubuntu 18.04 #8209

Closed
grahamsutton opened this issue May 19, 2020 · 13 comments
Closed

Unable to start minikube from fresh installation on Ubuntu 18.04 #8209

grahamsutton opened this issue May 19, 2020 · 13 comments
Labels
co/docker-driver Issues related to kubernetes in container kind/support Categorizes issue or PR as a support question. os/linux triage/needs-information Indicates an issue needs more information in order to work on it.

Comments

@grahamsutton
Copy link

Steps to reproduce the issue:

  1. Go to the minikube start page.
  2. Under "Installation", select "Linux" tab and copy and run the following commands:
$ curl -LO https://storage.googleapis.com/minikube/releases/latest/minikube-linux-amd64
$ sudo install minikube-linux-amd64 /usr/local/bin/minikube
  1. Open a new new terminal and run minikube start

An additional point, I've also tried downloading minikube with .deb and .rpm packages and receive the same result. I am not sure if the problem is new or unique as I cannot find any Google searches really related to it.

Originally, I thought my issue was related to issue #7818 but I am using amd64 architecture:

$ dpkg --print-architecture
amd64

so I ruled that out. Also, the only other mention of a "Template parsing error" that I came across was issue #6923, but I am not a minikube internals expert by any stretch of the imagination, so I am not sure how that one would apply to this scenario if it does.

Full output of failed command:

$ minikube start --alsologtostderr
W0519 10:13:21.122795   24042 root.go:252] Error reading config file at /home/graham/.minikube/config/config.json: open /home/graham/.minikube/config/config.json: no such file or directory
I0519 10:13:21.150868   24042 start.go:99] hostinfo: {"hostname":"graham","uptime":517895,"bootTime":1589379706,"procs":396,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"18.04","kernelVersion":"4.15.0-99-generic","virtualizationSystem":"kvm","virtualizationRole":"host","hostid":"01806365-98fc-4de9-93f9-0975df715952"}
I0519 10:13:21.151468   24042 start.go:109] virtualization: kvm host
😄  minikube v1.10.1 on Ubuntu 18.04
I0519 10:13:21.157001   24042 notify.go:125] Checking for updates...
I0519 10:13:21.157384   24042 driver.go:253] Setting default libvirt URI to qemu:///system
I0519 10:13:21.262764   24042 docker.go:95] docker version: linux-18.09.9
✨  Using the docker driver based on existing profile
I0519 10:13:21.265991   24042 start.go:215] selected driver: docker
I0519 10:13:21.266003   24042 start.go:594] validating driver "docker" against &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 Memory:3900 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.18.2 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.244.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.2 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true]}
I0519 10:13:21.266096   24042 start.go:600] status for docker: {Installed:true Healthy:true Error:<nil> Fix: Doc:}
I0519 10:13:21.266111   24042 start.go:917] auto setting extra-config to "kubeadm.pod-network-cidr=10.244.0.0/16".
👍  Starting control plane node minikube in cluster minikube
I0519 10:13:21.267827   24042 cache.go:104] Beginning downloading kic artifacts for docker with docker
I0519 10:13:21.387070   24042 image.go:88] Found gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 in local docker daemon, skipping pull
I0519 10:13:21.387135   24042 preload.go:81] Checking if preload exists for k8s version v1.18.2 and runtime docker
I0519 10:13:21.387206   24042 preload.go:96] Found local preload: /home/graham/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v3-v1.18.2-docker-overlay2-amd64.tar.lz4
I0519 10:13:21.387226   24042 cache.go:48] Caching tarball of preloaded images
I0519 10:13:21.387265   24042 preload.go:122] Found /home/graham/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v3-v1.18.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0519 10:13:21.387285   24042 cache.go:51] Finished verifying existence of preloaded tar for  v1.18.2 on docker
I0519 10:13:21.387457   24042 profile.go:156] Saving config to /home/graham/.minikube/profiles/minikube/config.json ...
I0519 10:13:21.387795   24042 cache.go:132] Successfully downloaded all kic artifacts
I0519 10:13:21.387843   24042 start.go:223] acquiring machines lock for minikube: {Name:mkaee4a9d4a1870e074d8bd34494e288ea49a92d Clock:{} Delay:500ms Timeout:15m0s Cancel:<nil>}
I0519 10:13:21.388063   24042 start.go:227] acquired machines lock for "minikube" in 169.495µs
I0519 10:13:21.388102   24042 start.go:87] Skipping create...Using existing machine configuration
I0519 10:13:21.388123   24042 fix.go:53] fixHost starting: 
I0519 10:13:21.388629   24042 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0519 10:13:21.510887   24042 fix.go:105] recreateIfNeeded on minikube: state=Stopped err=<nil>
W0519 10:13:21.510933   24042 fix.go:131] unexpected machine state, will restart: <nil>
🔄  Restarting existing docker container for "minikube" ...
I0519 10:13:21.521793   24042 cli_runner.go:108] Run: docker start minikube
I0519 10:13:22.007339   24042 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0519 10:13:22.134698   24042 kic.go:318] container "minikube" state is running.
I0519 10:13:22.135071   24042 machine.go:86] provisioning docker machine ...
I0519 10:13:22.135101   24042 ubuntu.go:166] provisioning hostname "minikube"
I0519 10:13:22.135197   24042 cli_runner.go:108] Run: docker inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0519 10:13:22.471079   24042 machine.go:89] provisioned docker machine in 335.988956ms
I0519 10:13:22.471124   24042 fix.go:55] fixHost completed within 1.083004458s
I0519 10:13:22.471142   24042 start.go:74] releasing machines lock for "minikube", held for 1.08305399s
🤦  StartHost failed, but will try again: provision: get ssh host-port: get port 22 for "minikube": docker inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:


stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil

I0519 10:13:27.471644   24042 start.go:223] acquiring machines lock for minikube: {Name:mkaee4a9d4a1870e074d8bd34494e288ea49a92d Clock:{} Delay:500ms Timeout:15m0s Cancel:<nil>}
I0519 10:13:27.471948   24042 start.go:227] acquired machines lock for "minikube" in 217.696µs
I0519 10:13:27.472025   24042 start.go:87] Skipping create...Using existing machine configuration
I0519 10:13:27.472059   24042 fix.go:53] fixHost starting: 
I0519 10:13:27.473074   24042 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0519 10:13:27.570800   24042 fix.go:105] recreateIfNeeded on minikube: state=Stopped err=<nil>
W0519 10:13:27.570830   24042 fix.go:131] unexpected machine state, will restart: <nil>
🔄  Restarting existing docker container for "minikube" ...
I0519 10:13:27.575757   24042 cli_runner.go:108] Run: docker start minikube
I0519 10:13:28.102962   24042 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0519 10:13:28.210806   24042 kic.go:318] container "minikube" state is running.
I0519 10:13:28.211207   24042 machine.go:86] provisioning docker machine ...
I0519 10:13:28.211277   24042 ubuntu.go:166] provisioning hostname "minikube"
I0519 10:13:28.211380   24042 cli_runner.go:108] Run: docker inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0519 10:13:28.563387   24042 machine.go:89] provisioned docker machine in 352.159044ms
I0519 10:13:28.563439   24042 fix.go:55] fixHost completed within 1.09138776s
I0519 10:13:28.563461   24042 start.go:74] releasing machines lock for "minikube", held for 1.091475385s
😿  Failed to start docker container. "minikube start" may fix it: provision: get ssh host-port: get port 22 for "minikube": docker inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:


stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil

I0519 10:13:28.563768   24042 exit.go:58] WithError(error provisioning host)=Failed to start host: provision: get ssh host-port: get port 22 for "minikube": docker inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:


stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil
 called from:
goroutine 1 [running]:
runtime/debug.Stack(0x40c11a, 0x1879d60, 0x185e940)
	/usr/local/go/src/runtime/debug/stack.go:24 +0x9d
k8s.io/minikube/pkg/minikube/exit.WithError(0x1ae0675, 0x17, 0x1d9bf60, 0xc000564360)
	/app/pkg/minikube/exit/exit.go:58 +0x34
k8s.io/minikube/cmd/minikube/cmd.runStart(0x2ae78c0, 0xc0002f3c00, 0x0, 0x1)
	/app/cmd/minikube/cmd/start.go:170 +0xac2
github.com/spf13/cobra.(*Command).execute(0x2ae78c0, 0xc0002f3bf0, 0x1, 0x1, 0x2ae78c0, 0xc0002f3bf0)
	/go/pkg/mod/github.com/spf13/[email protected]/command.go:846 +0x2aa
github.com/spf13/cobra.(*Command).ExecuteC(0x2ae6900, 0x0, 0x1, 0xc000311260)
	/go/pkg/mod/github.com/spf13/[email protected]/command.go:950 +0x349
github.com/spf13/cobra.(*Command).Execute(...)
	/go/pkg/mod/github.com/spf13/[email protected]/command.go:887
k8s.io/minikube/cmd/minikube/cmd.Execute()
	/app/cmd/minikube/cmd/root.go:112 +0x747
main.main()
	/app/cmd/minikube/main.go:66 +0xea
W0519 10:13:28.564241   24042 out.go:201] error provisioning host: Failed to start host: provision: get ssh host-port: get port 22 for "minikube": docker inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:


stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil

💣  error provisioning host: Failed to start host: provision: get ssh host-port: get port 22 for "minikube": docker inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:


stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil


😿  minikube is exiting due to an error. If the above message is not useful, open an issue:
👉  https://github.com/kubernetes/minikube/issues/new/choose

Full output of minikube start command used, if not already included:
Included above.

Optional: Full output of minikube logs command:

```sh $ minikube logs 🤷 The control plane node must be running for this command 👉 To fix this, run: "minikube start" ```
@afbjorklund
Copy link
Collaborator

afbjorklund commented May 19, 2020 •
edited
Loading

An additional point, I've also tried downloading minikube with .deb and .rpm packages and receive the same result.

It's the (exact) same binary in all three of them, so that is to be expected.

Sorry that you had a bad initial experience with the new "docker" driver.

You might want to try one of the more traditional ones, like "virtualbox" ?

We don't see the full log here, since it was not from the first start attempt.

@afbjorklund afbjorklund added co/docker-driver Issues related to kubernetes in container os/linux kind/support Categorizes issue or PR as a support question. labels May 19, 2020
@grahamsutton
Copy link
Author

grahamsutton commented May 19, 2020 •
edited
Loading

I tried using VirtualBox but it looks like my computer is having isolated issues just trying to install it and get the service running, so it looks like I have to scrap that option for now, allthough that option seems promising once I can get it to work. Ultimately, I would really like to get it working with Docker.

Looks like the "template parser error" issue gets solved though after running a basic update.

$ sudo apt-get update

However, I am presented with a new issue now where it seems to create the docker container and then shuts down and deletes it immediately after. This error seems to be the highlight:

😿  Failed to start docker container. "minikube start" may fix it: creating host: create: creating: prepare kic ssh: copying pub key: docker copy /tmp/tmpf-memory-asset827503185 into minikube:/home/docker/.ssh/authorized_keys, output: lstat /tmp/tmpf-memory-asset827503185: no such file or directory

Looks like minikube is trying to copy a file or directory from my computer into the docker container except it doesn't exist. I figured maybe this file/directory couldn't be created at /tmp because of root privileges, so I tried running minikube with root privileges but the "You should not run minikube with root privileges" message comes up and stops any further execution.

This is the full log when I run minikube start --alsologtostderr:

$ minikube start --alsologtostderr
I0519 14:13:54.433197    8940 start.go:99] hostinfo: {"hostname":"graham","uptime":532328,"bootTime":1589379706,"procs":420,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"18.04","kernelVersion":"4.15.0-99-generic","virtualizationSystem":"kvm","virtualizationRole":"host","hostid":"01806365-98fc-4de9-93f9-0975df715952"}
I0519 14:13:54.434179    8940 start.go:109] virtualization: kvm host
😄  minikube v1.10.1 on Ubuntu 18.04
I0519 14:13:54.436509    8940 driver.go:253] Setting default libvirt URI to qemu:///system
I0519 14:13:54.436542    8940 notify.go:125] Checking for updates...
I0519 14:13:54.436549    8940 global.go:102] Querying for installed drivers using PATH=/home/graham/.minikube/bin:/home/graham/.nvm/versions/node/v10.20.1/bin:/home/graham/.rvm/gems/ruby-2.6.3/bin:/home/graham/.rvm/gems/ruby-2.6.3@global/bin:/usr/share/rvm/rubies/ruby-2.6.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/share/rvm/bin:/usr/local/go/bin
I0519 14:13:54.546651    8940 docker.go:95] docker version: linux-18.09.9
I0519 14:13:54.546677    8940 global.go:110] docker priority: 7, state: {Installed:true Healthy:true Error:<nil> Fix: Doc:}
I0519 14:13:54.546833    8940 global.go:110] kvm2 priority: 7, state: {Installed:false Healthy:false Error:exec: "virsh": executable file not found in $PATH Fix:Install libvirt Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/kvm2/}
I0519 14:13:54.546952    8940 global.go:110] none priority: 3, state: {Installed:true Healthy:false Error:the 'none' driver must be run as the root user Fix:For non-root usage, try the newer 'docker' driver Doc:}
I0519 14:13:54.547002    8940 global.go:110] podman priority: 2, state: {Installed:false Healthy:false Error:exec: "podman": executable file not found in $PATH Fix:Install Podman Doc:https://minikube.sigs.k8s.io/docs/drivers/podman/}
I0519 14:13:54.780984    8940 global.go:110] virtualbox priority: 5, state: {Installed:true Healthy:true Error:<nil> Fix: Doc:}
I0519 14:13:54.781231    8940 global.go:110] vmware priority: 6, state: {Installed:false Healthy:false Error:exec: "docker-machine-driver-vmware": executable file not found in $PATH Fix:Install docker-machine-driver-vmware Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/vmware/}
I0519 14:13:54.781279    8940 driver.go:201] not recommending "none" due to health: the 'none' driver must be run as the root user
I0519 14:13:54.781323    8940 driver.go:235] Picked: docker
I0519 14:13:54.781347    8940 driver.go:236] Alternatives: [virtualbox]
I0519 14:13:54.781370    8940 driver.go:237] Rejects: [kvm2 none podman vmware]
✨  Automatically selected the docker driver
I0519 14:13:54.785179    8940 start.go:215] selected driver: docker
I0519 14:13:54.785196    8940 start.go:594] validating driver "docker" against <nil>
I0519 14:13:54.785210    8940 start.go:600] status for docker: {Installed:true Healthy:true Error:<nil> Fix: Doc:}
I0519 14:13:54.785225    8940 start.go:917] auto setting extra-config to "kubeadm.pod-network-cidr=10.244.0.0/16".
I0519 14:13:54.785274    8940 start_flags.go:217] no existing cluster config was found, will generate one from the flags 
I0519 14:13:54.785454    8940 cli_runner.go:108] Run: docker system info --format "{{json .}}"
I0519 14:13:54.911755    8940 start_flags.go:231] Using suggested 3900MB memory alloc based on sys=15923MB, container=15923MB
I0519 14:13:54.911990    8940 start_flags.go:558] Wait components to verify : map[apiserver:true system_pods:true]
👍  Starting control plane node minikube in cluster minikube
I0519 14:13:54.915472    8940 cache.go:104] Beginning downloading kic artifacts for docker with docker
I0519 14:13:55.030970    8940 image.go:88] Found gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 in local docker daemon, skipping pull
I0519 14:13:55.031012    8940 preload.go:81] Checking if preload exists for k8s version v1.18.2 and runtime docker
I0519 14:13:55.031070    8940 preload.go:96] Found local preload: /home/graham/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v3-v1.18.2-docker-overlay2-amd64.tar.lz4
I0519 14:13:55.031088    8940 cache.go:48] Caching tarball of preloaded images
I0519 14:13:55.031113    8940 preload.go:122] Found /home/graham/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v3-v1.18.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0519 14:13:55.031130    8940 cache.go:51] Finished verifying existence of preloaded tar for  v1.18.2 on docker
I0519 14:13:55.031495    8940 profile.go:156] Saving config to /home/graham/.minikube/profiles/minikube/config.json ...
I0519 14:13:55.031617    8940 lock.go:35] WriteFile acquiring /home/graham/.minikube/profiles/minikube/config.json: {Name:mka5686be0ab5b94a14afa2e8e07ec5b73261332 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0519 14:13:55.031933    8940 cache.go:132] Successfully downloaded all kic artifacts
I0519 14:13:55.031974    8940 start.go:223] acquiring machines lock for minikube: {Name:mkaee4a9d4a1870e074d8bd34494e288ea49a92d Clock:{} Delay:500ms Timeout:15m0s Cancel:<nil>}
I0519 14:13:55.032067    8940 start.go:227] acquired machines lock for "minikube" in 70.217µs
I0519 14:13:55.032110    8940 start.go:83] Provisioning new machine with config: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 Memory:3900 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.18.2 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.244.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.2 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true]} {Name: IP: Port:8443 KubernetesVersion:v1.18.2 ControlPlane:true Worker:true}
I0519 14:13:55.032201    8940 start.go:104] createHost starting for "" (driver="docker")
🔥  Creating docker container (CPUs=2, Memory=3900MB) ...
I0519 14:13:55.035979    8940 start.go:140] libmachine.API.Create for "minikube" (driver="docker")
I0519 14:13:55.036018    8940 client.go:161] LocalClient.Create starting
I0519 14:13:55.036071    8940 main.go:110] libmachine: Reading certificate data from /home/graham/.minikube/certs/ca.pem
I0519 14:13:55.036121    8940 main.go:110] libmachine: Decoding PEM data...
I0519 14:13:55.036152    8940 main.go:110] libmachine: Parsing certificate...
I0519 14:13:55.036293    8940 main.go:110] libmachine: Reading certificate data from /home/graham/.minikube/certs/cert.pem
I0519 14:13:55.036331    8940 main.go:110] libmachine: Decoding PEM data...
I0519 14:13:55.036361    8940 main.go:110] libmachine: Parsing certificate...
I0519 14:13:55.036778    8940 cli_runner.go:108] Run: docker ps -a --format {{.Names}}
I0519 14:13:55.143301    8940 cli_runner.go:108] Run: docker volume create minikube --label name.minikube.sigs.k8s.io=minikube --label created_by.minikube.sigs.k8s.io=true
I0519 14:13:55.251210    8940 oci.go:98] Successfully created a docker volume minikube
W0519 14:13:55.251313    8940 oci.go:158] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0519 14:13:55.251381    8940 preload.go:81] Checking if preload exists for k8s version v1.18.2 and runtime docker
I0519 14:13:55.251799    8940 cli_runner.go:108] Run: docker info --format "'{{json .SecurityOptions}}'"
I0519 14:13:55.251845    8940 preload.go:96] Found local preload: /home/graham/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v3-v1.18.2-docker-overlay2-amd64.tar.lz4
I0519 14:13:55.251873    8940 kic.go:134] Starting extracting preloaded images to volume ...
I0519 14:13:55.252019    8940 cli_runner.go:108] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/graham/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v3-v1.18.2-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v minikube:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 -I lz4 -xvf /preloaded.tar -C /extractDir
I0519 14:13:55.371192    8940 cli_runner.go:108] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --security-opt apparmor=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname minikube --name minikube --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=minikube --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=minikube --volume minikube:/var --cpus=2 --memory=3900mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438
I0519 14:13:56.078872    8940 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Running}}
I0519 14:13:56.210785    8940 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0519 14:13:56.354436    8940 oci.go:212] the created container "minikube" has a running status.
I0519 14:13:56.354480    8940 kic.go:162] Creating ssh key for kic: /home/graham/.minikube/machines/minikube/id_rsa...
I0519 14:13:56.935867    8940 kic_runner.go:179] docker (temp): /home/graham/.minikube/machines/minikube/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0519 14:13:57.283022    8940 client.go:164] LocalClient.Create took 2.246977984s
I0519 14:13:59.302389    8940 start.go:107] duration metric: createHost completed in 4.270165964s
I0519 14:13:59.302428    8940 start.go:74] releasing machines lock for "minikube", held for 4.270338743s
I0519 14:13:59.303251    8940 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0519 14:13:59.555015    8940 stop.go:36] StopHost: minikube
✋  Stopping "minikube" in docker ...
I0519 14:14:00.015355    8940 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
🛑  Powering off "minikube" via SSH ...
I0519 14:14:00.160895    8940 cli_runner.go:108] Run: docker exec --privileged -t minikube /bin/bash -c "sudo init 0"
I0519 14:14:01.479106    8940 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0519 14:14:01.898722    8940 oci.go:552] container minikube status is Stopped
I0519 14:14:01.898757    8940 oci.go:564] Successfully shutdown container minikube
I0519 14:14:01.898769    8940 stop.go:84] shutdown container: err=<nil>
I0519 14:14:01.898806    8940 main.go:110] libmachine: Stopping "minikube"...
I0519 14:14:01.898932    8940 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0519 14:14:02.018821    8940 stop.go:56] stop err: Machine "minikube" is already stopped.
I0519 14:14:02.018861    8940 stop.go:59] host is already stopped
I0519 14:14:02.962947    8940 cli_runner.go:150] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/graham/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v3-v1.18.2-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v minikube:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 -I lz4 -xvf /preloaded.tar -C /extractDir: (7.710850996s)
I0519 14:14:02.962993    8940 kic.go:139] duration metric: took 7.711120 seconds to extract preloaded images to volume
🔥  Deleting "minikube" in docker ...
I0519 14:14:03.024675    8940 cli_runner.go:108] Run: docker inspect -f {{.Id}} minikube
I0519 14:14:03.131112    8940 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0519 14:14:03.226989    8940 cli_runner.go:108] Run: docker exec --privileged -t minikube /bin/bash -c "sudo init 0"
I0519 14:14:03.339249    8940 oci.go:544] error shutdown minikube: docker exec --privileged -t minikube /bin/bash -c "sudo init 0": exit status 1
stdout:

stderr:
Error response from daemon: Container e1e4c0a57a609f824d76eae5d27e5f700f8194b7fef03cf92e9af6e7a3e40193 is not running
I0519 14:14:04.339778    8940 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0519 14:14:04.446856    8940 oci.go:552] container minikube status is Stopped
I0519 14:14:04.446888    8940 oci.go:564] Successfully shutdown container minikube
I0519 14:14:04.446979    8940 cli_runner.go:108] Run: docker rm -f -v minikube
I0519 14:14:04.575212    8940 cli_runner.go:108] Run: docker inspect -f {{.Id}} minikube
🤦  StartHost failed, but will try again: creating host: create: creating: prepare kic ssh: copying pub key: docker copy /tmp/tmpf-memory-asset454592858 into minikube:/home/docker/.ssh/authorized_keys, output: lstat /tmp/tmpf-memory-asset454592858: no such file or directory
: exit status 1
I0519 14:14:09.692058    8940 start.go:223] acquiring machines lock for minikube: {Name:mkaee4a9d4a1870e074d8bd34494e288ea49a92d Clock:{} Delay:500ms Timeout:15m0s Cancel:<nil>}
I0519 14:14:09.692375    8940 start.go:227] acquired machines lock for "minikube" in 223.109µs
I0519 14:14:09.692450    8940 start.go:83] Provisioning new machine with config: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 Memory:3900 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.18.2 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.244.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.2 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true]} {Name: IP: Port:8443 KubernetesVersion:v1.18.2 ControlPlane:true Worker:true}
I0519 14:14:09.692615    8940 start.go:104] createHost starting for "" (driver="docker")
🔥  Creating docker container (CPUs=2, Memory=3900MB) ...
I0519 14:14:09.695217    8940 start.go:140] libmachine.API.Create for "minikube" (driver="docker")
I0519 14:14:09.695330    8940 client.go:161] LocalClient.Create starting
I0519 14:14:09.695471    8940 main.go:110] libmachine: Reading certificate data from /home/graham/.minikube/certs/ca.pem
I0519 14:14:09.695596    8940 main.go:110] libmachine: Decoding PEM data...
I0519 14:14:09.695662    8940 main.go:110] libmachine: Parsing certificate...
I0519 14:14:09.696041    8940 main.go:110] libmachine: Reading certificate data from /home/graham/.minikube/certs/cert.pem
I0519 14:14:09.696134    8940 main.go:110] libmachine: Decoding PEM data...
I0519 14:14:09.696189    8940 main.go:110] libmachine: Parsing certificate...
I0519 14:14:09.697050    8940 cli_runner.go:108] Run: docker ps -a --format {{.Names}}
I0519 14:14:09.796772    8940 cli_runner.go:108] Run: docker volume create minikube --label name.minikube.sigs.k8s.io=minikube --label created_by.minikube.sigs.k8s.io=true
I0519 14:14:09.906918    8940 oci.go:98] Successfully created a docker volume minikube
W0519 14:14:09.907002    8940 oci.go:158] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0519 14:14:09.907069    8940 preload.go:81] Checking if preload exists for k8s version v1.18.2 and runtime docker
I0519 14:14:09.907175    8940 preload.go:96] Found local preload: /home/graham/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v3-v1.18.2-docker-overlay2-amd64.tar.lz4
I0519 14:14:09.907195    8940 cli_runner.go:108] Run: docker info --format "'{{json .SecurityOptions}}'"
I0519 14:14:09.907202    8940 kic.go:134] Starting extracting preloaded images to volume ...
I0519 14:14:09.907357    8940 cli_runner.go:108] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/graham/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v3-v1.18.2-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v minikube:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 -I lz4 -xvf /preloaded.tar -C /extractDir
I0519 14:14:10.059084    8940 cli_runner.go:108] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --security-opt apparmor=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname minikube --name minikube --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=minikube --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=minikube --volume minikube:/var --cpus=2 --memory=3900mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438
I0519 14:14:10.805017    8940 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Running}}
I0519 14:14:10.933776    8940 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0519 14:14:11.062819    8940 oci.go:212] the created container "minikube" has a running status.
I0519 14:14:11.062859    8940 kic.go:162] Creating ssh key for kic: /home/graham/.minikube/machines/minikube/id_rsa...
I0519 14:14:11.314483    8940 kic_runner.go:179] docker (temp): /home/graham/.minikube/machines/minikube/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0519 14:14:11.654906    8940 client.go:164] LocalClient.Create took 1.959532735s
I0519 14:14:13.655092    8940 start.go:107] duration metric: createHost completed in 3.962434505s
I0519 14:14:13.655138    8940 start.go:74] releasing machines lock for "minikube", held for 3.962720948s
😿  Failed to start docker container. "minikube start" may fix it: creating host: create: creating: prepare kic ssh: copying pub key: docker copy /tmp/tmpf-memory-asset442591985 into minikube:/home/docker/.ssh/authorized_keys, output: lstat /tmp/tmpf-memory-asset442591985: no such file or directory
: exit status 1
❗  Startup with docker driver failed, trying with alternate driver virtualbox: Failed to start host: creating host: create: creating: prepare kic ssh: copying pub key: docker copy /tmp/tmpf-memory-asset442591985 into minikube:/home/docker/.ssh/authorized_keys, output: lstat /tmp/tmpf-memory-asset442591985: no such file or directory
: exit status 1
I0519 14:14:13.655720    8940 delete.go:266] Deleting minikube
I0519 14:14:13.655742    8940 delete.go:269] minikube configuration: &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 Memory:3900 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.18.2 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.244.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.2 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true]}
🔥  Deleting "minikube" in docker ...
I0519 14:14:13.928037    8940 delete.go:234] deleting possible KIC leftovers for minikube (driver=docker) ...
I0519 14:14:13.928133    8940 cli_runner.go:108] Run: docker ps -a --filter label=name.minikube.sigs.k8s.io=minikube --format {{.Names}}
🔥  Deleting container "minikube" ...
I0519 14:14:14.803607    8940 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0519 14:14:14.966892    8940 cli_runner.go:108] Run: docker exec --privileged -t minikube /bin/bash -c "sudo init 0"
I0519 14:14:16.343211    8940 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0519 14:14:16.726788    8940 oci.go:552] container minikube status is Stopped
I0519 14:14:16.726816    8940 oci.go:564] Successfully shutdown container minikube
I0519 14:14:16.726900    8940 cli_runner.go:108] Run: docker rm -f -v minikube
I0519 14:14:16.898842    8940 volumes.go:35] trying to delete all docker volumes with label name.minikube.sigs.k8s.io=minikube
I0519 14:14:16.898982    8940 cli_runner.go:108] Run: docker volume ls --filter label=name.minikube.sigs.k8s.io=minikube --format {{.Name}}
I0519 14:14:17.006892    8940 cli_runner.go:108] Run: docker volume rm --force minikube
W0519 14:14:17.130717    8940 delete.go:251] error deleting volumes (might be okay).
To see the list of volumes run: 'docker volume ls'
:[deleting "minikube"]
I0519 14:14:17.130744    8940 volumes.go:57] trying to prune all docker volumes with label name.minikube.sigs.k8s.io=minikube
I0519 14:14:17.130836    8940 cli_runner.go:108] Run: docker volume prune -f --filter label=name.minikube.sigs.k8s.io=minikube
I0519 14:14:17.658948    8940 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0519 14:14:17.690819    8940 cli_runner.go:150] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/graham/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v3-v1.18.2-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v minikube:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 -I lz4 -xvf /preloaded.tar -C /extractDir: (7.78340384s)
I0519 14:14:17.690857    8940 kic.go:139] duration metric: took 7.783654 seconds to extract preloaded images to volume
I0519 14:14:17.779105    8940 delete.go:81] Unable to get host status for minikube, assuming it has already been deleted: state: unknown state "minikube": docker inspect minikube --format={{.State.Status}}: exit status 1
stdout:


stderr:
Template parsing error: template: :1:8: executing "" at <.State.Status>: map has no entry for key "State"
🔥  Removing /home/graham/.minikube/machines/minikube ...
💀  Removed all traces of the "minikube" cluster.
I0519 14:14:17.784195    8940 start.go:215] selected driver: virtualbox
I0519 14:14:17.784219    8940 start.go:594] validating driver "virtualbox" against <nil>
I0519 14:14:17.784236    8940 start.go:600] status for virtualbox: {Installed:true Healthy:true Error:<nil> Fix: Doc:}
I0519 14:14:17.784303    8940 start_flags.go:217] no existing cluster config was found, will generate one from the flags 
I0519 14:14:17.784431    8940 start_flags.go:231] Using suggested 3900MB memory alloc based on sys=15923MB, container=0MB
I0519 14:14:17.784557    8940 start_flags.go:558] Wait components to verify : map[apiserver:true system_pods:true]
I0519 14:14:17.784615    8940 iso.go:118] acquiring lock: {Name:mk3904fe7c84d08ba5abb4ab4210269bbe17fae7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
👍  Starting control plane node minikube in cluster minikube
I0519 14:14:17.786784    8940 preload.go:81] Checking if preload exists for k8s version v1.18.2 and runtime docker
I0519 14:14:17.786835    8940 preload.go:96] Found local preload: /home/graham/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v3-v1.18.2-docker-overlay2-amd64.tar.lz4
I0519 14:14:17.786856    8940 cache.go:48] Caching tarball of preloaded images
I0519 14:14:17.786883    8940 preload.go:122] Found /home/graham/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v3-v1.18.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0519 14:14:17.786896    8940 cache.go:51] Finished verifying existence of preloaded tar for  v1.18.2 on docker
I0519 14:14:17.786992    8940 profile.go:156] Saving config to /home/graham/.minikube/profiles/minikube/config.json ...
I0519 14:14:17.787081    8940 lock.go:35] WriteFile acquiring /home/graham/.minikube/profiles/minikube/config.json: {Name:mka5686be0ab5b94a14afa2e8e07ec5b73261332 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0519 14:14:17.787219    8940 cache.go:132] Successfully downloaded all kic artifacts
I0519 14:14:17.787246    8940 start.go:223] acquiring machines lock for minikube: {Name:mkaee4a9d4a1870e074d8bd34494e288ea49a92d Clock:{} Delay:500ms Timeout:15m0s Cancel:<nil>}
I0519 14:14:17.787313    8940 start.go:227] acquired machines lock for "minikube" in 49.425µs
I0519 14:14:17.787334    8940 start.go:83] Provisioning new machine with config: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.10.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 Memory:3900 CPUs:2 DiskSize:20000 Driver:virtualbox HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.18.2 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.244.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.2 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true]} {Name: IP: Port:8443 KubernetesVersion:v1.18.2 ControlPlane:true Worker:true}
I0519 14:14:17.787394    8940 start.go:104] createHost starting for "" (driver="virtualbox")
🔥  Creating virtualbox VM (CPUs=2, Memory=3900MB, Disk=20000MB) ...
I0519 14:14:17.789579    8940 start.go:140] libmachine.API.Create for "minikube" (driver="virtualbox")
I0519 14:14:17.789620    8940 client.go:161] LocalClient.Create starting
I0519 14:14:17.789661    8940 main.go:110] libmachine: Reading certificate data from /home/graham/.minikube/certs/ca.pem
I0519 14:14:17.789707    8940 main.go:110] libmachine: Decoding PEM data...
I0519 14:14:17.789737    8940 main.go:110] libmachine: Parsing certificate...
I0519 14:14:17.789918    8940 main.go:110] libmachine: Reading certificate data from /home/graham/.minikube/certs/cert.pem
I0519 14:14:17.789954    8940 main.go:110] libmachine: Decoding PEM data...
I0519 14:14:17.789980    8940 main.go:110] libmachine: Parsing certificate...
I0519 14:14:17.790078    8940 main.go:110] libmachine: COMMAND: /usr/bin/VBoxManage --version
W0519 14:14:17.836527    8940 main.go:108] libmachine: STDOUT:
{
WARNING: The character device /dev/vboxdrv does not exist.
	 Please install the virtualbox-dkms package and the appropriate
	 headers, most likely linux-headers-generic.

	 You will not be able to start VMs until this problem is fixed.
5.2.34_Ubuntur133883
}
I0519 14:14:17.836567    8940 main.go:110] libmachine: STDERR:
{
}
I0519 14:14:17.836618    8940 client.go:164] LocalClient.Create took 46.986588ms
I0519 14:14:19.836895    8940 start.go:107] duration metric: createHost completed in 2.049480991s
I0519 14:14:19.836945    8940 start.go:74] releasing machines lock for "minikube", held for 2.049615847s
I0519 14:14:19.837141    8940 cli_runner.go:108] Run: docker inspect minikube --format={{.State.Status}}
I0519 14:14:19.947098    8940 delete.go:45] couldn't inspect container "minikube" before deleting: unknown state "minikube": docker inspect minikube --format={{.State.Status}}: exit status 1
stdout:


stderr:
Template parsing error: template: :1:8: executing "" at <.State.Status>: map has no entry for key "State"
I0519 14:14:19.947450    8940 cli_runner.go:108] Run: sudo -n podman inspect minikube --format={{.State.Status}}
I0519 14:14:19.958526    8940 delete.go:45] couldn't inspect container "minikube" before deleting: unknown state "minikube": sudo -n podman inspect minikube --format={{.State.Status}}: exit status 1
stdout:

stderr:
sudo: a password is required
W0519 14:14:19.958583    8940 start.go:369] delete host: Docker machine "minikube" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
🤦  StartHost failed, but will try again: creating host: create: precreate: We support Virtualbox starting with version 5. Your VirtualBox install is "WARNING: The character device /dev/vboxdrv does not exist.\n\t Please install the virtualbox-dkms package and the appropriate\n\t headers, most likely linux-headers-generic.\n\n\t You will not be able to start VMs until this problem is fixed.\n5.2.34_Ubuntur133883". Please upgrade at https://www.virtualbox.org
I0519 14:14:24.958920    8940 start.go:223] acquiring machines lock for minikube: {Name:mkaee4a9d4a1870e074d8bd34494e288ea49a92d Clock:{} Delay:500ms Timeout:15m0s Cancel:<nil>}
I0519 14:14:24.959153    8940 start.go:227] acquired machines lock for "minikube" in 160.863µs
I0519 14:14:24.959214    8940 start.go:83] Provisioning new machine with config: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.10.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 Memory:3900 CPUs:2 DiskSize:20000 Driver:virtualbox HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.18.2 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.244.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.2 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true]} {Name: IP: Port:8443 KubernetesVersion:v1.18.2 ControlPlane:true Worker:true}
I0519 14:14:24.959336    8940 start.go:104] createHost starting for "" (driver="virtualbox")
🔥  Creating virtualbox VM (CPUs=2, Memory=3900MB, Disk=20000MB) ...
I0519 14:14:24.961755    8940 start.go:140] libmachine.API.Create for "minikube" (driver="virtualbox")
I0519 14:14:24.961843    8940 client.go:161] LocalClient.Create starting
I0519 14:14:24.961940    8940 main.go:110] libmachine: Reading certificate data from /home/graham/.minikube/certs/ca.pem
I0519 14:14:24.962041    8940 main.go:110] libmachine: Decoding PEM data...
I0519 14:14:24.962101    8940 main.go:110] libmachine: Parsing certificate...
I0519 14:14:24.962800    8940 main.go:110] libmachine: Reading certificate data from /home/graham/.minikube/certs/cert.pem
I0519 14:14:24.962901    8940 main.go:110] libmachine: Decoding PEM data...
I0519 14:14:24.962975    8940 main.go:110] libmachine: Parsing certificate...
I0519 14:14:24.963200    8940 main.go:110] libmachine: COMMAND: /usr/bin/VBoxManage --version
W0519 14:14:24.998155    8940 main.go:108] libmachine: STDOUT:
{
WARNING: The character device /dev/vboxdrv does not exist.
	 Please install the virtualbox-dkms package and the appropriate
	 headers, most likely linux-headers-generic.

	 You will not be able to start VMs until this problem is fixed.
5.2.34_Ubuntur133883
}
I0519 14:14:24.998188    8940 main.go:110] libmachine: STDERR:
{
}
I0519 14:14:24.998241    8940 client.go:164] LocalClient.Create took 36.376436ms
I0519 14:14:26.998603    8940 start.go:107] duration metric: createHost completed in 2.039233802s
I0519 14:14:26.998686    8940 start.go:74] releasing machines lock for "minikube", held for 2.039493254s
😿  Failed to start virtualbox VM. "minikube start" may fix it: creating host: create: precreate: We support Virtualbox starting with version 5. Your VirtualBox install is "WARNING: The character device /dev/vboxdrv does not exist.\n\t Please install the virtualbox-dkms package and the appropriate\n\t headers, most likely linux-headers-generic.\n\n\t You will not be able to start VMs until this problem is fixed.\n5.2.34_Ubuntur133883". Please upgrade at https://www.virtualbox.org
I0519 14:14:26.999114    8940 exit.go:58] WithError(error provisioning host)=Failed to start host: creating host: create: creating: prepare kic ssh: copying pub key: docker copy /tmp/tmpf-memory-asset442591985 into minikube:/home/docker/.ssh/authorized_keys, output: lstat /tmp/tmpf-memory-asset442591985: no such file or directory
: exit status 1 called from:
goroutine 1 [running]:
runtime/debug.Stack(0x0, 0x0, 0x0)
	/usr/local/go/src/runtime/debug/stack.go:24 +0x9d
k8s.io/minikube/pkg/minikube/exit.WithError(0x1ae0675, 0x17, 0x1d9bf60, 0xc000138500)
	/app/pkg/minikube/exit/exit.go:58 +0x34
k8s.io/minikube/cmd/minikube/cmd.runStart(0x2ae78c0, 0xc0002e16a0, 0x0, 0x1)
	/app/cmd/minikube/cmd/start.go:197 +0x837
github.com/spf13/cobra.(*Command).execute(0x2ae78c0, 0xc0002e1690, 0x1, 0x1, 0x2ae78c0, 0xc0002e1690)
	/go/pkg/mod/github.com/spf13/[email protected]/command.go:846 +0x2aa
github.com/spf13/cobra.(*Command).ExecuteC(0x2ae6900, 0x0, 0x1, 0xc000455bc0)
	/go/pkg/mod/github.com/spf13/[email protected]/command.go:950 +0x349
github.com/spf13/cobra.(*Command).Execute(...)
	/go/pkg/mod/github.com/spf13/[email protected]/command.go:887
k8s.io/minikube/cmd/minikube/cmd.Execute()
	/app/cmd/minikube/cmd/root.go:112 +0x747
main.main()
	/app/cmd/minikube/main.go:66 +0xea
W0519 14:14:26.999975    8940 out.go:201] error provisioning host: Failed to start host: creating host: create: creating: prepare kic ssh: copying pub key: docker copy /tmp/tmpf-memory-asset442591985 into minikube:/home/docker/.ssh/authorized_keys, output: lstat /tmp/tmpf-memory-asset442591985: no such file or directory
: exit status 1

💣  error provisioning host: Failed to start host: creating host: create: creating: prepare kic ssh: copying pub key: docker copy /tmp/tmpf-memory-asset442591985 into minikube:/home/docker/.ssh/authorized_keys, output: lstat /tmp/tmpf-memory-asset442591985: no such file or directory
: exit status 1

😿  minikube is exiting due to an error. If the above message is not useful, open an issue:
👉  https://github.com/kubernetes/minikube/issues/new/choose

Not sure if you want to close this ticket and open a new one or maybe this issue has a workaround.

@afbjorklund
Copy link
Collaborator

I tried using VirtualBox but it looks like my computer is having isolated issues just trying to install it and get the service running, so it looks like I have to scrap that option for now, allthough that option seems promising once I can get it to work.

VirtualBox 6.0 should work with Ubuntu 18.04, since it's what they use in the intro course:

https://www.edx.org/course/introduction-to-kubernetes

Ultimately, I would really like to get it working with Docker.

Ok, yeah that is supposed to be working. The logs look like a bit of a "mix" at the moment...

If you want to start over, you need to run minikube delete on the existing profile/machine.

This warning is normal (on debian/ubuntu, it requires some extra kernel config after boot):
Your kernel does not support swap limit capabilities or the cgroup is not mounted.

I agree that it seems like the copy is the failure, the retry seems to be broken at the moment.

I0519 14:13:56.935867 8940 kic_runner.go:179] docker (temp): /home/graham/.minikube/machines/minikube/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)

There is some error when it tries to recreate the machine but not the volume, like in #8192

So there is not enough clues about why the first attempt failed, and the second is broken.

@afbjorklund
Copy link
Collaborator

All that is supposed to happen in that copy routine is to create a tempfile and run docker cp

       glog.Infof("%s (temp): %s --> %s (%d bytes)", k.ociBin, src, dst, f.GetLength())
        tf, err := ioutil.TempFile("", "tmpf-memory-asset")
        if err != nil {
                return errors.Wrap(err, "creating temporary file")
        }
        defer os.Remove(tf.Name())

        if err := writeFile(tf.Name(), f, os.FileMode(perms)); err != nil {
                return errors.Wrap(err, "write")
        }
        return k.copy(tf.Name(), dst)

There is no minikube reason, to why the /tmp file should be missing between those two calls...

lstat /tmp/tmpf-memory-asset442591985: no such file or directory

https://golang.org/pkg/io/ioutil/#example_TempFile

It is the caller's responsibility to remove the file when no longer needed.

Is there some other system program installed that deletes random files in /tmp or something ?

@afbjorklund afbjorklund mentioned this issue May 20, 2020
Closed
@priyawadhwa
Copy link

Hey @grahamsutton thanks for all the info you provided. Are you still seeing this issue with minikube v1.12.0?

The error with the docker driver (the port 22 error) should be fixed in the upcoming release (v1.13.0) but it could be worth trying it again with v1.12.0 as well.

@priyawadhwa priyawadhwa added the triage/needs-information Indicates an issue needs more information in order to work on it. label Jul 29, 2020
@grahamsutton
Copy link
Author

Hey @priyawadhwa. I haven't tried recently, but I will update minikube and give it a shot tonight and let you know if it's working. I tried taking a stab at fixing the issue myself when I first encountered the problem but my Golang skills are amateurish at best.

@vteran93
Copy link

Hi Guys, I just tried to start with the docker driver and I'm getting this error:

 minikube start --driver=docker
😄  minikube v1.12.1 on Ubuntu 18.04
✨  Using the docker driver based on existing profile
👍  Starting control plane node minikube in cluster minikube
🔄  Restarting existing docker container for "minikube" ...
🤦  StartHost failed, but will try again: provision: Error getting config for native Go SSH: open /home/victor.teran/.minikube/machines/minikube/id_rsa: no such file or directory
🔄  Restarting existing docker container for "minikube" ...
😿  Failed to start docker container. "minikube start" may fix it: provision: Error getting config for native Go SSH: open /home/victor.teran/.minikube/machines/minikube/id_rsa: no such file or directory

💣  error provisioning host: Failed to start host: provision: Error getting config for native Go SSH: open /home/victor.teran/.minikube/machines/minikube/id_rsa: no such file or directory

😿  minikube is exiting due to an error. If the above message

@adr-arroyo
Copy link

Hello, I am having the same issue so I am posting to help on the resolution.

My last logs:

 Failed to start docker container. "minikube start" may fix it: creating host: create host timed out in 240.000000 seconds
I0730 13:11:48.566353   25116 exit.go:58] WithError(error provisioning host)=Failed to start host: creating host: create host timed out in 240.000000 seconds called from:
goroutine 1 [running]:
runtime/debug.Stack(0x1eb8320, 0xc0007142a0, 0x1eb6e80)
        /usr/local/go/src/runtime/debug/stack.go:24 +0x9d
k8s.io/minikube/pkg/minikube/exit.WithError(0x1ba8136, 0x17, 0x1eb8320, 0xc0007142a0)
        /app/pkg/minikube/exit/exit.go:58 +0x34
k8s.io/minikube/cmd/minikube/cmd.runStart(0x2cb86a0, 0xc000936f90, 0x0, 0x3)
        /app/cmd/minikube/cmd/start.go:171 +0xbe7
github.com/spf13/cobra.(*Command).execute(0x2cb86a0, 0xc000936f60, 0x3, 0x3, 0x2cb86a0, 0xc000936f60)
        /go/pkg/mod/github.com/spf13/[email protected]/command.go:846 +0x29d
github.com/spf13/cobra.(*Command).ExecuteC(0x2cb76e0, 0x0, 0x1, 0xc000045b90)
        /go/pkg/mod/github.com/spf13/[email protected]/command.go:950 +0x349
github.com/spf13/cobra.(*Command).Execute(...)
        /go/pkg/mod/github.com/spf13/[email protected]/command.go:887
k8s.io/minikube/cmd/minikube/cmd.Execute()
        /app/cmd/minikube/cmd/root.go:106 +0x72c
main.main()
        /app/cmd/minikube/main.go:71 +0x11f

❌  [CREATE_TIMEOUT] error provisioning host Failed to start host: creating host: create host timed out in 240.000000 seconds
💡  Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software
⁉️   Related issue: https://github.com/kubernetes/minikube/issues/7072

@vijesh12
Copy link

Been facing similar issue
`😄 minikube v1.12.3 on Debian buster/sid
✨ Using the docker driver based on user configuration
👍 Starting control plane node minikube in cluster minikube
🚜 Pulling base image ...
💾 Downloading Kubernetes v1.18.3 preload ...
> preloaded-images-k8s-v5-v1.18.3-docker-overlay2-amd64.tar.lz4: 510.91 MiB
🔥 Creating docker container (CPUs=2, Memory=2200MB) ...
✋ Stopping node "minikube" ...
🛑 Powering off "minikube" via SSH ...
🔥 Deleting "minikube" in docker ...
🤦 StartHost failed, but will try again: creating host: create: creating: prepare kic ssh: copying pub key: docker copy /tmp/tmpf-memory-asset282144239 into minikube:/home/docker/.ssh/authorized_keys, output: lstat /tmp/tmpf-memory-asset282144239: no such file or directory
: exit status 1
🔥 Creating docker container (CPUs=2, Memory=2200MB) ...
😿 Failed to start docker container. "minikube start" may fix it: creating host: create: creating: prepare kic ssh: copying pub key: docker copy /tmp/tmpf-memory-asset954344578 into minikube:/home/docker/.ssh/authorized_keys, output: lstat /tmp/tmpf-memory-asset954344578: no such file or directory
: exit status 1

💣 error provisioning host: Failed to start host: creating host: create: creating: prepare kic ssh: copying pub key: docker copy /tmp/tmpf-memory-asset954344578 into minikube:/home/docker/.ssh/authorized_keys, output: lstat /tmp/tmpf-memory-asset954344578: no such file or directory
: exit status 1

😿 minikube is exiting due to an error. If the above message is not useful, open an issue:
👉 https://github.com/kubernetes/minikube/issues/new/choose
`

@christian-oudard
Copy link

christian-oudard commented Sep 2, 2020 •
edited
Loading

@vijesh12 I am having the same issue exactly on Ubuntu 20.04.

When I run minikube --start --driver=docker --alsologtostderr, I get the same error message with "no such file or directory".

Edit: I was able to fix this by changing to .deb docker instead of snap docker.

Per https://kubernetes.io/docs/tasks/tools/install-minikube/:
"If you're using the none driver in Debian or a derivative, use the .deb packages for Docker rather than the snap package, which does not work with Minikube. You can download .deb packages from Docker."

I did $ snap remove docker, then followed these instructions:
https://docs.docker.com/engine/install/ubuntu/#install-using-the-repository

Maybe the error messages could be amended to tell this to the user?

@medyagh
Copy link
Member

medyagh commented Sep 16, 2020

@grahamsutton do you still have this issue with the latest version of minikube and docker driver?

@grahamsutton
Copy link
Author

@medyagh Minikube is working great now. Upgrading to v1.12.3 fixed the issue for me. Thank you for the support and for following-up with me.

@aditya5573
Copy link

Hi Guys, I just tried to start and I'm getting this error:
Command 'minikube' not found, did you mean:

command 'minitube' from deb minitube (3.1-1build1)

Try: sudo apt install

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
co/docker-driver Issues related to kubernetes in container kind/support Categorizes issue or PR as a support question. os/linux triage/needs-information Indicates an issue needs more information in order to work on it.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
10 participants
@tstromberg @christian-oudard @vteran93 @medyagh @grahamsutton @afbjorklund @priyawadhwa @adr-arroyo @vijesh12 @aditya5573