restart: waiting for k8s-app=kube-proxy: timed out waiting for the condition #3843

serverok · 2019-03-10T18:48:07Z

When i minikube start, i get error

boby@sok-01:~$ minikube start
😄  minikube v0.35.0 on linux (amd64)
💡  Tip: Use 'minikube start -p <name>' to create a new cluster, or 'minikube delete' to delete this one.
🔄  Restarting existing virtualbox VM for "minikube" ...
⌛  Waiting for SSH access ...
📶  "minikube" IP address is 192.168.99.100
🐳  Configuring Docker as the container runtime ...
✨  Preparing Kubernetes environment ...
🚜  Pulling images required by Kubernetes v1.13.4 ...
🔄  Relaunching Kubernetes v1.13.4 using kubeadm ... 
⌛  Waiting for pods: apiserver proxy💣  Error restarting cluster: wait: waiting for k8s-app=kube-proxy: timed out waiting for the condition

😿  Sorry that minikube crashed. If this was unexpected, we would love to hear from you:
👉  https://github.com/kubernetes/minikube/issues/new
boby@sok-01:~$

I am using Ubuntu 18.04

Attached minikube logs

minikube-logs.txt

The text was updated successfully, but these errors were encountered:

staticdev · 2019-03-11T17:30:55Z

I have the same issue here... only difference is I am running on Ubuntu 18.10.

nonrootuser $ minikube start
😄  minikube v0.35.0 on linux (amd64)
💡  Tip: Use 'minikube start -p <name>' to create a new cluster, or 'minikube delete' to delete this one.
🏃  Re-using the currently running virtualbox VM for "minikube" ...
⌛  Waiting for SSH access ...
📶  "minikube" IP address is 192.168.99.100
🐳  Configuring Docker as the container runtime ...
✨  Preparing Kubernetes environment ...
🚜  Pulling images required by Kubernetes v1.13.4 ...
🔄  Relaunching Kubernetes v1.13.4 using kubeadm ... 
⌛  Waiting for pods: apiserver proxy💣  Error restarting cluster: wait: waiting for k8s-app=kube-proxy: timed out waiting for the condition

😿  Sorry that minikube crashed. If this was unexpected, we would love to hear from you:
👉  https://github.com/kubernetes/minikube/issues/new

minikube-logs.txt

lee-zhg · 2019-03-11T20:00:43Z

I encountered the same problem after moved to v0.35.0 to fix the other problem.

😄 minikube v0.35.0 on darwin (amd64)
👍 minikube will upgrade the local cluster from Kubernetes 1.13.3 to 1.13.4
💡 Tip: Use 'minikube start -p ' to create a new cluster, or 'minikube delete' to delete this one.
🏃 Re-using the currently running virtualbox VM for "minikube" ...
⌛ Waiting for SSH access ...
📶 "minikube" IP address is 192.168.99.100
🐳 Configuring Docker as the container runtime ...
✨ Preparing Kubernetes environment ...
💾 Downloading kubeadm v1.13.4
💾 Downloading kubelet v1.13.4
🚜 Pulling images required by Kubernetes v1.13.4 ...
🔄 Relaunching Kubernetes v1.13.4 using kubeadm ...
⌛ Waiting for pods: apiserver

💣  Error restarting cluster: wait: waiting for component=kube-apiserver: timed out waiting for the condition

😿 Sorry that minikube crashed. If this was unexpected, we would love to hear from you:
👉 https://github.com/kubernetes/minikube/issues/new

I am on v10.14.2

mverrilli · 2019-03-12T05:31:25Z

I did minikube delete and started it again and it worked. It did sit on Waiting for pods for a few minutes but did get past it (unlike before, I left it running for a long time without any progress). HTH. I am also running 0.35.0.

chandrabhandz · 2019-03-12T10:33:03Z

Having the same problem, just installed 0.35.0 and can't get it to work.
tried minikube delete and start again but no luck

😄 minikube v0.35.0 on darwin (amd64)
🔥 Creating virtualbox VM (CPUs=4, Memory=8192MB, Disk=20000MB) ...
📶 "minikube" IP address is 192.168.99.102
🐳 Configuring Docker as the container runtime ...
✨ Preparing Kubernetes environment ...
🚜 Pulling images required by Kubernetes v1.13.4 ...
🚀 Launching Kubernetes v1.13.4 using kubeadm ...
⌛ Waiting for pods: apiserver proxy💣 Error starting cluster: wait: waiting for k8s-app=kube-proxy: timed out waiting for the condition

😿 Sorry that minikube crashed. If this was unexpected, we would love to hear from you:
👉 https://github.com/kubernetes/minikube/issues/new

tstromberg · 2019-03-13T21:58:43Z

@serverok - I've seen this to when resuming a previously setup VM, but haven't been able to replicate it reliably. Do you mind attaching the output of the following command:

minikube ssh 'docker logs $(docker ps -a -f name=k8s_kube-proxy --format={{.ID}})'

I suspect this can be resolved by running minikube delete, but it's almost certainly going to come back at some random point in the future.

For other folks who are also running into this in a way that does not say "Error restarting", I suggest opening a new bug report as there are likely to be multiple causes. Feel free to reference #3843 though.

Thanks!

Update: Fixed command-line.

ocontant · 2019-03-13T22:27:26Z

I have the same issue when running minikube with Virtualbox and the starting commands:

I run the minikube command as my user (not root).
minikube start --memory=8192 --cpus=4 --kubernetes-version=v1.13.4 --extra-config=controller-manager.cluster-signing-cert-file="/var/lib/localkube/certs/ca.crt" --extra-config=controller-manager.cluster-signing-key-file="/var/lib/localkube/certs/ca.key"

I run Ubuntu 18.10 inside a VMWare Workstation virtualization engine.
I have CPU Intel VT-x/EPT and IOMMU enabled on the VM and in the BIOS of the baremetal host.

The host has 32G of RAM and I allocated 16G RAM and 4 vCPU to the Ubuntu VM. I setup the minikube to start with 8G RAM and 4 CPU.

tstromberg · 2019-03-13T22:30:16Z

@ocontant - If you don't mind, please open a new issue as it may have different root causes. Many of those command-line options seem very strange, as localkube is no longer used.

I had a bug in my example command: please use:

minikube ssh 'docker logs $(docker ps -a -f name=k8s_kube-proxy --format={{.ID}})'

Thanks!

ocontant · 2019-03-13T22:31:22Z

@ocontant - If you don't mind, please open a new issue as it may have different root causes. Many of those command-line options seem very strange, as localkube is no longer used.

I had a bug in my example command: please use:

minikube ssh 'docker logs $(docker ps -a -f name=k8s_kube-proxy --format={{.ID}})'

Thanks!

The command are from the istio page reference how to install istio in minikube. Pershaps their documention is a bit outdate. I will try without those parameters and see.

ocontant · 2019-03-13T22:40:48Z

@tstromberg Seems like removing the extra parameters fixed the issue. My instance of minikube started correctly.

Do you have a way to inform istio upstream that their documentation is deprecated and they should update it? Reference to the documentation: [(https://istio.io/docs/setup/kubernetes/platform-setup/minikube/)]

serverok · 2019-03-14T05:21:14Z

@tstromberg

There is no such container, here is the result

boby@sok-01:~$ minikube start
😄  minikube v0.35.0 on linux (amd64)
💡  Tip: Use 'minikube start -p <name>' to create a new cluster, or 'minikube delete' to delete this one.
🔄  Restarting existing virtualbox VM for "minikube" ...
⌛  Waiting for SSH access ...
📶  "minikube" IP address is 192.168.99.100
🐳  Configuring Docker as the container runtime ...
✨  Preparing Kubernetes environment ...
🚜  Pulling images required by Kubernetes v1.13.4 ...
🔄  Relaunching Kubernetes v1.13.4 using kubeadm ... 
⌛  Waiting for pods: apiserver proxy💣  Error restarting cluster: wait: waiting for k8s-app=kube-proxy: timed out waiting for the condition

😿  Sorry that minikube crashed. If this was unexpected, we would love to hear from you:
👉  https://github.com/kubernetes/minikube/issues/new
boby@sok-01:~$ minikube ssh 'docker logs $(docker ps -a -f name=k8s_kube-proxy --format={{.ID}})'
"docker logs" requires exactly 1 argument.
See 'docker logs --help'.

Usage:  docker logs [OPTIONS] CONTAINER

Fetch the logs of a container
ssh: Process exited with status 1
boby@sok-01:~$

Attached result of docker ps and docker ps -a inside "minikube ssh"

docker-ps.txt

SychevIgor · 2019-03-14T07:41:26Z

The same problem with minikube on Windows Hyper-V

C:\Program Files\Docker>minikube start --vm-driver hyperv --hyperv-virtual-switch "MinukubeNet"
o minikube v0.35.0 on windows (amd64)
i Tip: Use 'minikube start -p ' to create a new cluster, or 'minikube delete' to delete this one.
: Re-using the currently running hyperv VM for "minikube" ...
: Waiting for SSH access ...

"minikube" IP address is 10.6.172.121
Configuring Docker as the container runtime ...
Preparing Kubernetes environment ...
Pulling images required by Kubernetes v1.13.4 ...
: Relaunching Kubernetes v1.13.4 using kubeadm ...
: Waiting for pods: apiserver proxy! Error restarting cluster: wait: waiting for k8s-app=kube-proxy: timed out waiting for the condition

Sorry that minikube crashed. If this was unexpected, we would love to hear from you:

https://github.com/kubernetes/minikube/issues/new

srameswaran · 2019-03-14T16:57:14Z

I have same problem
minikube start
😄 minikube v0.35.0 on darwin (amd64)
🔥 Creating virtualbox VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
📶 "minikube" IP address is 192.168.99.105
🐳 Configuring Docker as the container runtime ...
✨ Preparing Kubernetes environment ...
🚜 Pulling images required by Kubernetes v1.13.4 ...
🚀 Launching Kubernetes v1.13.4 using kubeadm ...
⌛ Waiting for pods: apiserver💣 Error starting cluster: wait: waiting for component=kube-apiserver: timed out waiting for the condition

😿 Sorry that minikube crashed. If this was unexpected, we would love to hear from you:
👉 https://github.com/kubernetes/minikube/issues/new

minikube ssh 'docker logs $(docker ps -a -f name=k8s_kube-proxy --format={{.ID}})'
W0314 16:41:42.848332 1 server_others.go:295] Flag proxy-mode="" unknown, assuming iptables proxy
I0314 16:41:42.864211 1 server_others.go:148] Using iptables Proxier.
W0314 16:41:42.864315 1 proxier.go:319] clusterCIDR not specified, unable to distinguish between internal and external traffic
I0314 16:41:42.864514 1 server_others.go:178] Tearing down inactive rules.
I0314 16:41:42.988593 1 server.go:483] Version: v1.13.4
I0314 16:41:43.000734 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_max' to 131072
I0314 16:41:43.000933 1 conntrack.go:52] Setting nf_conntrack_max to 131072
I0314 16:41:43.002120 1 conntrack.go:83] Setting conntrack hashsize to 32768
I0314 16:41:43.006628 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
I0314 16:41:43.006688 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
I0314 16:41:43.007273 1 config.go:102] Starting endpoints config controller
I0314 16:41:43.007294 1 controller_utils.go:1027] Waiting for caches to sync for endpoints config controller
I0314 16:41:43.007310 1 config.go:202] Starting service config controller
I0314 16:41:43.007313 1 controller_utils.go:1027] Waiting for caches to sync for service config controller
I0314 16:41:43.107532 1 controller_utils.go:1034] Caches are synced for endpoints config controller
I0314 16:41:43.107603 1 controller_utils.go:1034] Caches are synced for service config controller

dmag1 · 2019-03-15T12:18:29Z

I do get the same issue with minikube 0.35.0 on Windows 10.

Noted that storage-provisioner status would change from ERROR to CrashLoopBackOff at the same time.

kubectl get pods -n kube-system

NAME READY STATUS RESTARTS AGE
etcd-minikube 1/1 Running 6 9h
kube-addon-manager-minikube 1/1 Running 5 9h
kube-apiserver-minikube 1/1 Running 8 9h
kube-controller-manager-minikube 1/1 Running 7 8h
kube-scheduler-minikube 1/1 Running 8 9h
storage-provisioner 0/1 CrashLoopBackOff 100 9h

minikubeout.txt

liubog2008 · 2019-03-16T16:44:55Z

I have same problem that minikube doesn't create kube-proxy

$ docker ps -a | grep proxy
$

liubog2008 · 2019-03-16T17:23:05Z

It seems because of #3774

https://github.com/kubernetes/minikube/pull/3774/files#diff-fb1a98aa9faed8065953a5fbb1a92e8fR287

At this time, kube-proxy is not created by kubeadm

liubog2008 · 2019-03-16T17:24:26Z

@tstromberg

liubog2008 · 2019-03-16T17:25:19Z

$ sudo kubeadm init phase control-plane all --config /var/lib/kubeadm.yaml
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"

liubog2008 · 2019-03-16T17:31:19Z

The "init" command executes the following phases:

preflight                  Run master pre-flight checks
kubelet-start              Writes kubelet settings and (re)starts the kubelet
certs                      Certificate generation
  /ca                        Generates the self-signed Kubernetes CA to provision identities for other Kubernetes components
  /apiserver                 Generates the certificate for serving the Kubernetes API
  /apiserver-kubelet-client  Generates the Client certificate for the API server to connect to kubelet
  /etcd-ca                   Generates the self-signed CA to provision identities for etcd
  /etcd-server               Generates the certificate for serving etcd
  /etcd-peer                 Generates the credentials for etcd nodes to communicate with each other
  /etcd-healthcheck-client   Generates the client certificate for liveness probes to healtcheck etcd
  /apiserver-etcd-client     Generates the client apiserver uses to access etcd
  /front-proxy-ca            Generates the self-signed CA to provision identities for front proxy
  /front-proxy-client        Generates the client for the front proxy
  /sa                        Generates a private key for signing service account tokens along with its public key
kubeconfig                 Generates all kubeconfig files necessary to establish the control plane and the admin kubeconfig file
  /admin                     Generates a kubeconfig file for the admin to use and for kubeadm itself
  /kubelet                   Generates a kubeconfig file for the kubelet to use *only* for cluster bootstrapping purposes
  /controller-manager        Generates a kubeconfig file for the controller manager to use
  /scheduler                 Generates a kubeconfig file for the scheduler to use
control-plane              Generates all static Pod manifest files necessary to establish the control plane
  /apiserver                 Generates the kube-apiserver static Pod manifest
  /controller-manager        Generates the kube-controller-manager static Pod manifest
  /scheduler                 Generates the kube-scheduler static Pod manifest
etcd                       Generates static Pod manifest file for local etcd.
  /local                     Generates the static Pod manifest file for a local, single-node local etcd instance.
upload-config              Uploads the kubeadm and kubelet configuration to a ConfigMap
  /kubeadm                   Uploads the kubeadm ClusterConfiguration to a ConfigMap
  /kubelet                   Uploads the kubelet component config to a ConfigMap
mark-control-plane         Mark a node as a control-plane
bootstrap-token            Generates bootstrap tokens used to join a node to a cluster
addon                      Installs required addons for passing Conformance tests
  /coredns                   Installs the CoreDNS addon to a Kubernetes cluster
  /kube-proxy                Installs the kube-proxy addon to a Kubernetes cluster

Or it's because kube-proxy is moved by kubeadm

subravi92 · 2019-03-19T05:58:31Z

Even I have the same problem on mac after minikube upgrade..any idea on what might be causing it.

bash-5.0$ minikube start
😄 minikube v0.35.0 on darwin (amd64)
🔥 Creating virtualbox VM (CPUs=2, Memory=4096MB, Disk=20000MB) ...
📶 "minikube" IP address is 192.168.99.100
🐳 Configuring Docker as the container runtime ...
✨ Preparing Kubernetes environment ...
🚜 Pulling images required by Kubernetes v1.13.4 ...
🚀 Launching Kubernetes v1.13.4 using kubeadm ...
⌛ Waiting for pods: apiserver💣 Error starting cluster: wait: waiting for component=kube-apiserver: timed out waiting for the condition

😿 Sorry that minikube crashed. If this was unexpected, we would love to hear from you:
👉 https://github.com/kubernetes/minikube/issues/new

bash-5.0$ minikube delete
🔥 Deleting "minikube" from virtualbox ...
💔 The "minikube" cluster has been deleted.

bash-5.0$ minikube start
😄 minikube v0.35.0 on darwin (amd64)
🔥 Creating virtualbox VM (CPUs=2, Memory=4096MB, Disk=20000MB) ...
📶 "minikube" IP address is 192.168.99.102
🐳 Configuring Docker as the container runtime ...
✨ Preparing Kubernetes environment ...
🚜 Pulling images required by Kubernetes v1.13.4 ...
🚀 Launching Kubernetes v1.13.4 using kubeadm ...
⌛ Waiting for pods: apiserver💣 Error starting cluster: wait: waiting for component=kube-apiserver: timed out waiting for the condition

😿 Sorry that minikube crashed. If this was unexpected, we would love to hear from you:
👉 https://github.com/kubernetes/minikube/issues/new

sassyiphoneuser · 2019-03-19T13:36:59Z

I had the same issue but minikube delete solved it.

rudyzhou2 · 2019-03-20T04:19:26Z

same issue here on Windows 10 with Hyper V running 0.35.0

langebo · 2019-03-20T10:28:50Z

same issue running on win10 / kubernetes v1.13.4 / minikube v0.35.0 / hyperv (default switch)

milosonator · 2019-03-20T12:48:15Z

I've hit the same issue after my first attempt failed (because I needed to set docker proxy settings). Second and consequent attempts would fail.

I added the minikube ip address to my NO_PROXY environment variable, and after a delete it would work.

Minikube 0.35.0, Ubuntu 18.04, amd64, virtualbox (set to 16gb/50000mb).

subravi92 · 2019-03-22T07:23:03Z

Thanks.NO_PROXY env works like a charm.even machine restart would work( if vpn is disconnected ) after minikube delete as it would reset the network.

efengx · 2019-03-24T09:08:34Z

This is also the case with the latest version, details are #3936

shekharmayank · 2019-04-01T08:39:37Z

I am facing the same issue.

:   Waiting for pods: apiserver proxy
!   Error restarting cluster: wait: waiting for k8s-app=kube-proxy: timed out waiting for the condition

And minikube delete doesn't work and neither NO_PROXY.

srameswaran · 2019-04-01T15:03:28Z

I did delete all the virtual boxes and restart the minikube and it worked

rajithd-aurea · 2019-04-02T12:50:14Z

minicube delete and minikube start worked.
minikube delete
🔥 Deleting "minikube" from virtualbox ...
💔 The "minikube" cluster has been deleted.

minikube start
😄 minikube v1.0.0 on darwin (amd64)
🤹 Downloading Kubernetes v1.14.0 images in the background ...
🔥 Creating virtualbox VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
📶 "minikube" IP address is 192.168.99.101
🐳 Configuring Docker as the container runtime ...
🐳 Version of container runtime is 18.06.2-ce
⌛ Waiting for image downloads to complete ...
✨ Preparing Kubernetes environment ...
🚜 Pulling images required by Kubernetes v1.14.0 ...
🚀 Launching Kubernetes v1.14.0 using kubeadm ...
⌛ Waiting for pods: apiserver proxy etcd scheduler controller dns
🔑 Configuring cluster permissions ...
🤔 Verifying component health .....
💗 kubectl is now configured to use "minikube"
🏄 Done! Thank you for using minikube!

staticdev · 2019-04-02T13:54:53Z

@serverok please close this issue if this works for you.

serverok · 2019-04-02T16:11:36Z

Got it work after minikube delete and upgrading to v1..0.0

MichaelChirico · 2019-04-11T11:26:54Z

Confirming minikube delete && minikube start worked on my Mac:

system_profiler SPSoftwareDataType
Software:

    System Software Overview:

      System Version: macOS 10.13.6 (17G6030)
      Kernel Version: Darwin 17.7.0
      Boot Volume: Macintosh HD
      Boot Mode: Normal
      Computer Name: xxx
      User Name: Michael Chirico (michael.chirico)
      Secure Virtual Memory: Enabled
      System Integrity Protection: Enabled
      Time since boot: 1:00

Thanks!

tstromberg · 2019-04-11T17:56:53Z

Please use #3850 for

esbol-moldrakhmetov · 2019-04-17T03:49:45Z

I was helped...

MacBook-Air-Esbol:My esbolmoldrahmetov$ minikube start
😄 minikube v0.35.0 on darwin (amd64)
💡 Tip: Use 'minikube start -p ' to create a new cluster, or 'minikube delete' to delete this one.
🏃 Re-using the currently running virtualbox VM for "minikube" ...
⌛ Waiting for SSH access ...
📶 "minikube" IP address is 192.168.99.100
🐳 Configuring Docker as the container runtime ...
✨ Preparing Kubernetes environment ...
🚜 Pulling images required by Kubernetes v1.13.4 ...
🔄 Relaunching Kubernetes v1.13.4 using kubeadm ...
⌛ Waiting for pods: apiserver proxy §^C
MacBook-Air-Esbol:My esbolmoldrahmetov$ minikube start
😄 minikube v0.35.0 on darwin (amd64)
💡 Tip: Use 'minikube start -p ' to create a new cluster, or 'minikube delete' to delete this one.
🏃 Re-using the currently running virtualbox VM for "minikube" ...
⌛ Waiting for SSH access ...
📶 "minikube" IP address is 192.168.99.100
🐳 Configuring Docker as the container runtime ...
✨ Preparing Kubernetes environment ...
🚜 Pulling images required by Kubernetes v1.13.4 ...
🔄 Relaunching Kubernetes v1.13.4 using kubeadm ...
⌛ Waiting for pods: apiserver proxy💣 Error restarting cluster: wait: waiting for k8s-app=kube-proxy: timed out waiting for the condition

😿 Sorry that minikube crashed. If this was unexpected, we would love to hear from you:
👉 https://github.com/kubernetes/minikube/issues/new

MacBook-Air-Esbol:My esbolmoldrahmetov$ minikube delete
🔥 Deleting "minikube" from virtualbox ...
💔 The "minikube" cluster has been deleted.

sudo -i
minikube version
minikube version: v0.35.0

MacBook-Air-Esbol:~ root# rm -rf /.minikube/
MacBook-Air-Esbol: root# exit
logout

MacBook-Air-Esbol:My esbolmoldrahmetov$ minikube start
😄 minikube v0.35.0 on darwin (amd64)
🔥 Creating virtualbox VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
📶 "minikube" IP address is 192.168.99.100
🐳 Configuring Docker as the container runtime ...
✨ Preparing Kubernetes environment ...
🚜 Pulling images required by Kubernetes v1.13.4 ...
🚀 Launching Kubernetes v1.13.4 using kubeadm ...
⌛ Waiting for pods: apiserver proxy etcd scheduler controller addon-manager dns
🔑 Configuring cluster permissions ...
🤔 Verifying component health .....
💗 kubectl is now configured to use "minikube"
🏄 Done! Thank you for using minikube!

Azadehkhojandi · 2019-04-18T04:33:55Z

C:\WINDOWS\system32>minikube start --vm-driver hyperv --hyperv-virtual-switch "Primary Virtual Switch"
o minikube v1.0.0 on windows (amd64)
$ Downloading Kubernetes v1.14.0 images in the background ...
i Tip: Use 'minikube start -p ' to create a new cluster, or 'minikube delete' to delete this one.
: Re-using the currently running hyperv VM for "minikube" ...
: Waiting for SSH access ...

"minikube" IP address is 192.168.1.35
Configuring Docker as the container runtime ...
Version of container runtime is 18.06.2-ce
: Waiting for image downloads to complete ...
Preparing Kubernetes environment ...
Pulling images required by Kubernetes v1.14.0 ...
: Relaunching Kubernetes v1.14.0 using kubeadm ...
: Waiting for pods: apiserver proxy
! Error restarting cluster: wait: waiting for k8s-app=kube-proxy: timed out waiting for the condition

Sorry that minikube crashed. If this was unexpected, we would love to hear from you:

https://github.com/kubernetes/minikube/issues/new
X Problems detected in "kube-addon-manager":
- error: no objects passed to apply
- error: no objects passed to apply
- error: no objects paINFO: Leader is minikube

I stopped the Hyper-V Manager Service and deleted the minikube

C:\WINDOWS\system32>minikube start --vm-driver hyperv --hyperv-virtual-switch "Primary Virtual Switch"
o minikube v1.0.0 on windows (amd64)
$ Downloading Kubernetes v1.14.0 images in the background ...

Creating hyperv VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

"minikube" IP address is 192.168.1.36
Configuring Docker as the container runtime ...
Version of container runtime is 18.06.2-ce
: Waiting for image downloads to complete ...
Preparing Kubernetes environment ...
Pulling images required by Kubernetes v1.14.0 ...
Launching Kubernetes v1.14.0 using kubeadm ...
: Waiting for pods: apiserver proxy etcd scheduler controller dns
Configuring cluster permissions ...
Verifying component health .....

kubectl is now configured to use "minikube"
= Done! Thank you for using minikube!

scycer · 2019-04-29T10:42:22Z

FYI i couldn't get it to work either with 'none' or 'virtualbox' but after installing kvm and using that it worked for me

Ubuntu 18.10 - minikube v1.0.0

tstromberg · 2019-05-14T17:15:59Z

So! I finally ran into this bug myself in a repeatable fashion. The good news is that this is solvable! I can verify that #4014 fixes this by running within the VM:

kubeadm init phase addon all

Even on older Kubernetes releases. I'll make an effort to get this bug resolved this week in case that PR isn't merged. In the mean time, most everyone should be able to workaround this bug by running:

minikube delete

tstromberg · 2019-05-22T03:22:56Z

The fix was released in minikube v1.1.0. If you run into this, please upgrade and let me know if it fixes it!

sanemoginr · 2019-05-30T20:04:18Z

Hi , running minikube v1.1.0 and ran again into the problem:

Found network options:

NO_PROXY=192.168.99.100

Configuring environment for Kubernetes v1.14.2 on Docker 18.09.6
- env NO_PROXY=192.168.99.100
Downloading kubeadm v1.14.2
Downloading kubelet v1.14.2
Relaunching Kubernetes v1.14.2 using kubeadm ...

X Error restarting cluster: waiting for apiserver: timed out waiting for the condition

Sorry that minikube crashed. If this was unexpected, we would love to hear from you:
- https://github.com/kubernetes/minikube/issues/new
Problems detected in "kube-addon-manager":
- error: unable to recognize "STDIN": Get https://localhost:8443/api?timeout=32s: dial tcp 127.0.0.1:8443: connect: connection refused
- error: unable to recognize "STDIN": Get https://localhost:8443/api?timeout=32s: dial tcp 127.0.0.1:8443: connect: connection refused

tstromberg · 2019-05-30T20:48:50Z

@sanemoginr That appears to be something else different. Please open a new issue, and be sure to include the output of minikube logs. Thanks!

staticdev mentioned this issue Mar 11, 2019

VM reuse: waiting for k8s-app=kube-proxy: timed out waiting for the condition #3850

Closed

tstromberg changed the title ~~waiting for k8s-app=kube-proxy: timed out waiting for the condition~~ Error restarting cluster: waiting for k8s-app=kube-proxy: timed out waiting for the condition Mar 13, 2019

tstromberg added kind/bug Categorizes issue or PR as related to a bug. co/kube-proxy issues relating to kube-proxy in some way priority/important-longterm Important over the long term, but may not be staffed and/or may need multiple releases to complete. labels Mar 13, 2019

serverok closed this as completed Apr 2, 2019

tstromberg added the triage/duplicate Indicates an issue is a duplicate of other open issue. label Apr 11, 2019

tstromberg reopened this Apr 11, 2019

tstromberg changed the title ~~Error restarting cluster: waiting for k8s-app=kube-proxy: timed out waiting for the condition~~ VM reuse: waiting for k8s-app=kube-proxy: timed out waiting for the condition Apr 11, 2019

tstromberg changed the title ~~VM reuse: waiting for k8s-app=kube-proxy: timed out waiting for the condition~~ restart: waiting for k8s-app=kube-proxy: timed out waiting for the condition May 14, 2019

tstromberg added priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. and removed triage/duplicate Indicates an issue is a duplicate of other open issue. labels May 14, 2019

tstromberg added this to the v1.1.0 milestone May 14, 2019

tstromberg removed the priority/important-longterm Important over the long term, but may not be staffed and/or may need multiple releases to complete. label May 14, 2019

tstromberg mentioned this issue May 14, 2019

restart: waiting for k8s-app=kube-proxy: timed out waiting for the condition #4219

Closed

tekgal mentioned this issue May 15, 2019

minikube is crashed on my mac #4233

Closed

tstromberg self-assigned this May 16, 2019

This was referenced May 16, 2019

Error restarting cluster: wait: waiting for k8s-app=kube-proxy: timed out waiting for the condition #4230

Closed

Restart kube-proxy using kubeadm & add bootstrapper.WaitCluster #4276

Merged

tstromberg closed this as completed in #4276 May 17, 2019

tstromberg mentioned this issue May 22, 2019

Error restarting cluster: wait: waiting for k8s-app=kube-proxy: timed out waiting for the condition #4294

Closed

restart: waiting for k8s-app=kube-proxy: timed out waiting for the condition #3843

restart: waiting for k8s-app=kube-proxy: timed out waiting for the condition #3843

Comments

serverok commented Mar 10, 2019

staticdev commented Mar 11, 2019 • edited Loading

lee-zhg commented Mar 11, 2019

mverrilli commented Mar 12, 2019

chandrabhandz commented Mar 12, 2019

tstromberg commented Mar 13, 2019 • edited Loading

ocontant commented Mar 13, 2019 • edited Loading

tstromberg commented Mar 13, 2019

ocontant commented Mar 13, 2019

ocontant commented Mar 13, 2019 • edited Loading

serverok commented Mar 14, 2019

SychevIgor commented Mar 14, 2019

srameswaran commented Mar 14, 2019

dmag1 commented Mar 15, 2019

liubog2008 commented Mar 16, 2019 • edited Loading

liubog2008 commented Mar 16, 2019

liubog2008 commented Mar 16, 2019

liubog2008 commented Mar 16, 2019

liubog2008 commented Mar 16, 2019

subravi92 commented Mar 19, 2019

sassyiphoneuser commented Mar 19, 2019

rudyzhou2 commented Mar 20, 2019

langebo commented Mar 20, 2019

milosonator commented Mar 20, 2019

subravi92 commented Mar 22, 2019

efengx commented Mar 24, 2019

shekharmayank commented Apr 1, 2019 • edited Loading

srameswaran commented Apr 1, 2019

rajithd-aurea commented Apr 2, 2019

staticdev commented Apr 2, 2019

serverok commented Apr 2, 2019

MichaelChirico commented Apr 11, 2019

tstromberg commented Apr 11, 2019

esbol-moldrakhmetov commented Apr 17, 2019 • edited Loading

Azadehkhojandi commented Apr 18, 2019

scycer commented Apr 29, 2019

tstromberg commented May 14, 2019 • edited Loading

tstromberg commented May 22, 2019

sanemoginr commented May 30, 2019

tstromberg commented May 30, 2019

staticdev commented Mar 11, 2019 •

edited

Loading

tstromberg commented Mar 13, 2019 •

edited

Loading

ocontant commented Mar 13, 2019 •

edited

Loading

ocontant commented Mar 13, 2019 •

edited

Loading

liubog2008 commented Mar 16, 2019 •

edited

Loading

shekharmayank commented Apr 1, 2019 •

edited

Loading

esbol-moldrakhmetov commented Apr 17, 2019 •

edited

Loading

tstromberg commented May 14, 2019 •

edited

Loading