offline support broken: LoadImages makes HTTPS queries

[Colstuwjx]

The exact command to reproduce the issue:
minikube start

It seems that docker daemon inside minikube vm would pull docker images even we have been cached all things, included iso,images etc.

According to the disk cache reference said,

If any of these files exist, minikube will use copy them into the VM directly rather than pulling them from the internet.

maybe we need to also make docker daemon do NOT pull the cached images?
Thanks.

The full output of the command that failed:

🙄  Darwin 10.14.6 上的 minikube v1.6.1
✨  Selecting 'virtualbox' driver from user configuration (alternates: [hyperkit])
🔥  正在创建 virtualbox 虚拟机（CPUs=4，Memory=8196MB, Disk=20000MB）...
⚠️  VM is unable to access k8s.gcr.io, you may need to configure a proxy or set --image-repository
🐳  正在 Docker '19.03.5' 中准备 Kubernetes v1.17.0…
❌  Unable to load cached images: loading cached images: fetching image: Get https://index.docker.io/v2/: dial tcp: lookup index.docker.io on [::1]:53: read udp [::1]:50572->[::1]:53: read: connection refused
🚜  拉取镜像 ...
❌  无法拉取映像，有可能是正常状况：running cmd: "/bin/bash -c \"sudo env PATH=/var/lib/minikube/binaries/v1.17.0:$PATH kubeadm config images pull --config /var/tmp/minikube/kubeadm.yaml\"": /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.17.0:$PATH kubeadm config images pull --config /var/tmp/minikube/kubeadm.yaml": Process exited with status 1
stdout:

stderr:
W1217 08:28:08.405830    2817 common.go:77] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta1". Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
W1217 08:28:08.406353    2817 common.go:77] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta1". Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
W1217 08:28:08.407869    2817 validation.go:28] Cannot validate kube-proxy config - no validator is available
W1217 08:28:08.407887    2817 validation.go:28] Cannot validate kubelet config - no validator is available
failed to pull image "k8s.gcr.io/kube-apiserver:v1.17.0": output: Error response from daemon: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host
, error: exit status 1
To see the stack trace of this error execute with --v=5 or higher

🚀  正在启动 Kubernetes ...

💣  开启 cluster 时出错: init failed. cmd: "/bin/bash -c \"sudo env PATH=/var/lib/minikube/binaries/v1.17.0:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap\"": /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.17.0:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.17.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

stderr:
W1217 08:28:08.475359    2835 common.go:77] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta1". Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
W1217 08:28:08.475999    2835 common.go:77] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta1". Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
W1217 08:28:08.478214    2835 validation.go:28] Cannot validate kube-proxy config - no validator is available
W1217 08:28:08.478223    2835 validation.go:28] Cannot validate kubelet config - no validator is available
	[WARNING Service-Docker]: docker service is not enabled, please run 'systemctl enable docker.service'
	[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase preflight: [preflight] Some fatal errors occurred:
	[ERROR ImagePull]: failed to pull image k8s.gcr.io/kube-apiserver:v1.17.0: output: Error response from daemon: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host
, error: exit status 1
	[ERROR ImagePull]: failed to pull image k8s.gcr.io/kube-controller-manager:v1.17.0: output: Error response from daemon: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host
, error: exit status 1
	[ERROR ImagePull]: failed to pull image k8s.gcr.io/kube-scheduler:v1.17.0: output: Error response from daemon: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host
, error: exit status 1
	[ERROR ImagePull]: failed to pull image k8s.gcr.io/kube-proxy:v1.17.0: output: Error response from daemon: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host
, error: exit status 1
	[ERROR ImagePull]: failed to pull image k8s.gcr.io/pause:3.1: output: Error response from daemon: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host
, error: exit status 1
	[ERROR ImagePull]: failed to pull image k8s.gcr.io/etcd:3.4.3-0: output: Error response from daemon: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host
, error: exit status 1
	[ERROR ImagePull]: failed to pull image k8s.gcr.io/coredns:1.6.5: output: Error response from daemon: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host
, error: exit status 1
[preflight] If you know what you are doing, you can make a check non-fatal with `--ignore-preflight-errors=...`
To see the stack trace of this error execute with --v=5 or higher


😿  Sorry that minikube crashed. If this was unexpected, we would love to hear from you:
👉  https://github.com/kubernetes/minikube/issues/new/choose

The output of the minikube logs command:

==> Docker <==
-- Logs begin at Tue 2019-12-17 08:27:53 UTC, end at Tue 2019-12-17 08:32:51 UTC. --
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.386188326Z" level=info msg="loading plugin "io.containerd.grpc.v1.diff"..." type=io.containerd.grpc.v1
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.386193978Z" level=info msg="loading plugin "io.containerd.grpc.v1.events"..." type=io.containerd.grpc.v1
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.386199496Z" level=info msg="loading plugin "io.containerd.grpc.v1.healthcheck"..." type=io.containerd.grpc.v1
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.386206246Z" level=info msg="loading plugin "io.containerd.grpc.v1.images"..." type=io.containerd.grpc.v1
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.386212441Z" level=info msg="loading plugin "io.containerd.grpc.v1.leases"..." type=io.containerd.grpc.v1
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.386218259Z" level=info msg="loading plugin "io.containerd.grpc.v1.namespaces"..." type=io.containerd.grpc.v1
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.386223977Z" level=info msg="loading plugin "io.containerd.internal.v1.opt"..." type=io.containerd.internal.v1
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.386251026Z" level=info msg="loading plugin "io.containerd.grpc.v1.snapshots"..." type=io.containerd.grpc.v1
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.386259142Z" level=info msg="loading plugin "io.containerd.grpc.v1.tasks"..." type=io.containerd.grpc.v1
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.386265662Z" level=info msg="loading plugin "io.containerd.grpc.v1.version"..." type=io.containerd.grpc.v1
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.386271789Z" level=info msg="loading plugin "io.containerd.grpc.v1.introspection"..." type=io.containerd.grpc.v1
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.386345039Z" level=info msg=serving... address="/var/run/docker/containerd/containerd-debug.sock"
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.386370104Z" level=info msg=serving... address="/var/run/docker/containerd/containerd.sock"
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.386377627Z" level=info msg="containerd successfully booted in 0.006374s"
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.398043237Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.398065358Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.398077086Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///var/run/docker/containerd/containerd.sock 0  <nil>}] <nil>}" module=grpc
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.398086154Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.398806412Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.398826882Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.398836795Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///var/run/docker/containerd/containerd.sock 0  <nil>}] <nil>}" module=grpc
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.398842997Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.415654337Z" level=warning msg="Your kernel does not support cgroup blkio weight"
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.415676273Z" level=warning msg="Your kernel does not support cgroup blkio weight_device"
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.415681492Z" level=warning msg="Your kernel does not support cgroup blkio throttle.read_bps_device"
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.415685214Z" level=warning msg="Your kernel does not support cgroup blkio throttle.write_bps_device"
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.415689472Z" level=warning msg="Your kernel does not support cgroup blkio throttle.read_iops_device"
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.415760633Z" level=warning msg="Your kernel does not support cgroup blkio throttle.write_iops_device"
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.415860605Z" level=info msg="Loading containers: start."
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.464009293Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.500468325Z" level=info msg="Loading containers: done."
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.527526073Z" level=info msg="Docker daemon" commit=633a0ea838 graphdriver(s)=overlay2 version=19.03.5
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.527670974Z" level=info msg="Daemon has completed initialization"
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.542320765Z" level=info msg="API listen on /var/run/docker.sock"
Dec 17 08:28:03 minikube systemd[1]: Started Docker Application Container Engine.
Dec 17 08:28:03 minikube dockerd[2526]: time="2019-12-17T08:28:03.543019042Z" level=info msg="API listen on [::]:2376"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.432208855Z" level=warning msg="Error getting v2 registry: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.432240024Z" level=info msg="Attempting next endpoint for pull after error: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.432300779Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.708185278Z" level=warning msg="Error getting v2 registry: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.708282756Z" level=info msg="Attempting next endpoint for pull after error: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.708331154Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.765453673Z" level=warning msg="Error getting v2 registry: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.765538965Z" level=info msg="Attempting next endpoint for pull after error: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.765567862Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.819028640Z" level=warning msg="Error getting v2 registry: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.819050615Z" level=info msg="Attempting next endpoint for pull after error: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.819067913Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.872616990Z" level=warning msg="Error getting v2 registry: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.872647603Z" level=info msg="Attempting next endpoint for pull after error: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.872665965Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.927870901Z" level=warning msg="Error getting v2 registry: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.927897868Z" level=info msg="Attempting next endpoint for pull after error: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:08 minikube dockerd[2526]: time="2019-12-17T08:28:08.927930984Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:09 minikube dockerd[2526]: time="2019-12-17T08:28:09.000659616Z" level=warning msg="Error getting v2 registry: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:09 minikube dockerd[2526]: time="2019-12-17T08:28:09.000685107Z" level=info msg="Attempting next endpoint for pull after error: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:09 minikube dockerd[2526]: time="2019-12-17T08:28:09.000702554Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:09 minikube dockerd[2526]: time="2019-12-17T08:28:09.063005870Z" level=warning msg="Error getting v2 registry: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:09 minikube dockerd[2526]: time="2019-12-17T08:28:09.063031555Z" level=info msg="Attempting next endpoint for pull after error: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"
Dec 17 08:28:09 minikube dockerd[2526]: time="2019-12-17T08:28:09.063073342Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on 10.0.2.3:53: no such host"

==> container status <==
time="2019-12-17T08:32:53Z" level=fatal msg="failed to connect: failed to connect, make sure you are running as root and the runtime has been started: context deadline exceeded"
CONTAINER ID        IMAGE               COMMAND             CREATED             STATUS              PORTS               NAMES

==> dmesg <==
[Dec17 08:27] You have booted with nomodeset. This means your GPU drivers are DISABLED
[  +0.000000] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[  +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it
[  +0.162766] APIC calibration not consistent with PM-Timer: 102ms instead of 100ms
[  +0.000663]  #2
[  +0.002980]  #3
[  +0.020898] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +14.134856] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +10.243830] systemd[1]: Failed to bump fs.file-max, ignoring: Invalid argument
[  +0.003271] systemd-fstab-generator[1379]: Ignoring "noauto" for root device
[  +0.003175] systemd[1]: File /usr/lib/systemd/system/systemd-journald.service:12 configures an IP firewall (IPAddressDeny=any), but the local system does not support BPF/cgroup based firewalling.
[  +0.000001] systemd[1]: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.)
[  +0.276671] vboxguest: loading out-of-tree module taints kernel.
[  +0.000128] vboxvideo: Unknown symbol ttm_bo_mmap (err -2)
[  +0.000007] vboxvideo: Unknown symbol ttm_bo_global_release (err -2)
[  +0.000006] vboxvideo: Unknown symbol ttm_bo_manager_func (err -2)
[  +0.000003] vboxvideo: Unknown symbol ttm_bo_global_init (err -2)
[  +0.000005] vboxvideo: Unknown symbol ttm_bo_device_release (err -2)
[  +0.000008] vboxvideo: Unknown symbol ttm_bo_kunmap (err -2)
[  +0.000003] vboxvideo: Unknown symbol ttm_bo_del_sub_from_lru (err -2)
[  +0.000005] vboxvideo: Unknown symbol ttm_bo_device_init (err -2)
[  +0.000001] vboxvideo: Unknown symbol ttm_bo_init_mm (err -2)
[  +0.000000] vboxvideo: Unknown symbol ttm_bo_dma_acc_size (err -2)
[  +0.000003] vboxvideo: Unknown symbol ttm_tt_init (err -2)
[  +0.000001] vboxvideo: Unknown symbol ttm_bo_kmap (err -2)
[  +0.000004] vboxvideo: Unknown symbol ttm_bo_add_to_lru (err -2)
[  +0.000003] vboxvideo: Unknown symbol ttm_mem_global_release (err -2)
[  +0.000001] vboxvideo: Unknown symbol ttm_mem_global_init (err -2)
[  +0.000007] vboxvideo: Unknown symbol ttm_bo_init (err -2)
[  +0.000001] vboxvideo: Unknown symbol ttm_bo_validate (err -2)
[  +0.000004] vboxvideo: Unknown symbol ttm_bo_put (err -2)
[  +0.000003] vboxvideo: Unknown symbol ttm_tt_fini (err -2)
[  +0.000001] vboxvideo: Unknown symbol ttm_bo_eviction_valuable (err -2)
[  +0.018345] vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
[  +0.002907] vboxguest: misc device minor 57, IRQ 20, I/O port d020, MMIO at 00000000f0000000 (size 0x400000)
[  +0.124349] hpet1: lost 681 rtc interrupts
[  +0.011008] VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
              00:00:00.004730 main     Log opened 2019-12-17T08:27:53.871790000Z
[  +0.000038] 00:00:00.004803 main     OS Product: Linux
[  +0.000027] 00:00:00.004833 main     OS Release: 4.19.81
[  +0.000028] 00:00:00.004860 main     OS Version: #1 SMP Tue Dec 10 16:09:50 PST 2019
[  +0.000040] 00:00:00.004887 main     Executable: /usr/sbin/VBoxService
              00:00:00.004888 main     Process ID: 2147
              00:00:00.004888 main     Package type: LINUX_64BITS_GENERIC
[  +0.000027] 00:00:00.004929 main     5.2.32 r132073 started. Verbose level = 0
[  +0.000635] 00:00:00.005546 main     Error: Service 'control' failed to initialize: VERR_INVALID_FUNCTION
[  +0.000067] 00:00:00.005626 main     Session 0 is about to close ...
[  +0.000028] 00:00:00.005658 main     Stopping all guest processes ...
[  +0.000026] 00:00:00.005685 main     Closing all guest files ...
[  +0.000260] 00:00:00.005936 main     Ended.
[  +0.427900] NFSD: the nfsdcld client tracking upcall will be removed in 3.10. Please transition to using nfsdcltrack.
[Dec17 08:28] systemd-fstab-generator[2410]: Ignoring "noauto" for root device
[  +5.903211] systemd-fstab-generator[2755]: Ignoring "noauto" for root device
[Dec17 08:29] NFSD: Unable to end grace period: -110

==> kernel <==
 08:32:53 up 5 min,  0 users,  load average: 0.08, 0.42, 0.26
Linux minikube 4.19.81 #1 SMP Tue Dec 10 16:09:50 PST 2019 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2019.02.7"

==> kubelet <==
-- Logs begin at Tue 2019-12-17 08:27:53 UTC, end at Tue 2019-12-17 08:32:53 UTC. --
Dec 17 08:32:50 minikube kubelet[6963]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:50 minikube kubelet[6963]: F1217 08:32:50.223982    6963 server.go:198] failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file "/var/lib/kubelet/config.yaml", error: open /var/lib/kubelet/config.yaml: no such file or directory
Dec 17 08:32:50 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/EXCEPTION
Dec 17 08:32:50 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
Dec 17 08:32:50 minikube systemd[1]: kubelet.service: Service RestartSec=600ms expired, scheduling restart.
Dec 17 08:32:50 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 377.
Dec 17 08:32:50 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Dec 17 08:32:50 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Dec 17 08:32:50 minikube kubelet[6973]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:50 minikube kubelet[6973]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:50 minikube kubelet[6973]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:50 minikube kubelet[6973]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:50 minikube kubelet[6973]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:50 minikube kubelet[6973]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:50 minikube kubelet[6973]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:50 minikube kubelet[6973]: F1217 08:32:50.971943    6973 server.go:198] failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file "/var/lib/kubelet/config.yaml", error: open /var/lib/kubelet/config.yaml: no such file or directory
Dec 17 08:32:50 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/EXCEPTION
Dec 17 08:32:50 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
Dec 17 08:32:51 minikube systemd[1]: kubelet.service: Service RestartSec=600ms expired, scheduling restart.
Dec 17 08:32:51 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 378.
Dec 17 08:32:51 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Dec 17 08:32:51 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Dec 17 08:32:51 minikube kubelet[7063]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:51 minikube kubelet[7063]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:51 minikube kubelet[7063]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:51 minikube kubelet[7063]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:51 minikube kubelet[7063]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:51 minikube kubelet[7063]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:51 minikube kubelet[7063]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:51 minikube kubelet[7063]: F1217 08:32:51.725582    7063 server.go:198] failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file "/var/lib/kubelet/config.yaml", error: open /var/lib/kubelet/config.yaml: no such file or directory
Dec 17 08:32:51 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/EXCEPTION
Dec 17 08:32:51 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
Dec 17 08:32:52 minikube systemd[1]: kubelet.service: Service RestartSec=600ms expired, scheduling restart.
Dec 17 08:32:52 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 379.
Dec 17 08:32:52 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Dec 17 08:32:52 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Dec 17 08:32:52 minikube kubelet[7073]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:52 minikube kubelet[7073]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:52 minikube kubelet[7073]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:52 minikube kubelet[7073]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:52 minikube kubelet[7073]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:52 minikube kubelet[7073]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:52 minikube kubelet[7073]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:52 minikube kubelet[7073]: F1217 08:32:52.475984    7073 server.go:198] failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file "/var/lib/kubelet/config.yaml", error: open /var/lib/kubelet/config.yaml: no such file or directory
Dec 17 08:32:52 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/EXCEPTION
Dec 17 08:32:52 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
Dec 17 08:32:53 minikube systemd[1]: kubelet.service: Service RestartSec=600ms expired, scheduling restart.
Dec 17 08:32:53 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 380.
Dec 17 08:32:53 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Dec 17 08:32:53 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Dec 17 08:32:53 minikube kubelet[7085]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:53 minikube kubelet[7085]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:53 minikube kubelet[7085]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:53 minikube kubelet[7085]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:53 minikube kubelet[7085]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:53 minikube kubelet[7085]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:53 minikube kubelet[7085]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Dec 17 08:32:53 minikube kubelet[7085]: F1217 08:32:53.223437    7085 server.go:198] failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file "/var/lib/kubelet/config.yaml", error: open /var/lib/kubelet/config.yaml: no such file or directory
Dec 17 08:32:53 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/EXCEPTION
Dec 17 08:32:53 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.

The operating system version: MacOS mojave

[Colstuwjx]

See kubeadm related issue: 524.

[Colstuwjx]

Update:

For minikube side, I have seen that we will do retrieveImage while load images to container runtime, and for no networking access environment, it would broken.

Maybe we could add a config option for this, to skip the retrieveImage and just load the cached images?

Thanks.

[tstromberg]

Thank you for bringing this to our attention. I can confirm that offline support is broken in minikube v1.6.1:

My bet is that this was an unexpected side effect of #5987

Here's the error that made me suspicious:

❌ Unable to load cached images: loading cached images: fetching image: Get https://index.docker.io/v2/: dial tcp: lookup index.docker.io on [::1]:53: read udp [::1]:50572->[::1]:53: read: connection refused

Here's another example from running locally without Docker installed:

❌ Unable to load cached images: loading cached images: fetching image: Get https://k8s.gcr.io/v2/: dial tcp: lookup k8s.gcr.io on [::1]:53: read udp [::1]:59457->[::1]:53: i/o timeout

We'll make sure to fix this ASAP.

/cc @medyagh

[medyagh]

@Colstuwjx Thank you so much for taking the time to create this bug ! this is definitely a bug ! I regret that it was a side effect of my improving cache PR.

I am sorry for the inconvenience it caused to offline users andI really appreciate it that you reported it. and thanks for @tstromberg for creating a quick fix PR with integration tests so this may never happen again !