Add solution message if Docker is rootless #10652

hakangung · 2021-02-28T21:43:52Z

Steps to reproduce the issue:

1.docker system prune --volumes
2. systemctl --user restart docker
3.minikube delete
4. minikube start --driver=docker

Full output of failed command:
I0228 21:16:45.860078 56169 out.go:229] Setting OutFile to fd 1 ...
I0228 21:16:45.860629 56169 out.go:281] isatty.IsTerminal(1) = true
I0228 21:16:45.860652 56169 out.go:242] Setting ErrFile to fd 2...
I0228 21:16:45.860662 56169 out.go:281] isatty.IsTerminal(2) = true
I0228 21:16:45.860827 56169 root.go:291] Updating PATH: /home/guengoer_hakan/.minikube/bin
I0228 21:16:45.861363 56169 out.go:236] Setting JSON to false
I0228 21:16:45.862532 56169 start.go:106] hostinfo: {"hostname":"instance-2","uptime":2938,"bootTime":1614544067,"procs":98,"os":"linux","platform":"centos","platformFamily":"rhel","platformVersion":"8.3.2011","kernelVersion":"4.18.0-240.10.1.el8_3.x86_64","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"guest","hostId":"754f5452-23f5-2039-6a81-e07e237544e4"}
I0228 21:16:45.862648 56169 start.go:116] virtualization: guest
I0228 21:16:45.866336 56169 out.go:119] 😄 minikube v1.17.1 on Centos 8.3.2011 (amd64)
😄 minikube v1.17.1 on Centos 8.3.2011 (amd64)
I0228 21:16:45.866543 56169 driver.go:315] Setting default libvirt URI to qemu:///system
I0228 21:16:45.867217 56169 notify.go:126] Checking for updates...
I0228 21:16:45.938726 56169 docker.go:115] docker version: linux-20.10.3
I0228 21:16:45.938829 56169 cli_runner.go:111] Run: docker system info --format "{{json .}}"
ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:fuse-overlayfs DriverStatus:[] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:23 OomKillDisable:true NGoroutines:39 SystemTime:2021-02-28 21:16:45.966520192 +0000 UTC LoggingDriver:json-file CgroupDriver:none NEventsListener:0 KernelVersion:4.18.0-240.10.1.el8_3.x86_64 OperatingSystem:CentOS Linux 8 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:3917074432 GenericResources: DockerRootDir:/home/guengoer_hakan/.local/share/docker HTTPProxy: HTTPSProxy: NoProxy: Name:instance-2 Labels:[] ExperimentalBuild:false ServerVersion:20.10.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=rootless] ProductLicense:Community Engine Warnings:[WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode. WARNING: bridge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:}}
I0228 21:16:45.978338 56169 docker.go:145] overlay module found
I0228 21:16:45.980683 56169 out.go:119] ✨ Using the docker driver based on user configuration
✨ Using the docker driver based on user configuration
I0228 21:16:45.980727 56169 start.go:279] selected driver: docker
I0228 21:16:45.980739 56169 start.go:702] validating driver "docker" against
I0228 21:16:45.980773 56169 start.go:713] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc:}
I0228 21:16:46.016561 56169 info.go:253] docker info: {ID:AWIP:MF6E:QS3V:P5EI:ILNT:WXIE:NGOG:IUG4:KIWY:YFFR:3LKH:BH2F Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:fuse-overlayfs DriverStatus:[] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:23 OomKillDisable:true NGoroutines:39 SystemTime:2021-02-28 21:16:46.007036281 +0000 UTC LoggingDriver:json-file CgroupDriver:none NEventsListener:0 KernelVersion:4.18.0-240.10.1.el8_3.x86_64 OperatingSystem:CentOS Linux 8 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:3917074432 GenericResources: DockerRootDir:/home/guengoer_hakan/.local/share/docker HTTPProxy: HTTPSProxy: NoProxy: Name:instance-2 Labels:[] ExperimentalBuild:false ServerVersion:20.10.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=rootless] ProductLicense:Community Engine Warnings:[WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode. WARNING: bridge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:}}
W0228 21:16:46.016764 56169 out.go:181] ❗ docker is currently using the fuse-overlayfs storage driver, consider switching to overlay2 for better performance
❗ docker is currently using the fuse-overlayfs storage driver, consider switching to overlay2 for better performance
I0228 21:16:46.017166 56169 start_flags.go:249] no existing cluster config was found, will generate one from the flags
I0228 21:16:46.017439 56169 start_flags.go:267] Using suggested 2200MB memory alloc based on sys=3735MB, container=3735MB
I0228 21:16:46.017581 56169 start_flags.go:671] Wait components to verify : map[apiserver:true system_pods:true]
I0228 21:16:46.017625 56169 cni.go:74] Creating CNI manager for ""
I0228 21:16:46.017643 56169 cni.go:139] CNI unnecessary in this configuration, recommending no CNI
I0228 21:16:46.017662 56169 start_flags.go:390] config:
{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] Network: MultiNodeRequested:false}
I0228 21:16:46.022268 56169 out.go:119] 👍 Starting control plane node minikube in cluster minikube
👍 Starting control plane node minikube in cluster minikube
I0228 21:16:46.050509 56169 image.go:92] Found gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e in local docker daemon, skipping pull
I0228 21:16:46.050542 56169 cache.go:116] gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e exists in daemon, skipping pull
I0228 21:16:46.050558 56169 preload.go:97] Checking if preload exists for k8s version v1.20.2 and runtime docker
I0228 21:16:46.050893 56169 profile.go:148] Saving config to /home/guengoer_hakan/.minikube/profiles/minikube/config.json ...
I0228 21:16:46.050950 56169 lock.go:36] WriteFile acquiring /home/guengoer_hakan/.minikube/profiles/minikube/config.json: {Name:mkc146efc5aed1b4d4291eceb3c9e9ddc4d600ec Clock:{} Delay:500ms Timeout:1m0s Cancel:}
I0228 21:16:46.051344 56169 cache.go:185] Successfully downloaded all kic artifacts
I0228 21:16:46.051386 56169 start.go:313] acquiring machines lock for minikube: {Name:mk5bba78214f592a9db33daafb95c5a2882b4ea1 Clock:{} Delay:500ms Timeout:10m0s Cancel:}
I0228 21:16:46.051487 56169 start.go:317] acquired machines lock for "minikube" in 79.694µs
I0228 21:16:46.054620 56169 out.go:140] 🔥 Creating docker container (CPUs=2, Memory=2200MB) ...
🔥 Creating docker container (CPUs=2, Memory=2200MB) ...I0228 21:16:46.052060 56169 cache.go:93] acquiring lock: {Name:mk823d35d9ea8e3477db802cfc232a829124043b Clock:{} Delay:500ms Timeout:10m0s Cancel:}
I0228 21:16:46.054872 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4 exists
I0228 21:16:46.054902 56169 cache.go:82] cache image "docker.io/kubernetesui/metrics-scraper:v1.0.4" -> "/home/guengoer_hakan/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4" took 2.845699ms
I0228 21:16:46.054923 56169 cache.go:66] save to tar file docker.io/kubernetesui/metrics-scraper:v1.0.4 -> /home/guengoer_hakan/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4 succeeded
I0228 21:16:46.052114 56169 cache.go:93] acquiring lock: {Name:mk1f37d5b8b459a292fa09b2a660292656c00133 Clock:{} Delay:500ms Timeout:10m0s Cancel:}
I0228 21:16:46.054940 56169 start.go:160] libmachine.API.Create for "minikube" (driver="docker")
I0228 21:16:46.054969 56169 client.go:168] LocalClient.Create starting
I0228 21:16:46.055028 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.2 exists
| I0228 21:16:46.055046 56169 cache.go:82] cache image "k8s.gcr.io/kube-proxy:v1.20.2" -> "/home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.2" took 2.934332ms
I0228 21:16:46.052134 56169 cache.go:93] acquiring lock: {Name:mke9b2ca3a8302e586b140c8466bd0a989fb7c3b Clock:{} Delay:500ms Timeout:10m0s Cancel:}
I0228 21:16:46.055026 56169 main.go:119] libmachine: Reading certificate data from /home/guengoer_hakan/.minikube/certs/ca.pem
I0228 21:16:46.055124 56169 main.go:119] libmachine: Decoding PEM data...
I0228 21:16:46.055152 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.2 exists
I0228 21:16:46.055153 56169 main.go:119] libmachine: Parsing certificate...
I0228 21:16:46.055173 56169 cache.go:82] cache image "k8s.gcr.io/kube-scheduler:v1.20.2" -> "/home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.2" took 3.038988ms
I0228 21:16:46.055186 56169 cache.go:66] save to tar file k8s.gcr.io/kube-scheduler:v1.20.2 -> /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.2 succeeded
I0228 21:16:46.052202 56169 cache.go:93] acquiring lock: {Name:mk4fd0daf2bbaa7a40ba4dea49fbaf4f1a784be6 Clock:{} Delay:500ms Timeout:10m0s Cancel:}
I0228 21:16:46.055313 56169 main.go:119] libmachine: Reading certificate data from /home/guengoer_hakan/.minikube/certs/cert.pem
I0228 21:16:46.055345 56169 main.go:119] libmachine: Decoding PEM data...
I0228 21:16:46.055365 56169 main.go:119] libmachine: Parsing certificate...
I0228 21:16:46.055404 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 exists
I0228 21:16:46.055423 56169 cache.go:82] cache image "k8s.gcr.io/coredns:1.7.0" -> "/home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0" took 3.221005ms
I0228 21:16:46.055436 56169 cache.go:66] save to tar file k8s.gcr.io/coredns:1.7.0 -> /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 succeeded
I0228 21:16:46.052216 56169 cache.go:93] acquiring lock: {Name:mk0432620acf066901ccf0dd12ec4fbf679910e0 Clock:{} Delay:500ms Timeout:10m0s Cancel:}
I0228 21:16:46.055546 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 exists
I0228 21:16:46.055700 56169 cache.go:82] cache image "k8s.gcr.io/etcd:3.4.13-0" -> "/home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0" took 3.480519ms
I0228 21:16:46.055719 56169 cache.go:66] save to tar file k8s.gcr.io/etcd:3.4.13-0 -> /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 succeeded
I0228 21:16:46.052231 56169 cache.go:93] acquiring lock: {Name:mk2717a8a0580cadfccbaa4b0cbdddb5213cadc7 Clock:{} Delay:500ms Timeout:10m0s Cancel:}
I0228 21:16:46.055825 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/pause_3.2 exists
I0228 21:16:46.055844 56169 cache.go:82] cache image "k8s.gcr.io/pause:3.2" -> "/home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/pause_3.2" took 3.613475ms
I0228 21:16:46.055855 56169 cache.go:66] save to tar file k8s.gcr.io/pause:3.2 -> /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/pause_3.2 succeeded
I0228 21:16:46.052250 56169 cache.go:93] acquiring lock: {Name:mke93ea495f8d026ece79d034bcabf11a9c71473 Clock:{} Delay:500ms Timeout:10m0s Cancel:}
I0228 21:16:46.055950 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v4 exists
I0228 21:16:46.055953 56169 cli_runner.go:111] Run: docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}},{{$first := true}} "ContainerIPs": [{{range $k,$v := .Containers }}{{if $first}}{{$first = false}}{{else}}, {{end}}"{{$v.IPv4Address}}"{{end}}]}"
I0228 21:16:46.055968 56169 cache.go:82] cache image "gcr.io/k8s-minikube/storage-provisioner:v4" -> "/home/guengoer_hakan/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v4" took 3.719082ms
I0228 21:16:46.055981 56169 cache.go:66] save to tar file gcr.io/k8s-minikube/storage-provisioner:v4 -> /home/guengoer_hakan/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v4 succeeded
I0228 21:16:46.052274 56169 cache.go:93] acquiring lock: {Name:mkb1e1ddaa0c0a18e76d41fef6be014c3ded90d1 Clock:{} Delay:500ms Timeout:10m0s Cancel:}
I0228 21:16:46.056096 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.1.0 exists
I0228 21:16:46.056258 56169 cache.go:82] cache image "k8s.gcr.io/kube-apiserver:v1.20.2" -> "/home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.2" took 4.083477ms
I0228 21:16:46.056274 56169 cache.go:66] save to tar file k8s.gcr.io/kube-apiserver:v1.20.2 -> /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.2 succeeded
I0228 21:16:46.052149 56169 cache.go:93] acquiring lock: {Name:mkfed6515850fe8084214bc8585132f20e8cad1b Clock:{} Delay:500ms Timeout:10m0s Cancel:}
I0228 21:16:46.056366 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.2 exists
I0228 21:16:46.056381 56169 cache.go:82] cache image "k8s.gcr.io/kube-controller-manager:v1.20.2" -> "/home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.2" took 4.232224ms
I0228 21:16:46.056392 56169 cache.go:66] save to tar file k8s.gcr.io/kube-controller-manager:v1.20.2 -> /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.2 succeeded
I0228 21:16:46.056403 56169 cache.go:73] Successfully saved all images to host disk.
W0228 21:16:46.083785 56169 cli_runner.go:149] docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}},{{$first := true}} "ContainerIPs": [{{range $k,$v := .Containers }}{{if $first}}{{$first = false}}{{else}}, {{end}}"{{$v.IPv4Address}}"{{end}}]}" returned with exit code 1
I0228 21:16:46.083882 56169 network_create.go:249] running [docker network inspect minikube] to gather additional debugging logs...
I0228 21:16:46.083905 56169 cli_runner.go:111] Run: docker network inspect minikube
W0228 21:16:46.111375 56169 cli_runner.go:149] docker network inspect minikube returned with exit code 1
I0228 21:16:46.111428 56169 network_create.go:252] error running [docker network inspect minikube]: docker network inspect minikube: exit status 1
stdout:
[]

stderr:
Error: No such network: minikube
I0228 21:16:46.111450 56169 network_create.go:254] output of [docker network inspect minikube]: -- stdout --
[]

** /stderr **
I0228 21:16:46.111506 56169 cli_runner.go:111] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}},{{$first := true}} "ContainerIPs": [{{range $k,$v := .Containers }}{{if $first}}{{$first = false}}{{else}}, {{end}}"{{$v.IPv4Address}}"{{end}}]}"
I0228 21:16:46.139215 56169 network_create.go:104] attempt to create network 192.168.49.0/24 with subnet: minikube and gateway 192.168.49.1 and MTU of 1500 ...
I0228 21:16:46.139309 56169 cli_runner.go:111] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true minikube
/ I0228 21:16:46.241074 56169 kic.go:100] calculated static IP "192.168.49.2" for the "minikube" container
I0228 21:16:46.241167 56169 cli_runner.go:111] Run: docker ps -a --format {{.Names}}

I0228 21:16:46.268397 56169 cli_runner.go:111] Run: docker volume create minikube --label name.minikube.sigs.k8s.io=minikube --label created_by.minikube.sigs.k8s.io=true
I0228 21:16:46.298974 56169 oci.go:102] Successfully created a docker volume minikube
I0228 21:16:46.299094 56169 cli_runner.go:111] Run: docker run --rm --entrypoint /usr/bin/test -v minikube:/var gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e -d /var/lib
/ I0228 21:16:47.368770 56169 cli_runner.go:155] Completed: docker run --rm --entrypoint /usr/bin/test -v minikube:/var gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e -d /var/lib: (1.069626596s)
I0228 21:16:47.368812 56169 oci.go:106] Successfully prepared a docker volume minikube
W0228 21:16:47.368880 56169 oci.go:159] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0228 21:16:47.368947 56169 cli_runner.go:111] Run: docker info --format "'{{json .SecurityOptions}}'"
I0228 21:16:47.369203 56169 preload.go:97] Checking if preload exists for k8s version v1.20.2 and runtime docker
I0228 21:16:47.407139 56169 cli_runner.go:111] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname minikube --name minikube --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=minikube --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=minikube --network minikube --ip 192.168.49.2 --volume minikube:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e
\ I0228 21:16:47.977064 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:16:48.015979 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Status}}
I0228 21:16:48.055132 56169 cli_runner.go:111] Run: docker exec minikube stat /var/lib/dpkg/alternatives/iptables
/ W0228 21:16:48.259735 56169 cli_runner.go:149] docker exec minikube stat /var/lib/dpkg/alternatives/iptables returned with exit code 1
W0228 21:16:48.259781 56169 oci.go:631] error checking if /var/lib/dpkg/alternatives/iptables exists: docker exec minikube stat /var/lib/dpkg/alternatives/iptables: exit status 1
stdout:

stderr:
Error response from daemon: Container de7dfc0d9cf192ab3914a1ca9e74ac40bf8fe51222c8cdf52719a41776da002f is not running
I0228 21:16:48.259804 56169 retry.go:31] will retry after 16.569904ms: iptables file doesn't exist, see #8179

I0228 21:16:48.277522 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:16:48.306754 56169 retry.go:31] will retry after 32.411455ms: temporary error created container "minikube" is not running yet
I0228 21:16:48.340219 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:16:48.369002 56169 retry.go:31] will retry after 39.303902ms: temporary error created container "minikube" is not running yet
\ I0228 21:16:48.408879 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:16:48.437061 56169 retry.go:31] will retry after 47.471781ms: temporary error created container "minikube" is not running yet
| I0228 21:16:48.484884 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:16:48.515153 56169 retry.go:31] will retry after 70.21466ms: temporary error created container "minikube" is not running yet
/ I0228 21:16:48.586150 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:16:48.614550 56169 retry.go:31] will retry after 135.186566ms: temporary error created container "minikube" is not running yet
I0228 21:16:48.750485 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
\ I0228 21:16:48.778919 56169 retry.go:31] will retry after 96.644387ms: temporary error created container "minikube" is not running yet
I0228 21:16:48.876346 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
| I0228 21:16:48.905679 56169 retry.go:31] will retry after 168.258704ms: temporary error created container "minikube" is not running yet
/ I0228 21:16:49.074615 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:16:49.102585 56169 retry.go:31] will retry after 229.495137ms: temporary error created container "minikube" is not running yet
I0228 21:16:49.361014 56169 retry.go:31] will retry after 461.846136ms: temporary error created container "minikube" is not running yet
/ I0228 21:16:49.823025 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:16:49.851571 56169 retry.go:31] will retry after 878.134135ms: temporary error created container "minikube" is not running yet
I0228 21:16:50.730304 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:16:50.758552 56169 retry.go:31] will retry after 1.704399736s: temporary error created container "minikube" is not running yet
\ I0228 21:16:52.464108 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:16:52.492201 56169 retry.go:31] will retry after 1.390096821s: temporary error created container "minikube" is not running yet
/ I0228 21:16:53.883203 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}

I0228 21:16:53.911943 56169 retry.go:31] will retry after 2.570896008s: temporary error created container "minikube" is not running yet
\ I0228 21:16:56.484001 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:16:56.512095 56169 retry.go:31] will retry after 3.58222675s: temporary error created container "minikube" is not running yet
\ I0228 21:17:00.095061 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:17:00.129190 56169 retry.go:31] will retry after 6.364064127s: temporary error created container "minikube" is not running yet
\ I0228 21:17:06.494425 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:17:06.527961 56169 retry.go:31] will retry after 7.71493206s: temporary error created container "minikube" is not running yet
| I0228 21:17:14.243973 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:17:14.276019 56169 cli_runner.go:111] Run: docker inspect minikube
I0228 21:17:14.306412 56169 errors.go:72] Postmortem inspect ("docker inspect minikube"): -- stdout --
[
{
"Id": "de7dfc0d9cf192ab3914a1ca9e74ac40bf8fe51222c8cdf52719a41776da002f",
"Created": "2021-02-28T21:16:47.435866693Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],

  "State": {
      "Status": "exited",
      "Running": false,
      "Paused": false,
      "Restarting": false,
      "OOMKilled": false,
      "Dead": false,
      "Pid": 0,
      "ExitCode": 32,
      "Error": "",
      "StartedAt": "2021-02-28T21:16:47.962284324Z",
      "FinishedAt": "2021-02-28T21:16:48.06325808Z"
  },
  "Image": "sha256:a9b1f16d8ece76c4cdb89a2fe1ad78a7f65d606186e1511566c8e1323663562c",
  "ResolvConfPath": "/home/guengoer_hakan/.local/share/docker/containers/de7dfc0d9cf192ab3914a1ca9e74ac40bf8fe51222c8cdf52719a41776da002f/resolv.conf",
  "HostnamePath": "/home/guengoer_hakan/.local/share/docker/containers/de7dfc0d9cf192ab3914a1ca9e74ac40bf8fe51222c8cdf52719a41776da002f/hostname",
  "HostsPath": "/home/guengoer_hakan/.local/share/docker/containers/de7dfc0d9cf192ab3914a1ca9e74ac40bf8fe51222c8cdf52719a41776da002f/hosts",
  "LogPath": "/home/guengoer_hakan/.local/share/docker/containers/de7dfc0d9cf192ab3914a1ca9e74ac40bf8fe51222c8cdf52719a41776da002f/de7dfc0d9cf192ab3914a1ca9e74ac40bf8fe51222c8cdf52719a41776da002f-json.log",
  "Name": "/minikube",
  "RestartCount": 0,
  "Driver": "fuse-overlayfs",
  "Platform": "linux",
  "MountLabel": "",
  "ProcessLabel": "",
  "AppArmorProfile": "",
  "ExecIDs": null,
  "HostConfig": {
      "Binds": [
          "/lib/modules:/lib/modules:ro",
          "minikube:/var"

                  "HostIp": "127.0.0.1",
                  "HostPort": ""
              }
          ],
          "5000/tcp": [
              {
                  "HostIp": "127.0.0.1",
                  "HostPort": ""
              }
          ],
          "8443/tcp": [
              {
                  "HostIp": "127.0.0.1",
                  "HostPort": ""
              }
          ]
      },
      "RestartPolicy": {
          "Name": "no",
          "MaximumRetryCount": 0
      },
      "AutoRemove": false,
      "VolumeDriver": "",
      "VolumesFrom": null,
      "CapAdd": null,
      "CapDrop": null,
      "CgroupnsMode": "host",
      "Dns": [],
      "DnsOptions": [],
      "DnsSearch": [],
      "ExtraHosts": null,
      "GroupAdd": null,
      "IpcMode": "private",
      "Cgroup": "",
      "Links": null,
      "OomScoreAdj": 0,
      "PidMode": "",
      "Privileged": true,
      "PublishAllPorts": false,
      "ReadonlyRootfs": false,
      "SecurityOpt": [
          "seccomp=unconfined",
          "apparmor=unconfined",
          "label=disable"
      ],
      "Tmpfs": {
          "/run": "",
          "/tmp": ""
      },
      "UTSMode": "",
      "UsernsMode": "",
      "ShmSize": 67108864,
      "Runtime": "runc",
      "ConsoleSize": [
          0,
          0
      ],
      "Isolation": "",
      "CpuShares": 0,
      "Memory": 2306867200,
      "NanoCpus": 2000000000,
      "CgroupParent": "",
      "BlkioWeight": 0,
      "BlkioWeightDevice": [],
      "BlkioDeviceReadBps": null,
      "BlkioDeviceWriteBps": null,
      "BlkioDeviceReadIOps": null,
      "BlkioDeviceWriteIOps": null,
      "CpuPeriod": 0,
      "CpuQuota": 0,
      "CpuRealtimePeriod": 0,
      "CpuRealtimeRuntime": 0,
      "CpusetCpus": "",
      "CpusetMems": "",
      "Devices": [],
      "DeviceCgroupRules": null,
      "DeviceRequests": null,
      "KernelMemory": 0,
      "KernelMemoryTCP": 0,
      "MemoryReservation": 0,
      "MemorySwap": 2306867200,
      "MemorySwappiness": null,
      "OomKillDisable": false,
      "PidsLimit": null,
      "Ulimits": null,
      "CpuCount": 0,
      "CpuPercent": 0,
      "IOMaximumIOps": 0,
      "IOMaximumBandwidth": 0,
      "MaskedPaths": null,
      "ReadonlyPaths": null
  },
  "GraphDriver": {
      "Data": {
          "LowerDir": "/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/711ca0d696f39a7a1d1acf0bdd04e0d3366e16af193fadcf7b3bf877d0caea66-init/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/fff851f0bda4658b64b2a80f3be4311586a837dbdab01f68e3008066bae266f5/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/8c73c628c75115737626867a31ea17f5e8b6593469db76916546e765657cdab5/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/0d54f33aca177c1bd1e31c66ff46a3a630ffdce9dbedfcacc96780cee5b132d9/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/b791b5b37f22c9e698a59ba6f840ffbd185d6c4cd718604e83133efe399fc68a/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/dc2d517a25764b5bfaaeb192d96a632a3f4d01bfb22a38169aaaa851e28bec63/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/0f6a7ef3b7cc372b16715ab94c051cbd7babe67aaa779c1cbdf552759559e16f/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/e48fd6fa5224c7371b4bd828d40634e73ab16b57794c38916f0842168971f098/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/91f571b73c501fb06da8d66c4894929a3b6df6b2025f596090c8c84e259b90b1/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/f3c53e2d68b4e62ac7796b124c5a057a7e622c150f929106b04b2cf5642acb92/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/afdb0832120fa7b6cb8a0531f8cb0d746b4fef2b2a5bf251ba9194e65b215e0f/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/f3c0b96e82a959f9f741813193a719cf13cc8d913177bb032a2bc2a8769b8920/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/e9f03888dcb7909f445785960593fc54970f1f2ae9f372752278ef5d9d134709/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/4d395f64378e7cdbbe452bb435b438c9df62143735a3834599b9f440fcf9bb7e/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/776464a6d5f53d10ae9741e73f1f2eebd03f1a6e74aa4b279f3277f7e6af5936/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/31a9801227d5245e329d92f6a055197eb54bd81e2bc6cfa1da49950f8f0bc033/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/3126a651243a618f15ccdd0ed71c2121d34a6b4931ab6548cf92a385b433fe6f/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/d8ebeffb80268729ebfd998eca5fbb42030529ce91634b162beaea890747c340/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/745f91d3e9e1e346edd401f3c9e62c82319a45388d05a3da27236c081ad16ee8/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/3c6ab343a0025358a2a487b2663756ca57c7635ce2d77197e4871aac1d01978b/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/75837d897e815dbed7556c67014700c41b41d4eb864ee336fdb5ce0d113c5d08/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/9a45436a94ba867e340a8e472de1e1f094074d2b921b0e369752f721c20da7c5/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/429f91f8d9f35f9291cce37038b5b1c7159f90d7a3bc16509743df6327df550e/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/83721ed636785e8d4c64b15285ef33a0ac17cd2b38d12608cfc44a1d612b391a/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/ec8a7ff835f58791a1b965857223d2ade01e9247965fec594012f18522bcf93d/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/ece62d7a3fd9b2ab822b46bab13f4a15dcff5fc9b420199e0a6b07b5b11917ac/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/2720c0dbd495eedf389a453da015102a38bc7482baff1f3e2c756a1940b246d7/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/b4e304a0c23fe5534ead378f75439de8894fc8eb1da996059e6319bdda2551a4/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/f266ec749150baa79b0c3a66b462c870cf5b8142a7ac4d70b0821026138cdcc3/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/d4d19a10e08165b53121729b86321f3a5d3a38cc7a40177327edf217fe180c93/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/3886f3f3e2e30defee9dc97ab33df7d71b8f7efc5c8576bcae07d92814f39bf2/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/4b60677bdbf3c1344f57090a1f9a82f9f6af147be5b8c525bb56357cfd9de9fe/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/ad8c2448cdca6c090cc7457f8736b2344b3c328c23a050460995239f8cee173e/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/6a5eb00a594258f344e7d821c9fab228636bf421d7003f275ee9847ab7b3951e/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/177d7950603a8e83d7762e52bc34e39a40c38f68eeb27fb115037dde115e0176/diff",
          "MergedDir": "/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/711ca0d696f39a7a1d1acf0bdd04e0d3366e16af193fadcf7b3bf877d0caea66/merged",
          "UpperDir": "/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/711ca0d696f39a7a1d1acf0bdd04e0d3366e16af193fadcf7b3bf877d0caea66/diff",
          "WorkDir": "/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/711ca0d696f39a7a1d1acf0bdd04e0d3366e16af193fadcf7b3bf877d0caea66/work"
      },
      "Name": "fuse-overlayfs"
  },
  "Mounts": [
      {
          "Type": "bind",
          "Source": "/lib/modules",
          "Destination": "/lib/modules",
          "Mode": "ro",
          "RW": false,
          "Propagation": "rprivate"
      },
      {
          "Type": "volume",
          "Name": "minikube",
          "Source": "/home/guengoer_hakan/.local/share/docker/volumes/minikube/_data",
          "Destination": "/var",
          "Driver": "local",
          "Mode": "z",
          "RW": true,
          "Propagation": ""
      }
  ],
  "Config": {
      "Hostname": "minikube",
      "Domainname": "",
      "User": "root",
      "AttachStdin": false,
      "AttachStdout": false,
      "AttachStderr": false,
      "ExposedPorts": {
          "22/tcp": {},
          "2376/tcp": {},
          "5000/tcp": {},
          "8443/tcp": {}
      },
      "Tty": true,
      "OpenStdin": false,
      "StdinOnce": false,
      "Env": [
          "container=docker",
          "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
      ],
      "Cmd": null,
      "Image": "gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e",
      "Volumes": null,
      "WorkingDir": "",
      "Entrypoint": [
          "/usr/local/bin/entrypoint",
          "/sbin/init"
      ],
      "OnBuild": null,
      "Labels": {
          "created_by.minikube.sigs.k8s.io": "true",
          "mode.minikube.sigs.k8s.io": "minikube",
          "name.minikube.sigs.k8s.io": "minikube",
          "role.minikube.sigs.k8s.io": ""
      },
      "StopSignal": "SIGRTMIN+3"
  },
  "NetworkSettings": {
      "Bridge": "",
      "SandboxID": "74b9a15d1b2fc78278f40b64a9769714012c5b21c46dc9306b4050398cc5d5fc",
      "HairpinMode": false,
      "LinkLocalIPv6Address": "",
      "LinkLocalIPv6PrefixLen": 0,
      "Ports": {},
      "SandboxKey": "/run/user/1000/docker/netns/74b9a15d1b2f",
      "SecondaryIPAddresses": null,
      "SecondaryIPv6Addresses": null,
      "EndpointID": "",
      "Gateway": "",
      "GlobalIPv6Address": "",
      "GlobalIPv6PrefixLen": 0,
      "IPAddress": "",
      "IPPrefixLen": 0,
      "IPv6Gateway": "",
      "MacAddress": "",
      "Networks": {
          "minikube": {
              "IPAMConfig": {
                  "IPv4Address": "192.168.49.2"
              },
             "Links": null,
              "Aliases": [
                  "de7dfc0d9cf1",
                  "minikube"
              ],
              "NetworkID": "9802cae1d86c9894dc48ca160258dee9d2119fd4e3b27086450b12ccc4ac905f",
              "EndpointID": "",
              "Gateway": "",
              "IPAddress": "",
              "IPPrefixLen": 0,
              "IPv6Gateway": "",
              "GlobalIPv6Address": "",
              "GlobalIPv6PrefixLen": 0,
              "MacAddress": "",
              "DriverOpts": null
          }
      }
  }

}
]

-- /stdout --
I0228 21:17:14.306679 56169 cli_runner.go:111] Run: docker logs --timestamps --details minikube
/ I0228 21:17:14.339249 56169 errors.go:79] Postmortem logs ("docker logs --timestamps --details minikube"): -- stdout --
2021-02-28T21:16:47.970278409Z + configure_proxy
2021-02-28T21:16:47.970316380Z + mkdir -p /etc/systemd/system.conf.d/
2021-02-28T21:16:47.996489453Z + [[ ! -z '' ]]
2021-02-28T21:16:47.996528684Z + cat
2021-02-28T21:16:48.010332364Z + fix_kmsg
2021-02-28T21:16:48.010364667Z + [[ ! -e /dev/kmsg ]]
2021-02-28T21:16:48.010369608Z + [[ -e /dev/console ]]
2021-02-28T21:16:48.010373682Z + echo 'WARN: /dev/kmsg does not exist, symlinking /dev/console'
2021-02-28T21:16:48.010378505Z WARN: /dev/kmsg does not exist, symlinking /dev/console
2021-02-28T21:16:48.010382283Z + ln -s /dev/console /dev/kmsg
2021-02-28T21:16:48.015745973Z + fix_mount
2021-02-28T21:16:48.015777013Z + echo 'INFO: ensuring we can execute mount/umount even with userns-remap'
2021-02-28T21:16:48.015782373Z INFO: ensuring we can execute mount/umount even with userns-remap
2021-02-28T21:16:48.015786719Z ++ which mount
2021-02-28T21:16:48.019486738Z ++ which umount
2021-02-28T21:16:48.019519914Z + chown root:root /usr/bin/mount /usr/bin/umount
2021-02-28T21:16:48.025667960Z ++ which mount
2021-02-28T21:16:48.025727091Z ++ which umount
2021-02-28T21:16:48.031495240Z + chmod -s /usr/bin/mount /usr/bin/umount
2021-02-28T21:16:48.031534748Z +++ which mount
2021-02-28T21:16:48.031540134Z ++ stat -f -c %T /usr/bin/mount
2021-02-28T21:16:48.036392758Z + [[ fuseblk == \a\u\f\s ]]
2021-02-28T21:16:48.036431382Z + echo 'INFO: remounting /sys read-only'
2021-02-28T21:16:48.036436797Z INFO: remounting /sys read-only
2021-02-28T21:16:48.036440663Z + mount -o remount,ro /sys
2021-02-28T21:16:48.044803323Z mount: /sys: permission denied.

-- /stdout --
I0228 21:17:14.339378 56169 cli_runner.go:111] Run: docker system info --format "{{json .}}"
I0228 21:17:14.378839 56169 info.go:253] docker info: {ID:AWIP:MF6E:QS3V:P5EI:ILNT:WXIE:NGOG:IUG4:KIWY:YFFR:3LKH:BH2F Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:1 Driver:fuse-overlayfs DriverStatus:[] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false 89a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=rootless] ProductLicense:Community Engine Warnings:[WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode. WARNING: bridge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:}}
I0228 21:17:14.378940 56169 errors.go:86] postmortem docker info: {ID:AWIP:MF6E:QS3V:P5EI:ILNT:WXIE:NGOG:IUG4:KIWY:YFFR:3LKH:BH2F Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:1 Driver:fuse-overlayfs DriverStatus:[] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:26 OomKillDisable:true NGoroutines:40 SystemTime:2021-02-28 21:17:14.368487819 +0000 UTC LoggingDriver:json-file CgroupDriver:none NEventsListener:0 KernelVersion:4.18.0-240.10.1.el8_3.x86_64 OperatingSystem:CentOS Linux 8 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:3917074432 GenericResources: DockerRootDir:/home/guengoer_hakan/.local/share/docker HTTPProxy: HTTPSProxy: NoProxy: Name:instance-2 Labels:[] ExperimentalBuild:false ServerVersion:20.10.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=rootless] ProductLicense:Community Engine Warnings:[WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode. WARNING: bridge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:}}
I0228 21:17:14.379043 56169 network_create.go:249] running [docker network inspect minikube] to gather additional debugging logs...
I0228 21:17:14.379070 56169 cli_runner.go:111] Run: docker network inspect minikube
I0228 21:17:14.410067 56169 network_create.go:254] output of [docker network inspect minikube]: -- stdout --
[
{
"Name": "minikube",
"Id": "9802cae1d86c9894dc48ca160258dee9d2119fd4e3b27086450b12ccc4ac905f",
"Created": "2021-02-28T21:16:46.165876875Z",
"Scope": "local",
"Driver": "bridge",
"EnableIPv6": false,
"IPAM": {
"Driver": "default",
"Options": {},
"Config": [
{
"Subnet": "192.168.49.0/24",
"Gateway": "192.168.49.1"
}
]
},
"Internal": false,
"Attachable": false,
"Ingress": false,
"ConfigFrom": {
"Network": ""
},
"ConfigOnly": false,
"Containers": {},
"Options": {
"--icc": "",
"--ip-masq": "",
"com.docker.network.driver.mtu": "1500"
},
"Labels": {
"created_by.minikube.sigs.k8s.io": "true"
}
}
]

-- /stdout --
I0228 21:17:14.410168 56169 cli_runner.go:111] Run: docker system info --format "{{json .}}"

I0228 21:17:14.449807 56169 info.go:253] docker info: {ID:AWIP:MF6E:QS3V:P5EI:ILNT:WXIE:NGOG:IUG4:KIWY:YFFR:3LKH:BH2F Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:1 Driver:fuse-overlayfs DriverStatus:[] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:26 OomKillDisable:true NGoroutines:40 SystemTime:2021-02-28 21:17:14.437806473 +0000 UTC LoggingDriver:json-file CgroupDriver:none NEventsListener:0 KernelVersion:4.18.0-240.10.1.el8_3.x86_64 OperatingSystem:CentOS Linux 8 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:3917074432 GenericResources: DockerRootDir:/home/guengoer_hakan/.local/share/docker HTTPProxy: HTTPSProxy: NoProxy: Name:instance-2 Labels:[] ExperimentalBuild:false ServerVersion:20.10.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=rootless] ProductLicense:Community Engine Warnings:[WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode. WARNING: bridge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:}}
I0228 21:17:14.449918 56169 client.go:171] LocalClient.Create took 28.394938101s
I0228 21:17:16.450271 56169 ssh_runner.go:149] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0228 21:17:16.450389 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
W0228 21:17:16.480576 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1
I0228 21:17:16.480717 56169 retry.go:31] will retry after 198.275464ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:

stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil
| I0228 21:17:16.679296 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
W0228 21:17:16.709291 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1
I0228 21:17:16.709395 56169 retry.go:31] will retry after 442.156754ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:

stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil
/ I0228 21:17:17.152416 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
W0228 21:17:17.182974 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1
I0228 21:17:17.183084 56169 retry.go:31] will retry after 404.186092ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:

stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil
/ I0228 21:17:17.588151 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
W0228 21:17:17.618350 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1
I0228 21:17:17.618465 56169 retry.go:31] will retry after 593.313927ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:

stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil
\ I0228 21:17:18.212546 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
W0228 21:17:18.242967 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1
I0228 21:17:18.243089 56169 retry.go:31] will retry after 1.089540387s: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:

stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil

I0228 21:17:19.333651 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
\ W0228 21:17:19.363841 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1
W0228 21:17:19.363990 56169 start.go:257] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:

stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil

W0228 21:17:19.364019 56169 start.go:239] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:

stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil
I0228 21:17:19.364037 56169 start.go:129] duration metric: createHost completed in 33.312430859s
I0228 21:17:19.364068 56169 start.go:80] releasing machines lock for "minikube", held for 33.312564462s
W0228 21:17:19.364104 56169 start.go:377] error starting host: creating host: create: creating: create kic node: container name "minikube": log: 2021-02-28T21:16:48.036431382Z + echo 'INFO: remounting /sys read-only'
2021-02-28T21:16:48.036436797Z INFO: remounting /sys read-only
2021-02-28T21:16:48.036440663Z + mount -o remount,ro /sys
2021-02-28T21:16:48.044803323Z mount: /sys: permission denied.: container exited unexpectedly
I0228 21:17:19.364769 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Status}}
I0228 21:17:19.394688 56169 stop.go:39] StopHost: minikube
W0228 21:17:19.395832 56169 register.go:127] "Stopping" was not found within the registered steps for "Initial Minikube Setup": [Initial Minikube Setup Selecting Driver Downloading Artifacts Starting Node Pulling Base Image Running on Localhost Local OS Release Creating Container Creating VM Running Remotely Preparing Kubernetes Generating certificates Booting control plane Configuring RBAC rules Configuring CNI Configuring Localhost Environment Verifying Kubernetes Enabling Addons Done]
I0228 21:17:19.405165 56169 out.go:119] ✋ Stopping node "minikube" ...

✋ Stopping node "minikube" ...
I0228 21:17:19.405300 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Status}}
I0228 21:17:19.437837 56169 stop.go:79] host is in state Stopped
I0228 21:17:19.437908 56169 main.go:119] libmachine: Stopping "minikube"...
I0228 21:17:19.437962 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Status}}
I0228 21:17:19.468381 56169 stop.go:59] stop err: Machine "minikube" is already stopped.
I0228 21:17:19.468437 56169 stop.go:62] host is already stopped
W0228 21:17:20.468942 56169 register.go:127] "Stopping" was not found within the registered steps for "Initial Minikube Setup": [Initial Minikube Setup Selecting Driver Downloading Artifacts Starting Node Pulling Base Image Running on Localhost Local OS Release Creating Container Creating VM Running Remotely Preparing Kubernetes Generating certificates Booting control plane Configuring RBAC rules Configuring CNI Configuring Localhost Environment Verifying Kubernetes Enabling Addons Done]
I0228 21:17:20.475308 56169 out.go:119] 🔥 Deleting "minikube" in docker ...
🔥 Deleting "minikube" in docker ...
I0228 21:17:20.475420 56169 cli_runner.go:111] Run: docker container inspect -f {{.Id}} minikube
I0228 21:17:20.504773 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Status}}
I0228 21:17:20.534568 56169 cli_runner.go:111] Run: docker exec --privileged -t minikube /bin/bash -c "sudo init 0"
W0228 21:17:20.565116 56169 cli_runner.go:149] docker exec --privileged -t minikube /bin/bash -c "sudo init 0" returned with exit code 1
I0228 21:17:20.565164 56169 oci.go:600] error shutdown minikube: docker exec --privileged -t minikube /bin/bash -c "sudo init 0": exit status 1
stdout:

stderr:
Error response from daemon: Container de7dfc0d9cf192ab3914a1ca9e74ac40bf8fe51222c8cdf52719a41776da002f is not running
I0228 21:17:21.565442 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Status}}
I0228 21:17:21.594788 56169 oci.go:608] container minikube status is Stopped
I0228 21:17:21.594829 56169 oci.go:620] Successfully shutdown container minikube
I0228 21:17:21.594882 56169 cli_runner.go:111] Run: docker rm -f -v minikube
I0228 21:17:21.641806 56169 cli_runner.go:111] Run: docker container inspect -f {{.Id}} minikube
W0228 21:17:21.670243 56169 cli_runner.go:149] docker container inspect -f {{.Id}} minikube returned with exit code 1
I0228 21:17:21.670334 56169 cli_runner.go:111] Run: docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}},{{$first := true}} "ContainerIPs": [{{range $k,$v := .Containers }}{{if $first}}{{$first = false}}{{else}}, {{end}}"{{$v.IPv4Address}}"{{end}}]}"
I0228 21:17:21.703931 56169 cli_runner.go:111] Run: docker network rm minikube
W0228 21:17:21.806767 56169 out.go:181] 🤦 StartHost failed, but will try again: creating host: create: creating: create kic node: container name "minikube": log: 2021-02-28T21:16:48.036431382Z + echo 'INFO: remounting /sys read-only'
2021-02-28T21:16:48.036436797Z INFO: remounting /sys read-only
2021-02-28T21:16:48.036440663Z + mount -o remount,ro /sys
2021-02-28T21:16:48.044803323Z mount: /sys: permission denied.: container exited unexpectedly
🤦 StartHost failed, but will try again: creating host: create: creating: create kic node: container name "minikube": log: 2021-02-28T21:16:48.036431382Z + echo 'INFO: remounting /sys read-only'
2021-02-28T21:16:48.036436797Z INFO: remounting /sys read-only
2021-02-28T21:16:48.036440663Z + mount -o remount,ro /sys
2021-02-28T21:16:48.044803323Z mount: /sys: permission denied.: container exited unexpectedly
I0228 21:17:21.806814 56169 start.go:392] Will try again in 5 seconds ...
I0228 21:17:26.807157 56169 start.go:313] acquiring machines lock for minikube: {Name:mk5bba78214f592a9db33daafb95c5a2882b4ea1 Clock:{} Delay:500ms Timeout:10m0s Cancel:}
I0228 21:17:26.807365 56169 start.go:317] acquired machines lock for "minikube" in 157.453µs
I0228 21:17:26.807387 56169 start.go:89] Provisioning new machine with config: &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.2 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] Network: MultiNodeRequested:false} &{Name: IP: Port:8443 KubernetesVersion:v1.20.2 ControlPlane:true Worker:true}
I0228 21:17:26.807450 56169 start.go:126] createHost starting for "" (driver="docker")
I0228 21:17:26.810945 56169 out.go:140] 🔥 Creating docker container (CPUs=2, Memory=2200MB) ...
🔥 Creating docker container (CPUs=2, Memory=2200MB) ...I0228 21:17:26.811127 56169 start.go:160] libmachine.API.Create for "minikube" (driver="docker")
I0228 21:17:26.811161 56169 client.go:168] LocalClient.Create starting
I0228 21:17:26.811230 56169 main.go:119] libmachine: Reading certificate data from /home/guengoer_hakan/.minikube/certs/ca.pem
I0228 21:17:26.811281 56169 main.go:119] libmachine: Decoding PEM data...
I0228 21:17:26.811301 56169 main.go:119] libmachine: Parsing certificate...
I0228 21:17:26.811431 56169 main.go:119] libmachine: Reading certificate data from /home/guengoer_hakan/.minikube/certs/cert.pem
I0228 21:17:26.811463 56169 main.go:119] libmachine: Decoding PEM data...
I0228 21:17:26.811484 56169 main.go:119] libmachine: Parsing certificate...
I0228 21:17:26.811929 56169 cli_runner.go:111] Run: docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}},{{$first := true}} "ContainerIPs": [{{range $k,$v := .Containers }}{{if $first}}{{$first = false}}{{else}}, {{end}}"{{$v.IPv4Address}}"{{end}}]}"
| W0228 21:17:26.841839 56169 cli_runner.go:149] docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}},{{$first := true}} "ContainerIPs": [{{range $k,$v := .Containers }}{{if $first}}{{$first = false}}{{else}}, {{end}}"{{$v.IPv4Address}}"{{end}}]}" returned with exit code 1
I0228 21:17:26.841928 56169 network_create.go:249] running [docker network inspect minikube] to gather additional debugging logs...
I0228 21:17:26.841955 56169 cli_runner.go:111] Run: docker network inspect minikube
W0228 21:17:26.870480 56169 cli_runner.go:149] docker network inspect minikube returned with exit code 1
I0228 21:17:26.870520 56169 network_create.go:252] error running [docker network inspect minikube]: docker network inspect minikube: exit status 1
stdout:
[]

stderr:
Error: No such network: minikube
I0228 21:17:26.870546 56169 network_create.go:254] output of [docker network inspect minikube]: -- stdout --
[]

-- /stdout --
** stderr **
Error: No such network: minikube

** /stderr **
I0228 21:17:26.870610 56169 cli_runner.go:111] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}},{{$first := true}} "ContainerIPs": [{{range $k,$v := .Containers }}{{if $first}}{{$first = false}}{{else}}, {{end}}"{{$v.IPv4Address}}"{{end}}]}"
I0228 21:17:26.899888 56169 network_create.go:104] attempt to create network 192.168.49.0/24 with subnet: minikube and gateway 192.168.49.1 and MTU of 1500 ...
I0228 21:17:26.900047 56169 cli_runner.go:111] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true minikube
/ I0228 21:17:27.004617 56169 kic.go:100] calculated static IP "192.168.49.2" for the "minikube" container
I0228 21:17:27.004750 56169 cli_runner.go:111] Run: docker ps -a --format {{.Names}}

I0228 21:17:27.033141 56169 cli_runner.go:111] Run: docker volume create minikube --label name.minikube.sigs.k8s.io=minikube --label created_by.minikube.sigs.k8s.io=true
I0228 21:17:27.064600 56169 oci.go:102] Successfully created a docker volume minikube
I0228 21:17:27.064711 56169 cli_runner.go:111] Run: docker run --rm --entrypoint /usr/bin/test -v minikube:/var gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e -d /var/lib
| I0228 21:17:27.690147 56169 oci.go:106] Successfully prepared a docker volume minikube
W0228 21:17:27.690226 56169 oci.go:159] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0228 21:17:27.690291 56169 preload.go:97] Checking if preload exists for k8s version v1.20.2 and runtime docker
I0228 21:17:27.690292 56169 cli_runner.go:111] Run: docker info --format "'{{json .SecurityOptions}}'"
/ I0228 21:17:27.730755 56169 cli_runner.go:111] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname minikube --name minikube --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=minikube --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=minikube --network minikube --ip 192.168.49.2 --volume minikube:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e
\ I0228 21:17:28.389255 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
| I0228 21:17:28.436423 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Status}}
I0228 21:17:28.717846 56169 retry.go:31] will retry after 16.060099ms: temporary error created container "minikube" is not running yet
I0228 21:17:28.734544 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
\ I0228 21:17:28.773594 56169 retry.go:31] will retry after 30.656058ms: temporary error created container "minikube" is not running yet
I0228 21:17:28.805247 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
| I0228 21:17:28.842960 56169 retry.go:31] will retry after 26.767606ms: temporary error created container "minikube" is not running yet
I0228 21:17:28.870799 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:17:28.906816 56169 retry.go:31] will retry after 40.352305ms: temporary error created container "minikube" is not running yet
/ I0228 21:17:28.948399 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:17:28.981299 56169 retry.go:31] will retry after 95.117265ms: temporary error created container "minikube" is not running yet
I0228 21:17:29.077830 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:17:29.118602 56169 retry.go:31] will retry after 80.484181ms: temporary error created container "minikube" is not running yet
\ I0228 21:17:29.200249 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:17:29.236960 56169 retry.go:31] will retry after 233.280287ms: temporary error created container "minikube" is not running yet
I0228 21:17:29.471297 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:17:29.508040 56169 retry.go:31] will retry after 306.706033ms: temporary error created container "minikube" is not running yet
/ I0228 21:17:29.815867 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:17:29.854344 56169 retry.go:31] will retry after 393.590919ms: temporary error created container "minikube" is not running yet
I0228 21:17:30.249012 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:17:30.284722 56169 retry.go:31] will retry after 304.646178ms: temporary error created container "minikube" is not running yet
/ I0228 21:17:30.590483 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:17:30.624821 56169 retry.go:31] will retry after 569.437886ms: temporary error created container "minikube" is not running yet
\ I0228 21:17:31.194953 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:17:31.232573 56169 retry.go:31] will retry after 1.436620784s: temporary error created container "minikube" is not running yet
I0228 21:17:32.669837 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:17:32.703351 56169 retry.go:31] will retry after 2.871107953s: temporary error created container "minikube" is not running yet
I0228 21:17:35.575187 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
\ I0228 21:17:35.603981 56169 retry.go:31] will retry after 1.691594669s: temporary error created container "minikube" is not running yet
\ I0228 21:17:37.295842 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
| I0228 21:17:37.330352 56169 retry.go:31] will retry after 4.794099941s: temporary error created container "minikube" is not running yet
| I0228 21:17:42.125124 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:17:42.159959 56169 retry.go:31] will retry after 3.672532743s: temporary error created container "minikube" is not running yet
| I0228 21:17:45.833279 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
/ I0228 21:17:45.863345 56169 retry.go:31] will retry after 11.744556342s: temporary error created container "minikube" is not running yet
I0228 21:17:57.608632 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Running}}
I0228 21:17:57.640084 56169 cli_runner.go:111] Run: docker inspect minikube
I0228 21:17:57.668699 56169 errors.go:72] Postmortem inspect ("docker inspect minikube"): -- stdout --
[
{
"Id": "8874db9d7a76a8188223b05db31cf8307b84124c63e82845e31a748f46ec782b",
"Created": "2021-02-28T21:17:27.760686799Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "exited",
"Running": false,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 0,
"ExitCode": 32,
"Error": "",
"StartedAt": "2021-02-28T21:17:28.369925778Z",
"FinishedAt": "2021-02-28T21:17:28.455955323Z"
},
"Image": "sha256:a9b1f16d8ece76c4cdb89a2fe1ad78a7f65d606186e1511566c8e1323663562c",
"ResolvConfPath": "/home/guengoer_hakan/.local/share/docker/containers/8874db9d7a76a8188223b05db31cf8307b84124c63e82845e31a748f46ec782b/resolv.conf",
"HostnamePath": "/home/guengoer_hakan/.local/share/docker/containers/8874db9d7a76a8188223b05db31cf8307b84124c63e82845e31a748f46ec782b/hostname",
"HostsPath": "/home/guengoer_hakan/.local/share/docker/containers/8874db9d7a76a8188223b05db31cf8307b84124c63e82845e31a748f46ec782b/hosts",
"LogPath": "/home/guengoer_hakan/.local/share/docker/containers/8874db9d7a76a8188223b05db31cf8307b84124c63e82845e31a748f46ec782b/8874db9d7a76a8188223b05db31cf8307b84124c63e82845e31a748f46ec782b-json.log",
"Name": "/minikube",
"RestartCount": 0,
"Driver": "fuse-overlayfs",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"minikube:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "minikube",
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/d0fbe600f939f86269a1ba08b5f2b8ad18ab7e180d74e36ddbc4e7f467adc149-init/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/fff851f0bda4658b64b2a80f3be4311586a837dbdab01f68e3008066bae266f5/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/8c73c628c75115737626867a31ea17f5e8b6593469db76916546e765657cdab5/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/0d54f33aca177c1bd1e31c66ff46a3a630ffdce9dbedfcacc96780cee5b132d9/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/b791b5b37f22c9e698a59ba6f840ffbd185d6c4cd718604e83133efe399fc68a/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/dc2d517a25764b5bfaaeb192d96a632a3f4d01bfb22a38169aaaa851e28bec63/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/0f6a7ef3b7cc372b16715ab94c051cbd7babe67aaa779c1cbdf552759559e16f/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/e48fd6fa5224c7371b4bd828d40634e73ab16b57794c38916f0842168971f098/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/91f571b73c501fb06da8d66c4894929a3b6df6b2025f596090c8c84e259b90b1/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/f3c53e2d68b4e62ac7796b124c5a057a7e622c150f929106b04b2cf5642acb92/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/afdb0832120fa7b6cb8a0531f8cb0d746b4fef2b2a5bf251ba9194e65b215e0f/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/f3c0b96e82a959f9f741813193a719cf13cc8d913177bb032a2bc2a8769b8920/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/e9f03888dcb7909f445785960593fc54970f1f2ae9f372752278ef5d9d134709/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/4d395f64378e7cdbbe452bb435b438c9df62143735a3834599b9f440fcf9bb7e/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/776464a6d5f53d10ae9741e73f1f2eebd03f1a6e74aa4b279f3277f7e6af5936/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/31a9801227d5245e329d92f6a055197eb54bd81e2bc6cfa1da49950f8f0bc033/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/3126a651243a618f15ccdd0ed71c2121d34a6b4931ab6548cf92a385b433fe6f/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/d8ebeffb80268729ebfd998eca5fbb42030529ce91634b162beaea890747c340/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/745f91d3e9e1e346edd401f3c9e62c82319a45388d05a3da27236c081ad16ee8/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/3c6ab343a0025358a2a487b2663756ca57c7635ce2d77197e4871aac1d01978b/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/75837d897e815dbed7556c67014700c41b41d4eb864ee336fdb5ce0d113c5d08/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/9a45436a94ba867e340a8e472de1e1f094074d2b921b0e369752f721c20da7c5/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/429f91f8d9f35f9291cce37038b5b1c7159f90d7a3bc16509743df6327df550e/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/83721ed636785e8d4c64b15285ef33a0ac17cd2b38d12608cfc44a1d612b391a/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/ec8a7ff835f58791a1b965857223d2ade01e9247965fec594012f18522bcf93d/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/ece62d7a3fd9b2ab822b46bab13f4a15dcff5fc9b420199e0a6b07b5b11917ac/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/2720c0dbd495eedf389a453da015102a38bc7482baff1f3e2c756a1940b246d7/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/b4e304a0c23fe5534ead378f75439de8894fc8eb1da996059e6319bdda2551a4/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/f266ec749150baa79b0c3a66b462c870cf5b8142a7ac4d70b0821026138cdcc3/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/d4d19a10e08165b53121729b86321f3a5d3a38cc7a40177327edf217fe180c93/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/3886f3f3e2e30defee9dc97ab33df7d71b8f7efc5c8576bcae07d92814f39bf2/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/4b60677bdbf3c1344f57090a1f9a82f9f6af147be5b8c525bb56357cfd9de9fe/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/ad8c2448cdca6c090cc7457f8736b2344b3c328c23a050460995239f8cee173e/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/6a5eb00a594258f344e7d821c9fab228636bf421d7003f275ee9847ab7b3951e/diff:/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/177d7950603a8e83d7762e52bc34e39a40c38f68eeb27fb115037dde115e0176/diff",
"MergedDir": "/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/d0fbe600f939f86269a1ba08b5f2b8ad18ab7e180d74e36ddbc4e7f467adc149/merged",
"UpperDir": "/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/d0fbe600f939f86269a1ba08b5f2b8ad18ab7e180d74e36ddbc4e7f467adc149/diff",
"WorkDir": "/home/guengoer_hakan/.local/share/docker/fuse-overlayfs/d0fbe600f939f86269a1ba08b5f2b8ad18ab7e180d74e36ddbc4e7f467adc149/work"
},
"Name": "fuse-overlayfs"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "minikube",
"Source": "/home/guengoer_hakan/.local/share/docker/volumes/minikube/_data", "Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "minikube",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker", "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "minikube",
"name.minikube.sigs.k8s.io": "minikube",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "37c3c885436ad31bab1df4fb458f58f5a63e83cbb30492dde2de92d5403116d6",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {},
"SandboxKey": "/run/user/1000/docker/netns/37c3c885436a",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"minikube": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": [
"8874db9d7a76",
"minikube"
],
"NetworkID": "197e2de9a43f8a67e2c4f864743f1dd432acaaa29d716880a8c13eb5cc823bbe",
"EndpointID": "",
"Gateway": "",
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "",
"DriverOpts": null
}
}
}
}
]

-- /stdout --
I0228 21:17:57.669212 56169 cli_runner.go:111] Run: docker logs --timestamps --details minikube
I0228 21:17:57.698097 56169 errors.go:79] Postmortem logs ("docker logs --timestamps --details minikube"): -- stdout --
2021-02-28T21:17:28.377307611Z + configure_proxy
2021-02-28T21:17:28.377362360Z + mkdir -p /etc/systemd/system.conf.d/
2021-02-28T21:17:28.394229808Z + [[ ! -z '' ]]
2021-02-28T21:17:28.394273162Z + cat
2021-02-28T21:17:28.400424616Z + fix_kmsg
2021-02-28T21:17:28.400458091Z + [[ ! -e /dev/kmsg ]]
2021-02-28T21:17:28.400463139Z + [[ -e /dev/console ]]
2021-02-28T21:17:28.400467375Z + echo 'WARN: /dev/kmsg does not exist, symlinking /dev/console'
2021-02-28T21:17:28.400471410Z WARN: /dev/kmsg does not exist, symlinking /dev/console
2021-02-28T21:17:28.400475394Z + ln -s /dev/console /dev/kmsg
2021-02-28T21:17:28.400480216Z + fix_mount
2021-02-28T21:17:28.400483897Z + echo 'INFO: ensuring we can execute mount/umount even with userns-remap'
2021-02-28T21:17:28.400487856Z INFO: ensuring we can execute mount/umount even with userns-remap
2021-02-28T21:17:28.400491371Z ++ which mount
2021-02-28T21:17:28.410252903Z ++ which umount
2021-02-28T21:17:28.410285050Z + chown root:root /usr/bin/mount /usr/bin/umount
2021-02-28T21:17:28.410696747Z ++ which mount
2021-02-28T21:17:28.414971981Z ++ which umount
2021-02-28T21:17:28.424116785Z + chmod -s /usr/bin/mount /usr/bin/umount
2021-02-28T21:17:28.424151785Z +++ which mount
2021-02-28T21:17:28.426501751Z ++ stat -f -c %T /usr/bin/mount
2021-02-28T21:17:28.433159638Z + [[ fuseblk == \a\u\f\s ]]
2021-02-28T21:17:28.433209023Z + echo 'INFO: remounting /sys read-only'
2021-02-28T21:17:28.433214134Z INFO: remounting /sys read-only
2021-02-28T21:17:28.433218084Z + mount -o remount,ro /sys
2021-02-28T21:17:28.446255648Z mount: /sys: permission denied.

-- /stdout --
I0228 21:17:57.698169 56169 cli_runner.go:111] Run: docker system info --format "{{json .}}"
\ I0228 21:17:57.733799 56169 info.go:253] docker info: {ID:AWIP:MF6E:QS3V:P5EI:ILNT:WXIE:NGOG:IUG4:KIWY:YFFR:3LKH:BH2F Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:1 Driver:fuse-overlayfs DriverStatus:[] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:28 OomKillDisable:true NGoroutines:40 SystemTime:2021-02-28 21:17:57.723979946 +0000 UTC LoggingDriver:json-file CgroupDriver:none NEventsListener:0 KernelVersion:4.18.0-240.10.1.el8_3.x86_64 OperatingSystem:CentOS Linux 8 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:3917074432 GenericResources: DockerRootDir:/home/guengoer_hakan/.local/share/docker HTTPProxy: HTTPSProxy: NoProxy: Name:instance-2 Labels:[] ExperimentalBuild:false ServerVersion:20.10.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=rootless] ProductLicense:Community Engine Warnings:[WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode. WARNING: bridge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:}}
I0228 21:17:57.733886 56169 errors.go:86] postmortem docker info: {ID:AWIP:MF6E:QS3V:P5EI:ILNT:WXIE:NGOG:IUG4:KIWY:YFFR:3LKH:BH2F Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:1 Driver:fuse-overlayfs DriverStatus:[] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:28 OomKillDisable:true NGoroutines:40 SystemTime:2021-02-28 21:17:57.723979946 +0000 UTC LoggingDriver:json-file CgroupDriver:none NEventsListener:0 KernelVersion:4.18.0-240.10.1.el8_3.x86_64 OperatingSystem:CentOS Linux 8 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:3917074432 GenericResources: DockerRootDir:/home/guengoer_hakan/.local/share/docker HTTPProxy: HTTPSProxy: NoProxy: Name:instance-2 Labels:[] ExperimentalBuild:false ServerVersion:20.10.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=rootless] ProductLicense:Community Engine Warnings:[WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode. WARNING: bridge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:}}
I0228 21:17:57.733951 56169 network_create.go:249] running [docker network inspect minikube] to gather additional debugging logs...
I0228 21:17:57.733967 56169 cli_runner.go:111] Run: docker network inspect minikube
I0228 21:17:57.761843 56169 network_create.go:254] output of [docker network inspect minikube]: -- stdout --
[
{
"Name": "minikube",
"Id": "197e2de9a43f8a67e2c4f864743f1dd432acaaa29d716880a8c13eb5cc823bbe",
"Created": "2021-02-28T21:17:26.926979098Z",
"Scope": "local",
"Driver": "bridge",
"EnableIPv6": false,
"IPAM": {
"Driver": "default",
"Options": {},
"Config": [
{
"Subnet": "192.168.49.0/24",
"Gateway": "192.168.49.1"
}
]
},
"Internal": false,
"Attachable": false,
"Ingress": false,
"ConfigFrom": {
"Network": ""
},
"ConfigOnly": false,
"Containers": {},
"Options": {
"--icc": "",
"--ip-masq": "",
"com.docker.network.driver.mtu": "1500"
},
"Labels": {
"created_by.minikube.sigs.k8s.io": "true"
}
}
]

-- /stdout --
I0228 21:17:57.761967 56169 cli_runner.go:111] Run: docker system info --format "{{json .}}"
I0228 21:17:57.797141 56169 info.go:253] docker info: {ID:AWIP:MF6E:QS3V:P5EI:ILNT:WXIE:NGOG:IUG4:KIWY:YFFR:3LKH:BH2F Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:1 Driver:fuse-overlayfs DriverStatus:[] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:28 OomKillDisable:true NGoroutines:40 SystemTime:2021-02-28 21:17:57.787785201 +0000 UTC LoggingDriver:json-file CgroupDriver:none NEventsListener:0 KernelVersion:4.18.0-240.10.1.el8_3.x86_64 OperatingSystem:CentOS Linux 8 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:3917074432 GenericResources: DockerRootDir:/home/guengoer_hakan/.local/share/docker HTTPProxy: HTTPSProxy: NoProxy: Name:instance-2 Labels:[] ExperimentalBuild:false ServerVersion:20.10.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=rootless] ProductLicense:Community Engine Warnings:[WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode. WARNING: bridge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:}}
I0228 21:17:57.797234 56169 client.go:171] LocalClient.Create took 30.986064229s
\ I0228 21:17:59.797941 56169 ssh_runner.go:149] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0228 21:17:59.798017 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
| W0228 21:17:59.826452 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1
I0228 21:17:59.826569 56169 retry.go:31] will retry after 200.38067ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:

stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil

I0228 21:18:00.027240 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
W0228 21:18:00.055794 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1
I0228 21:18:00.055914 56169 retry.go:31] will retry after 252.474839ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:

stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil
\ I0228 21:18:00.934603 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
W0228 21:18:00.962752 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1
I0228 21:18:00.962878 56169 retry.go:31] will retry after 881.006265ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:

stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil
| I0228 21:18:01.844259 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
W0228 21:18:01.874127 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1
W0228 21:18:01.874258 56169 start.go:257] error running df -h /var: NewSession: new client: new client: Error creating new ssh host

from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:

stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil

W0228 21:18:01.874280 56169 start.go:239] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1
stdout:

stderr:
Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil
I0228 21:18:01.874298 56169 start.go:129] duration metric: createHost completed in 35.066838501s
I0228 21:18:01.874306 56169 start.go:80] releasing machines lock for "minikube", held for 35.066931043s
W0228 21:18:01.874475 56169 out.go:181] 😿 Failed to start docker container. Running "minikube delete" may fix it: creating host: create: creating: create kic node: container name "minikube": log: 2021-02-28T21:17:28.433209023Z + echo 'INFO: remounting /sys read-only'
2021-02-28T21:17:28.433214134Z INFO: remounting /sys read-only
2021-02-28T21:17:28.433218084Z + mount -o remount,ro /sys
2021-02-28T21:17:28.446255648Z mount: /sys: permission denied.: container exited unexpectedly

😿 Failed to start docker container. Running "minikube delete" may fix it: creating host: create: creating: create kic node: container name "minikube": log: 2021-02-28T21:17:28.433209023Z + echo 'INFO: remounting /sys read-only'
2021-02-28T21:17:28.433214134Z INFO: remounting /sys read-only
2021-02-28T21:17:28.433218084Z + mount -o remount,ro /sys
2021-02-28T21:17:28.446255648Z mount: /sys: permission denied.: container exited unexpectedly
W0228 21:18:01.874520 56169 out.go:181]

W0228 21:18:01.874577 56169 out.go:181] 💢 The minikube docker container exited unexpectedly.
💢 The minikube docker container exited unexpectedly.
I0228 21:18:01.878889 56169 out.go:119] 💡 If you are still interested to make docker driver work. The following suggestions might help you get passed this issue:
💡 If you are still interested to make docker driver work. The following suggestions might help you get passed this issue:
I0228 21:18:01.881320 56169 out.go:119]

    I0228 21:18:01.883698   56169 out.go:119] - Prune unused docker images, volumes, networks and abandoned containers.

                            docker system prune --volumes

Prune unused docker images, volumes, networks and abandoned containers.

                          docker system prune --volumes

I0228 21:18:01.885541 56169 out.go:119]

    I0228 21:18:01.887730   56169 out.go:119] - Restart your docker service

Restart your docker service
I0228 21:18:01.889703 56169 out.go:119]

  I0228 21:18:01.891870   56169 out.go:119] - Delete and recreate minikube cluster
          minikube delete
          minikube start --driver=docker

Delete and recreate minikube cluster
minikube delete
minikube start --driver=docker
I0228 21:18:01.894276 56169 out.go:119]

W0228 21:18:01.894403 56169 out.go:181] ❌ Exiting due to GUEST_PROVISION: Failed to start host: creating host: create: creating: create kic node: container name "minikube": log: 2021-02-28T21:17:28.433209023Z + echo 'INFO: remounting /sys read-only'
2021-02-28T21:17:28.433214134Z INFO: remounting /sys read-only
2021-02-28T21:17:28.433218084Z + mount -o remount,ro /sys
2021-02-28T21:17:28.446255648Z mount: /sys: permission denied.: container exited unexpectedly
❌ Exiting due to GUEST_PROVISION: Failed to start host: creating host: create: creating: create kic node: container name "minikube": log: 2021-02-28T21:17:28.433209023Z + echo 'INFO: remounting /sys read-only'
2021-02-28T21:17:28.433214134Z INFO: remounting /sys read-only
2021-02-28T21:17:28.433218084Z + mount -o remount,ro /sys
2021-02-28T21:17:28.446255648Z mount: /sys: permission denied.: container exited unexpectedly
W0228 21:18:01.894443 56169 out.go:181]

W0228 21:18:01.894475 56169 out.go:181] 😿 If the above advice does not help, please let us know:
😿 If the above advice does not help, please let us know:
W0228 21:18:01.894505 56169 out.go:181] 👉 https://github.com/kubernetes/minikube/issues/new/choose
👉 https://github.com/kubernetes/minikube/issues/new/choose
I0228 21:18:01.898244 56169 out.go:119]

Full output of minikube start command used, if not already included:

Optional: Full output of minikube logs command:

The text was updated successfully, but these errors were encountered:

afbjorklund · 2021-03-01T06:06:59Z

We need to have a better check against trying to run with rootless docker, which is not supported yet.

WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode.

You will need to use the regular (rootful) Docker, if you want to use the current minikube docker driver.

See #9495

afbjorklund · 2021-03-01T06:26:56Z

Note for implementors, it is reflected in the Security Options of the docker info.

Example outputs:

 Security Options:
  apparmor
  seccomp
   Profile: default

 Security Options:
  seccomp
   Profile: default
  rootless

medyagh · 2021-03-15T21:24:39Z

we should add a solution message if Docker is Rootless that the support will come in the future and track this issue
#10836

anyone picking this up as @afbjorklund noted here #10652 (comment)

you will need to add a field to the docker info to detect Security Options rootless
https://github.com/medyagh/minikube/blob/f95d43a2c78070ab10a4e7d134ff2d0952a5ca86/pkg/drivers/kic/oci/info.go#L70

daehyeok · 2021-03-15T21:43:48Z

/assign

afbjorklund added co/docker-driver Issues related to kubernetes in container os/linux kind/support Categorizes issue or PR as a support question. needs-solution-message Issues where where offering a solution for an error would be helpful labels Mar 1, 2021

afbjorklund added the good first issue Denotes an issue ready for a new contributor, according to the "help wanted" guidelines. label Mar 1, 2021

medyagh added priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. and removed kind/support Categorizes issue or PR as a support question. labels Mar 15, 2021

medyagh changed the title ~~Exiting due to GUEST_PROVISION: Failed to start host: creating host: create: creating: create kic node: container name "minikube"~~ Add solution message if Docker is rootless Mar 15, 2021

medyagh added the help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. label Mar 15, 2021

k8s-ci-robot assigned daehyeok Mar 15, 2021

medyagh added the kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. label Mar 16, 2021

daehyeok mentioned this issue Mar 19, 2021

Add solution message if Docker is rootless #10878

Merged

medyagh closed this as completed in #10878 Mar 23, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add solution message if Docker is rootless #10652

Add solution message if Docker is rootless #10652

hakangung commented Feb 28, 2021

afbjorklund commented Mar 1, 2021

afbjorklund commented Mar 1, 2021 •

edited

Loading

medyagh commented Mar 15, 2021 •

edited

Loading

daehyeok commented Mar 15, 2021

Add solution message if Docker is rootless #10652

Add solution message if Docker is rootless #10652

Comments

hakangung commented Feb 28, 2021

afbjorklund commented Mar 1, 2021

afbjorklund commented Mar 1, 2021 • edited Loading

medyagh commented Mar 15, 2021 • edited Loading

daehyeok commented Mar 15, 2021

afbjorklund commented Mar 1, 2021 •

edited

Loading

medyagh commented Mar 15, 2021 •

edited

Loading