Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

minikube start --mount creates empty directory #4440

Closed
marcadella opened this issue Jun 6, 2019 · 8 comments
Closed

minikube start --mount creates empty directory #4440

marcadella opened this issue Jun 6, 2019 · 8 comments
Labels
area/mount cause/go9p-limitation Issues related to our go9p implementation triage/duplicate Indicates an issue is a duplicate of other open issue. triage/needs-information Indicates an issue needs more information in order to work on it.

Comments

@marcadella
Copy link

marcadella commented Jun 6, 2019 •
edited
Loading

The exact command to reproduce the issue:
minikube start --mount-string /my/packages:/data/packages --mount

The full output of the command that failed:
Minikube starts and it prints Creating mount /my/packages:/data/packages,
but when ssh'ing minikube (via minikube ssh) then ls into /data/packages, I can see that the directory is empty (of course /my/packages is not empty).

The output of the minikube logs command:

==> coredns <==
.:53
2019-06-06T13:42:18.675Z [INFO] CoreDNS-1.3.1
2019-06-06T13:42:18.675Z [INFO] linux/amd64, go1.11.4, 6b56a9c
CoreDNS-1.3.1
linux/amd64, go1.11.4, 6b56a9c
2019-06-06T13:42:18.675Z [INFO] plugin/reload: Running configuration MD5 = 599b9eb76b8c147408aed6a0bbe0f669

==> dmesg <==
[  +5.005520] hpet1: lost 319 rtc interrupts
[  +5.005704] hpet1: lost 318 rtc interrupts
[  +5.005710] hpet1: lost 319 rtc interrupts
[  +5.006582] hpet1: lost 318 rtc interrupts
[  +5.005782] hpet1: lost 318 rtc interrupts
[  +5.005506] hpet1: lost 319 rtc interrupts
[  +5.005578] hpet1: lost 318 rtc interrupts
[  +5.005947] hpet1: lost 318 rtc interrupts
[Jun 6 13:45] hpet1: lost 319 rtc interrupts
[  +0.871005] 9pnet: p9_fd_create_tcp (5256): problem connecting socket to 192.168.99.1
[  +4.134543] hpet1: lost 318 rtc interrupts
[  +5.005946] hpet1: lost 319 rtc interrupts
[  +5.005532] hpet1: lost 318 rtc interrupts
[  +5.006804] hpet1: lost 318 rtc interrupts
[  +5.005649] hpet1: lost 319 rtc interrupts
[  +5.005573] hpet1: lost 318 rtc interrupts
[  +5.005929] hpet1: lost 318 rtc interrupts
[  +5.005651] hpet1: lost 319 rtc interrupts
[  +5.005769] hpet1: lost 318 rtc interrupts
[  +5.005499] hpet1: lost 319 rtc interrupts
[  +5.005703] hpet1: lost 318 rtc interrupts
[Jun 6 13:46] hpet1: lost 318 rtc interrupts
[  +5.005523] hpet1: lost 319 rtc interrupts
[  +5.006262] hpet1: lost 318 rtc interrupts
[  +5.002987] hpet1: lost 318 rtc interrupts
[  +5.005429] hpet1: lost 319 rtc interrupts
[  +5.002817] hpet1: lost 318 rtc interrupts
[  +5.005474] hpet1: lost 319 rtc interrupts
[  +5.005633] hpet1: lost 318 rtc interrupts
[  +5.005556] hpet1: lost 319 rtc interrupts
[  +5.005648] hpet1: lost 318 rtc interrupts
[  +5.005578] hpet1: lost 319 rtc interrupts
[  +5.006315] hpet1: lost 318 rtc interrupts
[Jun 6 13:47] hpet1: lost 318 rtc interrupts
[  +5.005648] hpet1: lost 319 rtc interrupts
[  +5.001931] hpet1: lost 318 rtc interrupts
[  +5.007738] hpet1: lost 318 rtc interrupts
[  +5.001164] hpet1: lost 318 rtc interrupts
[  +5.004450] hpet1: lost 319 rtc interrupts
[  +5.005522] hpet1: lost 318 rtc interrupts
[  +5.004036] hpet1: lost 318 rtc interrupts
[  +5.003011] hpet1: lost 318 rtc interrupts
[  +4.999672] hpet1: lost 318 rtc interrupts
[  +4.999890] hpet1: lost 318 rtc interrupts
[  +5.002444] hpet1: lost 319 rtc interrupts
[Jun 6 13:48] hpet1: lost 318 rtc interrupts
[  +5.003271] hpet1: lost 318 rtc interrupts
[  +5.003343] hpet1: lost 318 rtc interrupts
[  +5.005597] hpet1: lost 319 rtc interrupts
[  +5.004153] hpet1: lost 318 rtc interrupts

==> kernel <==
 13:48:23 up 9 min,  0 users,  load average: 0.37, 0.86, 0.66
Linux minikube 4.15.0 #1 SMP Thu Apr 25 20:51:48 UTC 2019 x86_64 GNU/Linux

==> kube-addon-manager <==
error: no objects passed to apply
storaerror: no objects passed togeclas apply
s.storage.k8s.io/standard cerror: no objects passed to apply
reated
error: no objects passed to apply
error: no objects passed to apply
INFO:error: no objects passed to apply
e == Kubernetes addon ensure completed at 2019-06-06T13:42:23+00:00 ==
INFO: == Reconciling with deprecated label ==
INFO: == Reconciling with addon-manager label ==
serrror: no objects passed to apply
viceaccount/storage-provisioner created
pod/storage-provisioner created
INFO: == Kubernetes addon reconcile completed at 2019-06-06T13:42:27+00:00 ==
INFO: Leader is minikube
INFO: == Kubernetes addon ensure completed at 2019-06-06T13:43:00+00:00 ==
INFO: == Reconciling with deprecated label ==
INFO: == Reconciling with addon-manager label ==
serviceaccount/storage-provisioner unchanged
INFO: == Kubernetes addon reconcile completed at 2019-06-06T13:43:03+00:00 ==
INFO: Leader is minikube
INFO: == Kubernetes addon ensure completed at 2019-06-06T13:43:59+00:00 ==
INFO: == Reconciling with deprecated label ==
INFO: == Reconciling with addon-manager label ==
serviceaccount/storage-provisioner unchanged
INFO: == Kubernetes addon reconcile completed at 2019-06-06T13:44:02+00:00 ==
INFO: Leader is minikube
INFO: == Kubernetes addon ensure completed at 2019-06-06T13:45:00+00:00 ==
INFO: == Reconciling with deprecated label ==
INFO: == Reconciling with addon-manager label ==
serviceaccount/storage-provisioner unchanged
INFO: == Kubernetes addon reconcile completed at 2019-06-06T13:45:02+00:00 ==
INFO: Leader is minikube
INFO: == Kubernetes addon ensure completed at 2019-06-06T13:46:00+00:00 ==
INFO: == Reconciling with deprecated label ==
INFO: == Reconciling with addon-manager label ==
serviceaccount/storage-provisioner unchanged
INFO: == Kubernetes addon reconcile completed at 2019-06-06T13:46:02+00:00 ==
INFO: Leader is minikube
INFO: == Kubernetes addon ensure completed at 2019-06-06T13:47:00+00:00 ==
INFO: == Reconciling with deprecated label ==
INFO: == Reconciling with addon-manager label ==
serviceaccount/storage-provisioner unchanged
INFO: == Kubernetes addon reconcile completed at 2019-06-06T13:47:02+00:00 ==
INFO: Leader is minikube
INFO: == Kubernetes addon ensure completed at 2019-06-06T13:48:00+00:00 ==
INFO: == Reconciling with deprecated label ==
INFO: == Reconciling with addon-manager label ==
serviceaccount/storage-provisioner unchanged
INFO: == Kubernetes addon reconcile completed at 2019-06-06T13:48:03+00:00 ==

==> kube-apiserver <==
I0606 13:42:03.738190       1 trace.go:81] Trace[802240459]: "List /api/v1/namespaces/kube-system/pods" (started: 2019-06-06 13:42:02.987787389 +0000 UTC m=+56.241546354) (total time: 750.367777ms):
Trace[802240459]: [750.290743ms] [750.19851ms] Listing from storage done
I0606 13:42:06.575686       1 trace.go:81] Trace[1604623662]: "GuaranteedUpdate etcd3: *core.Endpoints" (started: 2019-06-06 13:42:06.03372903 +0000 UTC m=+59.287488002) (total time: 541.91362ms):
Trace[1604623662]: [541.879227ms] [541.568012ms] Transaction committed
I0606 13:42:06.575980       1 trace.go:81] Trace[900866388]: "Update /api/v1/namespaces/kube-system/endpoints/kube-scheduler" (started: 2019-06-06 13:42:06.033525184 +0000 UTC m=+59.287284149) (total time: 542.412992ms):
Trace[900866388]: [542.211445ms] [542.06495ms] Object stored in database
I0606 13:42:11.923807       1 trace.go:81] Trace[1592101474]: "Get /api/v1/namespaces/kube-system/endpoints/kube-controller-manager" (started: 2019-06-06 13:42:11.357154738 +0000 UTC m=+64.610913702) (total time: 566.612123ms):
Trace[1592101474]: [566.477713ms] [566.414052ms] About to write a response
I0606 13:42:13.568840       1 trace.go:81] Trace[1738923228]: "List /api/v1/namespaces/kube-system/pods" (started: 2019-06-06 13:42:12.987438496 +0000 UTC m=+66.241197464) (total time: 581.371493ms):
Trace[1738923228]: [581.23359ms] [581.12785ms] Listing from storage done
I0606 13:42:16.969431       1 trace.go:81] Trace[1369986079]: "Get /api/v1/nodes/minikube" (started: 2019-06-06 13:42:16.046835265 +0000 UTC m=+69.300594175) (total time: 922.55596ms):
Trace[1369986079]: [921.763444ms] [921.753433ms] About to write a response
I0606 13:42:16.970406       1 trace.go:81] Trace[455901679]: "Create /api/v1/namespaces/kube-system/events" (started: 2019-06-06 13:42:16.260919455 +0000 UTC m=+69.514678392) (total time: 709.45646ms):
Trace[455901679]: [709.328082ms] [709.195529ms] Object stored in database
I0606 13:42:16.973578       1 trace.go:81] Trace[1237972561]: "GuaranteedUpdate etcd3: *core.Node" (started: 2019-06-06 13:42:16.211624436 +0000 UTC m=+69.465383335) (total time: 761.147967ms):
Trace[1237972561]: [761.055249ms] [760.369556ms] Transaction committed
I0606 13:42:16.974434       1 trace.go:81] Trace[958337989]: "Patch /api/v1/nodes/minikube/status" (started: 2019-06-06 13:42:16.211255562 +0000 UTC m=+69.465014453) (total time: 763.15283ms):
Trace[958337989]: [762.695752ms] [761.890946ms] Object stored in database
I0606 13:42:16.976283       1 trace.go:81] Trace[860221853]: "GuaranteedUpdate etcd3: *core.Endpoints" (started: 2019-06-06 13:42:16.259153246 +0000 UTC m=+69.512912236) (total time: 717.095368ms):
Trace[860221853]: [717.066333ms] [714.707528ms] Transaction committed
I0606 13:42:16.976699       1 trace.go:81] Trace[880436926]: "Update /api/v1/namespaces/kube-system/endpoints/kube-controller-manager" (started: 2019-06-06 13:42:16.258999126 +0000 UTC m=+69.512758061) (total time: 717.674714ms):
Trace[880436926]: [717.38579ms] [717.28223ms] Object stored in database
I0606 13:42:17.984622       1 trace.go:81] Trace[91582391]: "GuaranteedUpdate etcd3: *apps.DaemonSet" (started: 2019-06-06 13:42:17.447731866 +0000 UTC m=+70.701490872) (total time: 536.853495ms):
Trace[91582391]: [536.768937ms] [536.225805ms] Transaction committed
I0606 13:42:17.985109       1 trace.go:81] Trace[1990801543]: "Update /apis/apps/v1/namespaces/kube-system/daemonsets/kube-proxy/status" (started: 2019-06-06 13:42:17.447284561 +0000 UTC m=+70.701043497) (total time: 537.798491ms):
Trace[1990801543]: [537.382677ms] [537.067398ms] Object stored in database
I0606 13:42:18.427123       1 trace.go:81] Trace[1673385737]: "Get /api/v1/namespaces/kube-system/endpoints/kube-scheduler" (started: 2019-06-06 13:42:17.588060165 +0000 UTC m=+70.841819097) (total time: 839.025496ms):
Trace[1673385737]: [838.906019ms] [838.843512ms] About to write a response
I0606 13:42:19.039094       1 trace.go:81] Trace[806839718]: "Get /api/v1/namespaces/kube-node-lease" (started: 2019-06-06 13:42:18.43427861 +0000 UTC m=+71.688037543) (total time: 604.782056ms):
Trace[806839718]: [604.693588ms] [604.643162ms] About to write a response
I0606 13:42:19.044436       1 trace.go:81] Trace[1746455746]: "List /api/v1/namespaces/kube-system/pods" (started: 2019-06-06 13:42:18.487082878 +0000 UTC m=+71.740841782) (total time: 557.318804ms):
Trace[1746455746]: [557.158736ms] [557.115767ms] Listing from storage done
I0606 13:42:26.398535       1 trace.go:81] Trace[393852582]: "Get /api/v1/namespaces/kube-system/endpoints/kube-controller-manager" (started: 2019-06-06 13:42:25.839283004 +0000 UTC m=+79.093041937) (total time: 559.213528ms):
Trace[393852582]: [559.063205ms] [559.004246ms] About to write a response
I0606 13:42:29.346436       1 trace.go:81] Trace[812183991]: "GuaranteedUpdate etcd3: *apps.ReplicaSet" (started: 2019-06-06 13:42:28.846252061 +0000 UTC m=+82.100011048) (total time: 500.148678ms):
Trace[812183991]: [500.068334ms] [499.338069ms] Transaction committed
I0606 13:42:29.348035       1 trace.go:81] Trace[1007337403]: "Update /apis/apps/v1/namespaces/kube-system/replicasets/coredns-fb8b8dccf/status" (started: 2019-06-06 13:42:28.846007105 +0000 UTC m=+82.099766040) (total time: 501.998647ms):
Trace[1007337403]: [500.474868ms] [500.302077ms] Object stored in database
I0606 13:42:29.873798       1 trace.go:81] Trace[2116467375]: "Get /api/v1/namespaces/kube-system/endpoints/kube-scheduler" (started: 2019-06-06 13:42:29.238826252 +0000 UTC m=+82.492585224) (total time: 634.931045ms):
Trace[2116467375]: [634.796467ms] [634.729143ms] About to write a response
I0606 13:42:29.875607       1 trace.go:81] Trace[1668568948]: "GuaranteedUpdate etcd3: *apps.Deployment" (started: 2019-06-06 13:42:29.343598557 +0000 UTC m=+82.597357546) (total time: 531.972543ms):
Trace[1668568948]: [531.915515ms] [531.34639ms] Transaction committed
I0606 13:42:29.876377       1 trace.go:81] Trace[2078837660]: "Update /apis/apps/v1/namespaces/kube-system/deployments/coredns/status" (started: 2019-06-06 13:42:29.343291719 +0000 UTC m=+82.597050658) (total time: 533.055857ms):
Trace[2078837660]: [532.397754ms] [532.191042ms] Object stored in database
I0606 13:42:30.229283       1 trace.go:81] Trace[1446437549]: "List /api/v1/namespaces/kube-system/pods" (started: 2019-06-06 13:42:29.488080584 +0000 UTC m=+82.741839550) (total time: 741.167806ms):
Trace[1446437549]: [741.095069ms] [740.956556ms] Listing from storage done
I0606 13:42:33.340721       1 trace.go:81] Trace[830669321]: "GuaranteedUpdate etcd3: *core.Endpoints" (started: 2019-06-06 13:42:32.83468942 +0000 UTC m=+86.088448407) (total time: 505.796195ms):
Trace[830669321]: [505.763695ms] [505.326482ms] Transaction committed
I0606 13:42:33.341036       1 trace.go:81] Trace[1798872360]: "Update /api/v1/namespaces/kube-system/endpoints/kube-controller-manager" (started: 2019-06-06 13:42:32.834109051 +0000 UTC m=+86.087867991) (total time: 506.891894ms):
Trace[1798872360]: [506.660022ms] [506.187712ms] Object stored in database

==> kube-proxy <==
W0606 13:42:16.040595       1 server_others.go:267] Flag proxy-mode="" unknown, assuming iptables proxy
I0606 13:42:16.971699       1 server_others.go:147] Using iptables Proxier.
W0606 13:42:16.972333       1 proxier.go:319] clusterCIDR not specified, unable to distinguish between internal and external traffic
I0606 13:42:16.977086       1 server.go:555] Version: v1.14.1
I0606 13:42:16.992104       1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_max' to 131072
I0606 13:42:16.992290       1 conntrack.go:52] Setting nf_conntrack_max to 131072
I0606 13:42:16.992414       1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
I0606 13:42:16.992531       1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
I0606 13:42:16.992802       1 config.go:102] Starting endpoints config controller
I0606 13:42:16.992841       1 controller_utils.go:1027] Waiting for caches to sync for endpoints config controller
I0606 13:42:16.992884       1 config.go:202] Starting service config controller
I0606 13:42:16.992917       1 controller_utils.go:1027] Waiting for caches to sync for service config controller
I0606 13:42:17.094739       1 controller_utils.go:1034] Caches are synced for service config controller
I0606 13:42:17.094958       1 controller_utils.go:1034] Caches are synced for endpoints config controller

==> kube-scheduler <==
E0606 13:41:28.464209       1 reflector.go:126] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:223: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0606 13:41:28.465906       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0606 13:41:28.467300       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0606 13:41:28.469546       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0606 13:41:28.471286       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0606 13:41:28.472670       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0606 13:41:29.449251       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0606 13:41:29.460703       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0606 13:41:29.463812       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0606 13:41:29.465400       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0606 13:41:29.467231       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0606 13:41:29.467594       1 reflector.go:126] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:223: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0606 13:41:29.469043       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0606 13:41:29.471672       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0606 13:41:29.472527       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0606 13:41:29.473614       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0606 13:41:30.452504       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0606 13:41:30.462592       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0606 13:41:30.466279       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0606 13:41:30.467653       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0606 13:41:30.469299       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0606 13:41:30.470988       1 reflector.go:126] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:223: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0606 13:41:30.472734       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0606 13:41:30.474094       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0606 13:41:30.476793       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0606 13:41:30.477205       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0606 13:41:31.454546       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0606 13:41:31.464975       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0606 13:41:31.467923       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0606 13:41:31.469479       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0606 13:41:31.470999       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0606 13:41:31.472777       1 reflector.go:126] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:223: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0606 13:41:31.475307       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0606 13:41:31.475772       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0606 13:41:31.479253       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0606 13:41:31.480366       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0606 13:41:32.456868       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0606 13:41:32.467281       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0606 13:41:32.470107       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0606 13:41:32.471568       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0606 13:41:32.474047       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0606 13:41:32.475319       1 reflector.go:126] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:223: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0606 13:41:32.477079       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0606 13:41:32.479510       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0606 13:41:32.481964       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0606 13:41:32.484219       1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
I0606 13:41:34.316989       1 controller_utils.go:1027] Waiting for caches to sync for scheduler controller
I0606 13:41:34.417885       1 controller_utils.go:1034] Caches are synced for scheduler controller
I0606 13:41:34.418291       1 leaderelection.go:217] attempting to acquire leader lease  kube-system/kube-scheduler...
I0606 13:41:34.575779       1 leaderelection.go:227] successfully acquired lease kube-system/kube-scheduler

==> kubelet <==
-- Logs begin at Thu 2019-06-06 13:39:22 UTC, end at Thu 2019-06-06 13:48:23 UTC. --
Jun 06 13:41:15 minikube kubelet[3225]: E0606 13:41:15.431843    3225 controller.go:194] failed to get node "minikube" when trying to set owner ref to the node lease: nodes "minikube" not found
Jun 06 13:41:15 minikube kubelet[3225]: E0606 13:41:15.506089    3225 kubelet.go:2244] node "minikube" not found
Jun 06 13:41:15 minikube kubelet[3225]: E0606 13:41:15.606411    3225 kubelet.go:2244] node "minikube" not found
Jun 06 13:41:15 minikube kubelet[3225]: E0606 13:41:15.706678    3225 kubelet.go:2244] node "minikube" not found
Jun 06 13:41:15 minikube kubelet[3225]: E0606 13:41:15.807540    3225 kubelet.go:2244] node "minikube" not found
Jun 06 13:41:15 minikube kubelet[3225]: I0606 13:41:15.820170    3225 kubelet_node_status.go:75] Successfully registered node minikube
Jun 06 13:41:16 minikube kubelet[3225]: E0606 13:41:16.158415    3225 controller.go:115] failed to ensure node lease exists, will retry in 7s, error: namespaces "kube-node-lease" not found
Jun 06 13:41:16 minikube kubelet[3225]: E0606 13:41:16.158654    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb663dceb4b", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"Starting", Message:"Starting kubelet.", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8e775cd4b, ext:798070805, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8e775cd4b, ext:798070805, loc:(*time.Location)(0x800e8e0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:16 minikube kubelet[3225]: E0606 13:41:16.685251    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb66821d44e", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbab64e, ext:869695734, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbab64e, ext:869695734, loc:(*time.Location)(0x800e8e0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:17 minikube kubelet[3225]: E0606 13:41:17.053801    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb668220c58", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbaee58, ext:869710080, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbaee58, ext:869710080, loc:(*time.Location)(0x800e8e0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:17 minikube kubelet[3225]: E0606 13:41:17.582536    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb6682219e7", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbafbe7, ext:869713550, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbafbe7, ext:869713550, loc:(*time.Location)(0x800e8e0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:17 minikube kubelet[3225]: E0606 13:41:17.999678    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb668c7d54e", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeAllocatableEnforced", Message:"Updated Node Allocatable limit across pods", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ec60b74e, ext:880574966, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ec60b74e, ext:880574966, loc:(*time.Location)(0x800e8e0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:18 minikube kubelet[3225]: E0606 13:41:18.449061    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb6682219e7", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbafbe7, ext:869713550, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8edcaae67, ext:904296771, loc:(*time.Location)(0x800e8e0)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:18 minikube kubelet[3225]: E0606 13:41:18.971807    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb66821d44e", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbab64e, ext:869695734, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8edca71ab, ext:904281225, loc:(*time.Location)(0x800e8e0)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:19 minikube kubelet[3225]: E0606 13:41:19.746747    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb668220c58", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbaee58, ext:869710080, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8edca9748, ext:904290852, loc:(*time.Location)(0x800e8e0)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:20 minikube kubelet[3225]: E0606 13:41:20.391493    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb6682219e7", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbafbe7, ext:869713550, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ee1758b2, ext:909321101, loc:(*time.Location)(0x800e8e0)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:21 minikube kubelet[3225]: E0606 13:41:21.229517    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb66821d44e", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbab64e, ext:869695734, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ee170dc3, ext:909301920, loc:(*time.Location)(0x800e8e0)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:22 minikube kubelet[3225]: E0606 13:41:22.000640    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb668220c58", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbaee58, ext:869710080, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ee1742bc, ext:909315481, loc:(*time.Location)(0x800e8e0)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:22 minikube kubelet[3225]: E0606 13:41:22.433326    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb6682219e7", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbafbe7, ext:869713550, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8f4734a91, ext:1016010098, loc:(*time.Location)(0x800e8e0)}}, Count:4, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:23 minikube kubelet[3225]: E0606 13:41:23.607788    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb66821d44e", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbab64e, ext:869695734, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8f47317d3, ext:1015997103, loc:(*time.Location)(0x800e8e0)}}, Count:4, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:24 minikube kubelet[3225]: E0606 13:41:24.858633    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb668220c58", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbaee58, ext:869710080, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8f4733731, ext:1016005133, loc:(*time.Location)(0x800e8e0)}}, Count:4, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:25 minikube kubelet[3225]: E0606 13:41:25.066847    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb66821d44e", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbab64e, ext:869695734, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8f46950d4, ext:1015356376, loc:(*time.Location)(0x800e8e0)}}, Count:5, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:25 minikube kubelet[3225]: E0606 13:41:25.276857    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb668220c58", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbaee58, ext:869710080, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8f46980e4, ext:1015368678, loc:(*time.Location)(0x800e8e0)}}, Count:5, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:25 minikube kubelet[3225]: E0606 13:41:25.571889    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb6682219e7", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbafbe7, ext:869713550, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8f4699ec1, ext:1015376308, loc:(*time.Location)(0x800e8e0)}}, Count:5, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:25 minikube kubelet[3225]: E0606 13:41:25.780767    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb66821d44e", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbab64e, ext:869695734, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8fa5593ca, ext:1114726056, loc:(*time.Location)(0x800e8e0)}}, Count:6, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:25 minikube kubelet[3225]: E0606 13:41:25.849457    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb668220c58", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbaee58, ext:869710080, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8fa55cb01, ext:1114740189, loc:(*time.Location)(0x800e8e0)}}, Count:6, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:26 minikube kubelet[3225]: E0606 13:41:26.140827    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb6682219e7", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbafbe7, ext:869713550, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8fa55df70, ext:1114745420, loc:(*time.Location)(0x800e8e0)}}, Count:6, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:26 minikube kubelet[3225]: E0606 13:41:26.398846    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb6682219e7", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbafbe7, ext:869713550, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d901449f91, ext:1157313646, loc:(*time.Location)(0x800e8e0)}}, Count:7, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:26 minikube kubelet[3225]: E0606 13:41:26.666143    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb66821d44e", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbab64e, ext:869695734, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d9014467be, ext:1157299357, loc:(*time.Location)(0x800e8e0)}}, Count:7, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:27 minikube kubelet[3225]: E0606 13:41:27.058143    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb668220c58", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbaee58, ext:869710080, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d9014489e1, ext:1157308096, loc:(*time.Location)(0x800e8e0)}}, Count:7, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:27 minikube kubelet[3225]: E0606 13:41:27.366339    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb668220c58", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbaee58, ext:869710080, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d90144b4f6, ext:1157319123, loc:(*time.Location)(0x800e8e0)}}, Count:8, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:27 minikube kubelet[3225]: E0606 13:41:27.541997    3225 event.go:191] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.15a59fb66821d44e", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d8ebbab64e, ext:869695734, loc:(*time.Location)(0x800e8e0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf3663d9014492ca, ext:1157310373, loc:(*time.Location)(0x800e8e0)}}, Count:8, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jun 06 13:41:59 minikube kubelet[3225]: I0606 13:41:59.278996    3225 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "config-volume" (UniqueName: "kubernetes.io/configmap/db7037e5-8860-11e9-b794-0800278d9153-config-volume") pod "coredns-fb8b8dccf-b47nv" (UID: "db7037e5-8860-11e9-b794-0800278d9153")
Jun 06 13:41:59 minikube kubelet[3225]: I0606 13:41:59.279719    3225 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "coredns-token-fhh8m" (UniqueName: "kubernetes.io/secret/db7037e5-8860-11e9-b794-0800278d9153-coredns-token-fhh8m") pod "coredns-fb8b8dccf-b47nv" (UID: "db7037e5-8860-11e9-b794-0800278d9153")
Jun 06 13:41:59 minikube kubelet[3225]: I0606 13:41:59.580966    3225 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kube-proxy" (UniqueName: "kubernetes.io/configmap/db715f83-8860-11e9-b794-0800278d9153-kube-proxy") pod "kube-proxy-jrxl5" (UID: "db715f83-8860-11e9-b794-0800278d9153")
Jun 06 13:41:59 minikube kubelet[3225]: I0606 13:41:59.581003    3225 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kube-proxy-token-w4m5k" (UniqueName: "kubernetes.io/secret/db715f83-8860-11e9-b794-0800278d9153-kube-proxy-token-w4m5k") pod "kube-proxy-jrxl5" (UID: "db715f83-8860-11e9-b794-0800278d9153")
Jun 06 13:41:59 minikube kubelet[3225]: I0606 13:41:59.581020    3225 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "xtables-lock" (UniqueName: "kubernetes.io/host-path/db715f83-8860-11e9-b794-0800278d9153-xtables-lock") pod "kube-proxy-jrxl5" (UID: "db715f83-8860-11e9-b794-0800278d9153")
Jun 06 13:41:59 minikube kubelet[3225]: I0606 13:41:59.581033    3225 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "lib-modules" (UniqueName: "kubernetes.io/host-path/db715f83-8860-11e9-b794-0800278d9153-lib-modules") pod "kube-proxy-jrxl5" (UID: "db715f83-8860-11e9-b794-0800278d9153")
Jun 06 13:41:59 minikube kubelet[3225]: I0606 13:41:59.883333    3225 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "coredns-token-fhh8m" (UniqueName: "kubernetes.io/secret/db7211c9-8860-11e9-b794-0800278d9153-coredns-token-fhh8m") pod "coredns-fb8b8dccf-mqswv" (UID: "db7211c9-8860-11e9-b794-0800278d9153")
Jun 06 13:41:59 minikube kubelet[3225]: I0606 13:41:59.883562    3225 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "config-volume" (UniqueName: "kubernetes.io/configmap/db7211c9-8860-11e9-b794-0800278d9153-config-volume") pod "coredns-fb8b8dccf-mqswv" (UID: "db7211c9-8860-11e9-b794-0800278d9153")
Jun 06 13:42:01 minikube kubelet[3225]: E0606 13:42:01.880022    3225 kuberuntime_manager.go:899] PodSandboxStatus of sandbox "1ab9f81c49789e83ffe8b0dc5c31a5a616605559b8537e0b36d300d5b2c703cd" for pod "kube-proxy-jrxl5_kube-system(db715f83-8860-11e9-b794-0800278d9153)" error: rpc error: code = Unknown desc = Error: No such container: 1ab9f81c49789e83ffe8b0dc5c31a5a616605559b8537e0b36d300d5b2c703cd
Jun 06 13:42:01 minikube kubelet[3225]: E0606 13:42:01.882158    3225 kuberuntime_manager.go:899] PodSandboxStatus of sandbox "16fa72e3f55df9812acae64918e0edaf5c945bcb538a87e6963c71cee6158fbc" for pod "coredns-fb8b8dccf-b47nv_kube-system(db7037e5-8860-11e9-b794-0800278d9153)" error: rpc error: code = Unknown desc = Error: No such container: 16fa72e3f55df9812acae64918e0edaf5c945bcb538a87e6963c71cee6158fbc
Jun 06 13:42:12 minikube kubelet[3225]: W0606 13:42:12.392527    3225 pod_container_deletor.go:75] Container "16fa72e3f55df9812acae64918e0edaf5c945bcb538a87e6963c71cee6158fbc" not found in pod's containers
Jun 06 13:42:13 minikube kubelet[3225]: W0606 13:42:13.571018    3225 pod_container_deletor.go:75] Container "96759aed1f0dce8aea2a847a348f027b5d4c0033464c48cc00829434aee4fb74" not found in pod's containers
Jun 06 13:42:16 minikube kubelet[3225]: W0606 13:42:16.030689    3225 pod_container_deletor.go:75] Container "1ab9f81c49789e83ffe8b0dc5c31a5a616605559b8537e0b36d300d5b2c703cd" not found in pod's containers
Jun 06 13:42:26 minikube kubelet[3225]: E0606 13:42:26.491294    3225 reflector.go:126] object-"kube-system"/"storage-provisioner-token-6dqp2": Failed to list *v1.Secret: secrets "storage-provisioner-token-6dqp2" is forbidden: User "system:node:minikube" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node "minikube" and this object
Jun 06 13:42:26 minikube kubelet[3225]: I0606 13:42:26.503446    3225 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "tmp" (UniqueName: "kubernetes.io/host-path/eb6dfe09-8860-11e9-b794-0800278d9153-tmp") pod "storage-provisioner" (UID: "eb6dfe09-8860-11e9-b794-0800278d9153")
Jun 06 13:42:26 minikube kubelet[3225]: I0606 13:42:26.503512    3225 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "storage-provisioner-token-6dqp2" (UniqueName: "kubernetes.io/secret/eb6dfe09-8860-11e9-b794-0800278d9153-storage-provisioner-token-6dqp2") pod "storage-provisioner" (UID: "eb6dfe09-8860-11e9-b794-0800278d9153")
Jun 06 13:42:28 minikube kubelet[3225]: E0606 13:42:28.965180    3225 kuberuntime_manager.go:899] PodSandboxStatus of sandbox "f6e2b262a75ab5ed374e4b3c9beddc0cd72c054b0e07ed0aaac496ad43090fa7" for pod "storage-provisioner_kube-system(eb6dfe09-8860-11e9-b794-0800278d9153)" error: rpc error: code = Unknown desc = Error: No such container: f6e2b262a75ab5ed374e4b3c9beddc0cd72c054b0e07ed0aaac496ad43090fa7
Jun 06 13:42:32 minikube kubelet[3225]: W0606 13:42:32.487464    3225 pod_container_deletor.go:75] Container "f6e2b262a75ab5ed374e4b3c9beddc0cd72c054b0e07ed0aaac496ad43090fa7" not found in pod's containers

==> storage-provisioner <==

The operating system version:
Using minikube v1.0.1
OS:
NAME="Ubuntu"
VERSION="18.04.2 LTS (Bionic Beaver)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 18.04.2 LTS"
VERSION_ID="18.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=bionic
UBUNTU_CODENAME=bionic
@sharifelgamal sharifelgamal added priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. area/mount labels Jun 6, 2019
@sharifelgamal sharifelgamal added this to the v1.2.0 milestone Jun 6, 2019
@Doqnach
Copy link

Doqnach commented Jun 7, 2019

In my case, nothing is created at all. Does work using the minikube mount command though.

MacOS, hyperkit, minikube v1.1.0

@marcadella
Copy link
Author

For my part, I get the same issue using minikube mount (empty directory).

@Doqnach
Copy link

Doqnach commented Jun 7, 2019

When work starts on this, my feature request would be that mounts would become something you can manage (minikube mount list, minikube unmount or minikube mount remove) and it not requiring the session to stay open. Also being able to configure a profile to mount certain paths on minikube start would be lovely.

@fenglixa
Copy link
Contributor

Strange, Cannot reproduce this issue with same steps as logged, everything works as expected (refer to below picture)
image

@Doqnach
Copy link

Doqnach commented Jun 14, 2019

I can't tell what vm-driver the OP is using, but in my case the problem is with hyperkit.

@fenglixa fenglixa mentioned this issue Jun 26, 2019
Closed
6 tasks
@tstromberg tstromberg modified the milestones: v1.2.0, v1.3.0-candidate Jul 12, 2019
@tstromberg tstromberg removed priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. labels Jul 12, 2019
@tstromberg
Copy link
Contributor

The good news here is that mount implementation is driver independent. The bad news is that the underlying server used isn't so great.

Any chance this directory has many (>600) files?

@tstromberg tstromberg added cause/go9p-limitation Issues related to our go9p implementation triage/needs-information Indicates an issue needs more information in order to work on it. labels Jul 16, 2019
@Doqnach
Copy link

Doqnach commented Jul 17, 2019 •
edited
Loading

In my case it's PHP projects with composer packages. So 600 is something that is easy to reach (current subproject has 6000+ already, including cache files etc: find . -type f | wc -l).

@tstromberg
Copy link
Contributor

This issue appears to be a duplicate of #2481, so I will close this one so that we may centralize the content relating to the issue. I think the root cause for this may actually be #1753, based on the file count.

If you feel that this issue is not in fact a duplicate, please feel free to re-open it. If you have additional information to share, please add it to the new issue.

Thank you for reporting this!

@tstromberg tstromberg added the triage/duplicate Indicates an issue is a duplicate of other open issue. label Jul 18, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/mount cause/go9p-limitation Issues related to our go9p implementation triage/duplicate Indicates an issue is a duplicate of other open issue. triage/needs-information Indicates an issue needs more information in order to work on it.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@tstromberg @fenglixa @sharifelgamal @Doqnach @marcadella