kubeadm on version 1.29.1 with upload-certs times out during the configMap POST #3022

meezaan · 2024-02-13T09:01:07Z

What keywords did you search in kubeadm issues before filing this one?

kubeadm init upload-certs failure, kubadm init configmap timeout, kubeadm init client-side throttling

I found an existing issue, but it is closed. I've also commented there: kubernetes/kubernetes#112411.

Is this a BUG REPORT or FEATURE REQUEST?

Choose one: BUG REPORT

On a new Debian 12 bare metal server, I'm trying to bootstrap a cluster with kubeadm 1.29.1. If I pass --upload-certs, I get the timeout error. If I don't pass it, everything works fine.

Here is what I run:

kubeadm init --control-plane-endpoint "k8scp.examle.com" --node-name "nod1.example.com" --service-dns-domain "domain.local" --pod-network-cidr "10.1.0.0/16" --upload-certs -v=8.

When it tries to post the configMap, it times out with:

I0213 09:49:00.619292   61821 request.go:629] Waited for 108.199735ms due to client-side throttling, not priority and fairness, request: POST:https://k8scp.examle.com:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s
I0213 09:49:00.619367   61821 round_trippers.go:463] POST https://k8scp.examle.com:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s
I0213 09:49:00.619372   61821 round_trippers.go:469] Request Headers:
I0213 09:49:00.619379   61821 round_trippers.go:473]     Accept: application/json, */*
I0213 09:49:00.619384   61821 round_trippers.go:473]     Content-Type: application/json
I0213 09:49:00.619389   61821 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 09:49:10.620347   61821 round_trippers.go:574] Response Status: 504 Gateway Timeout in 10000 milliseconds
I0213 09:49:10.620371   61821 round_trippers.go:577] Response Headers:
I0213 09:49:10.620382   61821 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 09:49:10.620391   61821 round_trippers.go:580]     Content-Type: text/plain; charset=utf-8
I0213 09:49:10.620402   61821 round_trippers.go:580]     Content-Length: 152
I0213 09:49:10.620412   61821 round_trippers.go:580]     Date: Tue, 13 Feb 2024 08:49:10 GMT
I0213 09:49:10.620421   61821 round_trippers.go:580]     Audit-Id: 3a55b4fc-07e1-42f5-9a20-d7a1bb0a5fe8
I0213 09:49:10.620448   61821 request.go:1212] Response Body: {"metadata":{},"status":"Failure","message":"Timeout: request did not complete within the allotted timeout","reason":"Timeout","details":{},"code":504}
the server was unable to return a response in the time allotted, but may still be processing the request (post configmaps)
unable to create ConfigMap

Everything before it works fine (all the api calls succeed and return and HTTP 201). What's interesting is that there's no waiting taking place for 10 seconds. All this happens in a handful of seconds (it's a 6 core machine, so everything's pretty fast).

Versions

kubectl version
Client Version: v1.29.1
Kustomize Version: v5.0.4-0.20230601165947-6ce0bf390ce3
The connection to the server localhost:8080 was refused - did you specify the right host or port?
kubeadm version
kubeadm version: &version.Info{Major:"1", Minor:"29", GitVersion:"v1.29.1", GitCommit:"bc401b91f2782410b3fb3f9acf43a995c4de90d2", GitTreeState:"clean", BuildDate:"2024-01-17T15:49:02Z", GoVersion:"go1.21.6", Compiler:"gc", Platform:"linux/amd64"}
systemctl --version
systemd 252 (252.22-1~deb12u1)
+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified

Environment:

Kubernetes version (use kubectl version): 1.29.1
Cloud provider or hardware configuration: AMD Ryzen 5 3600 Hexacore CPU, 64 GB RAM, 512 NVMe SSD
OS (e.g. from /etc/os-release): Debian 12 (bookworm)
Kernel (e.g. uname -a): Linux 6.1.0-13-amd64 kubeadm join on slave node fails preflight checks #1 SMP PREEMPT_DYNAMIC Debian 6.1.55-1 (2023-09-29) x86_64 GNU/Linux
Container runtime (CRI) (e.g. containerd, cri-o): containerd
Container networking plugin (CNI) (e.g. Calico, Cilium): Not installed yet
Others:

What happened?

See above, but I get:

I0213 09:49:00.619292   61821 request.go:629] Waited for 108.199735ms due to client-side throttling, not priority and fairness, request: POST:https://k8scp.examle.com:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s
I0213 09:49:00.619367   61821 round_trippers.go:463] POST https://k8scp.examle.com:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s
I0213 09:49:00.619372   61821 round_trippers.go:469] Request Headers:
I0213 09:49:00.619379   61821 round_trippers.go:473]     Accept: application/json, */*
I0213 09:49:00.619384   61821 round_trippers.go:473]     Content-Type: application/json
I0213 09:49:00.619389   61821 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 09:49:10.620347   61821 round_trippers.go:574] Response Status: 504 Gateway Timeout in 10000 milliseconds
I0213 09:49:10.620371   61821 round_trippers.go:577] Response Headers:
I0213 09:49:10.620382   61821 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 09:49:10.620391   61821 round_trippers.go:580]     Content-Type: text/plain; charset=utf-8
I0213 09:49:10.620402   61821 round_trippers.go:580]     Content-Length: 152
I0213 09:49:10.620412   61821 round_trippers.go:580]     Date: Tue, 13 Feb 2024 08:49:10 GMT
I0213 09:49:10.620421   61821 round_trippers.go:580]     Audit-Id: 3a55b4fc-07e1-42f5-9a20-d7a1bb0a5fe8
I0213 09:49:10.620448   61821 request.go:1212] Response Body: {"metadata":{},"status":"Failure","message":"Timeout: request did not complete within the allotted timeout","reason":"Timeout","details":{},"code":504}
the server was unable to return a response in the time allotted, but may still be processing the request (post configmaps)
unable to create ConfigMap

when I pass --upload-certs to kubeadm init.

What you expected to happen?

That the cluster for bootstrap like it does when I don't pass --upload-certs.

How to reproduce it (as minimally and precisely as possible)?

Install kubeadm and all the basic stuff on https://kubernetes.io/docs/setup/production-environment/tools/kubeadm/install-kubeadm/.

Then run kubeadm init --upload-certs.

Anything else we need to know?

The problem is exactly the same as kubernetes/kubernetes#112411, although I don't think systemd is the problem.

The text was updated successfully, but these errors were encountered:

neolit123 · 2024-02-13T09:16:10Z

can you show the full output this command, you can make it --v=5

kubeadm init --control-plane-endpoint "k8scp.examle.com" --node-name "nod1.example.com" --service-dns-domain "domain.local" --pod-network-cidr "10.1.0.0/16" --upload-certs -v=8.

neolit123 · 2024-02-13T09:19:20Z

I0213 09:49:10.620448 61821 request.go:1212] Response Body: {"metadata":{},"status":"Failure","message":"Timeout: request did not complete within the allotted timeout","reason":"Timeout","details":{},"code":504}
the server was unable to return a response in the time allotted, but may still be processing the request (post configmaps)
unable to create ConfigMap

in the past we have seen users complain that a single API call fails for them. but that's a problem on the host, for example the kube-apiserver restarted exactly at that moment.

That the cluster for bootstrap like it does when I don't pass --upload-certs.

and what happens if you just call kubeadm init, does it finish?
yon can then call kubeadm init phase upload-certs --upload-certs on demand.

neolit123 · 2024-02-13T09:22:10Z

POST:https://k8scp.examle.com:6443

this is just a host alias? do other API calls succeed reaching the server trough this, or only the upload-certs API calls fail?

meezaan · 2024-02-13T09:38:47Z

I0213 09:49:10.620448 61821 request.go:1212] Response Body: {"metadata":{},"status":"Failure","message":"Timeout: request did not complete within the allotted timeout","reason":"Timeout","details":{},"code":504}
the server was unable to return a response in the time allotted, but may still be processing the request (post configmaps)
unable to create ConfigMap

in the past we have seen users complain that a single API call fails for them. but that's a problem on the host, for example the kube-apiserver restarted exactly at that moment.

That the cluster for bootstrap like it does when I don't pass --upload-certs.

and what happens if you just call kubeadm init, does it finish? yon can then call kubeadm init phase upload-certs --upload-certs on demand.

Yes, I've stated this in the issue too. Without --upload-certs it completes bootstrapping the cluster successfully.

meezaan · 2024-02-13T09:40:18Z

POST:https://k8scp.examle.com:6443

this is just a host alias? do other API calls succeed reaching the server trough this, or only the upload-certs API calls fail?

Yes, it's just an FQDN pointing at the server and resolves fine.

Also, only the upload-certs call fails. Everything before it succeeds, so the other calls reach the server fine. Also, a 504 without a proxy in the middle just means the request timed out and the api server returned the 504.

neolit123 · 2024-02-13T09:54:31Z

can you show the full output this command, you can make it --v=5

kubeadm init --control-plane-endpoint "k8scp.examle.com" --node-name "nod1.example.com" --service-dns-domain "domain.local" --pod-network-cidr "10.1.0.0/16" --upload-certs -v=8.

please share the log

meezaan · 2024-02-13T10:02:47Z

Here's the entire dump. I've removed the endpoint FQDN just incase this time
(and anonymised the server name from the logs), but the error is the same:

edited (neolit123) to collapse the log:

root@m1 ~ # kubeadm init --service-dns-domain "organisation.local" --pod-network-cidr "10.1.0.0/16" --upload-certs --v=8
I0213 10:59:05.090051   65860 initconfiguration.go:122] detected and using CRI socket: unix:///var/run/containerd/containerd.sock
I0213 10:59:05.090162   65860 interface.go:432] Looking for default routes with IPv4 addresses
I0213 10:59:05.090169   65860 interface.go:437] Default route transits interface "enp34s0"
I0213 10:59:05.090272   65860 interface.go:209] Interface enp34s0 is up
I0213 10:59:05.090297   65860 interface.go:257] Interface "enp34s0" has 3 addresses :[95.217.118.240/26 2a01:4f9:4a:341c::2/64 fe80::2ef0:5dff:fe0d:dc34/64].
I0213 10:59:05.090305   65860 interface.go:224] Checking addr  95.217.118.240/26.
I0213 10:59:05.090311   65860 interface.go:231] IP found 95.217.118.240
I0213 10:59:05.090321   65860 interface.go:263] Found valid IPv4 address 95.217.118.240 for interface "enp34s0".
I0213 10:59:05.090328   65860 interface.go:443] Found active IP 95.217.118.240
I0213 10:59:05.090339   65860 kubelet.go:196] the value of KubeletConfiguration.cgroupDriver is empty; setting it to "systemd"
I0213 10:59:05.094659   65860 version.go:187] fetching Kubernetes version from URL: https://dl.k8s.io/release/stable-1.txt
[init] Using Kubernetes version: v1.29.1
[preflight] Running pre-flight checks
I0213 10:59:05.391525   65860 checks.go:563] validating Kubernetes and kubeadm version
I0213 10:59:05.391553   65860 checks.go:168] validating if the firewall is enabled and active
I0213 10:59:05.403787   65860 checks.go:203] validating availability of port 6443
I0213 10:59:05.403956   65860 checks.go:203] validating availability of port 10259
I0213 10:59:05.403992   65860 checks.go:203] validating availability of port 10257
I0213 10:59:05.404025   65860 checks.go:280] validating the existence of file /etc/kubernetes/manifests/kube-apiserver.yaml
I0213 10:59:05.404042   65860 checks.go:280] validating the existence of file /etc/kubernetes/manifests/kube-controller-manager.yaml
I0213 10:59:05.404056   65860 checks.go:280] validating the existence of file /etc/kubernetes/manifests/kube-scheduler.yaml
I0213 10:59:05.404068   65860 checks.go:280] validating the existence of file /etc/kubernetes/manifests/etcd.yaml
I0213 10:59:05.404079   65860 checks.go:430] validating if the connectivity type is via proxy or direct
I0213 10:59:05.404099   65860 checks.go:469] validating http connectivity to first IP address in the CIDR
I0213 10:59:05.404119   65860 checks.go:469] validating http connectivity to first IP address in the CIDR
I0213 10:59:05.404134   65860 checks.go:104] validating the container runtime
I0213 10:59:05.420368   65860 checks.go:639] validating whether swap is enabled or not
I0213 10:59:05.420433   65860 checks.go:370] validating the presence of executable crictl
I0213 10:59:05.420462   65860 checks.go:370] validating the presence of executable conntrack
I0213 10:59:05.420481   65860 checks.go:370] validating the presence of executable ip
I0213 10:59:05.420504   65860 checks.go:370] validating the presence of executable iptables
I0213 10:59:05.420525   65860 checks.go:370] validating the presence of executable mount
I0213 10:59:05.420543   65860 checks.go:370] validating the presence of executable nsenter
I0213 10:59:05.420561   65860 checks.go:370] validating the presence of executable ebtables
I0213 10:59:05.420579   65860 checks.go:370] validating the presence of executable ethtool
I0213 10:59:05.420595   65860 checks.go:370] validating the presence of executable socat
I0213 10:59:05.420614   65860 checks.go:370] validating the presence of executable tc
I0213 10:59:05.420630   65860 checks.go:370] validating the presence of executable touch
I0213 10:59:05.420649   65860 checks.go:516] running all checks
I0213 10:59:05.427085   65860 checks.go:401] checking whether the given node name is valid and reachable using net.LookupHost
I0213 10:59:05.452351   65860 checks.go:605] validating kubelet version
I0213 10:59:05.478550   65860 checks.go:130] validating if the "kubelet" service is enabled and active
I0213 10:59:05.487484   65860 checks.go:203] validating availability of port 10250
I0213 10:59:05.487533   65860 checks.go:329] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-iptables
I0213 10:59:05.487556   65860 checks.go:329] validating the contents of file /proc/sys/net/ipv4/ip_forward
I0213 10:59:05.487573   65860 checks.go:203] validating availability of port 2379
I0213 10:59:05.487595   65860 checks.go:203] validating availability of port 2380
I0213 10:59:05.487614   65860 checks.go:243] validating the existence and emptiness of directory /var/lib/etcd
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0213 10:59:05.487693   65860 checks.go:828] using image pull policy: IfNotPresent
I0213 10:59:05.499236   65860 checks.go:846] image exists: registry.k8s.io/kube-apiserver:v1.29.1
I0213 10:59:05.510690   65860 checks.go:846] image exists: registry.k8s.io/kube-controller-manager:v1.29.1
I0213 10:59:05.522243   65860 checks.go:846] image exists: registry.k8s.io/kube-scheduler:v1.29.1
I0213 10:59:05.533431   65860 checks.go:846] image exists: registry.k8s.io/kube-proxy:v1.29.1
I0213 10:59:05.545210   65860 checks.go:846] image exists: registry.k8s.io/coredns/coredns:v1.11.1
I0213 10:59:05.568042   65860 checks.go:846] image exists: registry.k8s.io/pause:3.9
I0213 10:59:05.579177   65860 checks.go:846] image exists: registry.k8s.io/etcd:3.5.10-0
[certs] Using certificateDir folder "/etc/kubernetes/pki"
I0213 10:59:05.579218   65860 certs.go:112] creating a new certificate authority for ca
[certs] Generating "ca" certificate and key
I0213 10:59:05.746882   65860 certs.go:519] validating certificate period for ca certificate
[certs] Generating "apiserver" certificate and key
[certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.organisation.local m1.mycluster.k8s.organisation.net] and IPs [10.96.0.1 95.217.118.240]
[certs] Generating "apiserver-kubelet-client" certificate and key
I0213 10:59:05.879484   65860 certs.go:112] creating a new certificate authority for front-proxy-ca
[certs] Generating "front-proxy-ca" certificate and key
I0213 10:59:05.940270   65860 certs.go:519] validating certificate period for front-proxy-ca certificate
[certs] Generating "front-proxy-client" certificate and key
I0213 10:59:06.054931   65860 certs.go:112] creating a new certificate authority for etcd-ca
[certs] Generating "etcd/ca" certificate and key
I0213 10:59:06.141822   65860 certs.go:519] validating certificate period for etcd/ca certificate
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost m1.mycluster.k8s.organisation.net] and IPs [95.217.118.240 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost m1.mycluster.k8s.organisation.net] and IPs [95.217.118.240 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
I0213 10:59:06.895146   65860 certs.go:78] creating new public/private key files for signing service account users
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0213 10:59:07.332637   65860 kubeconfig.go:112] creating kubeconfig file for admin.conf
[kubeconfig] Writing "admin.conf" kubeconfig file
I0213 10:59:07.432319   65860 kubeconfig.go:112] creating kubeconfig file for super-admin.conf
[kubeconfig] Writing "super-admin.conf" kubeconfig file
I0213 10:59:07.568597   65860 kubeconfig.go:112] creating kubeconfig file for kubelet.conf
[kubeconfig] Writing "kubelet.conf" kubeconfig file
I0213 10:59:07.726925   65860 kubeconfig.go:112] creating kubeconfig file for controller-manager.conf
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0213 10:59:07.791278   65860 kubeconfig.go:112] creating kubeconfig file for scheduler.conf
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0213 10:59:07.948684   65860 local.go:65] [etcd] wrote Static Pod manifest for a local etcd member to "/etc/kubernetes/manifests/etcd.yaml"
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
I0213 10:59:07.948697   65860 manifests.go:102] [control-plane] getting StaticPodSpecs
I0213 10:59:07.948780   65860 certs.go:519] validating certificate period for CA certificate
I0213 10:59:07.948814   65860 manifests.go:128] [control-plane] adding volume "ca-certs" for component "kube-apiserver"
I0213 10:59:07.948819   65860 manifests.go:128] [control-plane] adding volume "etc-ca-certificates" for component "kube-apiserver"
I0213 10:59:07.948824   65860 manifests.go:128] [control-plane] adding volume "k8s-certs" for component "kube-apiserver"
I0213 10:59:07.948828   65860 manifests.go:128] [control-plane] adding volume "usr-local-share-ca-certificates" for component "kube-apiserver"
I0213 10:59:07.948833   65860 manifests.go:128] [control-plane] adding volume "usr-share-ca-certificates" for component "kube-apiserver"
I0213 10:59:07.949339   65860 manifests.go:157] [control-plane] wrote static Pod manifest for component "kube-apiserver" to "/etc/kubernetes/manifests/kube-apiserver.yaml"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
I0213 10:59:07.949347   65860 manifests.go:102] [control-plane] getting StaticPodSpecs
I0213 10:59:07.949437   65860 manifests.go:128] [control-plane] adding volume "ca-certs" for component "kube-controller-manager"
I0213 10:59:07.949443   65860 manifests.go:128] [control-plane] adding volume "etc-ca-certificates" for component "kube-controller-manager"
I0213 10:59:07.949447   65860 manifests.go:128] [control-plane] adding volume "flexvolume-dir" for component "kube-controller-manager"
I0213 10:59:07.949451   65860 manifests.go:128] [control-plane] adding volume "k8s-certs" for component "kube-controller-manager"
I0213 10:59:07.949456   65860 manifests.go:128] [control-plane] adding volume "kubeconfig" for component "kube-controller-manager"
I0213 10:59:07.949461   65860 manifests.go:128] [control-plane] adding volume "usr-local-share-ca-certificates" for component "kube-controller-manager"
I0213 10:59:07.949465   65860 manifests.go:128] [control-plane] adding volume "usr-share-ca-certificates" for component "kube-controller-manager"
I0213 10:59:07.949899   65860 manifests.go:157] [control-plane] wrote static Pod manifest for component "kube-controller-manager" to "/etc/kubernetes/manifests/kube-controller-manager.yaml"
[control-plane] Creating static Pod manifest for "kube-scheduler"
I0213 10:59:07.949907   65860 manifests.go:102] [control-plane] getting StaticPodSpecs
I0213 10:59:07.949991   65860 manifests.go:128] [control-plane] adding volume "kubeconfig" for component "kube-scheduler"
I0213 10:59:07.950252   65860 manifests.go:157] [control-plane] wrote static Pod manifest for component "kube-scheduler" to "/etc/kubernetes/manifests/kube-scheduler.yaml"
I0213 10:59:07.950258   65860 kubelet.go:68] Stopping the kubelet
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
I0213 10:59:08.208937   65860 waitcontrolplane.go:83] [wait-control-plane] Waiting for the API server to be healthy
I0213 10:59:08.209794   65860 loader.go:395] Config loaded from file:  /etc/kubernetes/admin.conf
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0213 10:59:08.211118   65860 round_trippers.go:463] GET https://95.217.118.240:6443/healthz?timeout=10s
I0213 10:59:08.211129   65860 round_trippers.go:469] Request Headers:
I0213 10:59:08.211142   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:08.211152   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:08.211330   65860 round_trippers.go:574] Response Status:  in 0 milliseconds
I0213 10:59:08.211343   65860 round_trippers.go:577] Response Headers:
I0213 10:59:08.712097   65860 round_trippers.go:463] GET https://95.217.118.240:6443/healthz?timeout=10s
I0213 10:59:08.712118   65860 round_trippers.go:469] Request Headers:
I0213 10:59:08.712131   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:08.712143   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:08.712308   65860 round_trippers.go:574] Response Status:  in 0 milliseconds
I0213 10:59:08.712326   65860 round_trippers.go:577] Response Headers:
I0213 10:59:09.212495   65860 round_trippers.go:463] GET https://95.217.118.240:6443/healthz?timeout=10s
I0213 10:59:09.212510   65860 round_trippers.go:469] Request Headers:
I0213 10:59:09.212520   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:09.212528   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:09.212701   65860 round_trippers.go:574] Response Status:  in 0 milliseconds
I0213 10:59:09.212720   65860 round_trippers.go:577] Response Headers:
I0213 10:59:09.712300   65860 round_trippers.go:463] GET https://95.217.118.240:6443/healthz?timeout=10s
I0213 10:59:09.712313   65860 round_trippers.go:469] Request Headers:
I0213 10:59:09.712323   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:09.712330   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:10.279146   65860 round_trippers.go:574] Response Status: 403 Forbidden in 566 milliseconds
I0213 10:59:10.279169   65860 round_trippers.go:577] Response Headers:
I0213 10:59:10.279180   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:10.279188   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:10.279196   65860 round_trippers.go:580]     X-Content-Type-Options: nosniff
I0213 10:59:10.279203   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid:
I0213 10:59:10.279211   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid:
I0213 10:59:10.279218   65860 round_trippers.go:580]     Content-Length: 192
I0213 10:59:10.279226   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:10 GMT
I0213 10:59:10.279233   65860 round_trippers.go:580]     Audit-Id: 7a1a0d7f-6cae-49cc-a70f-fa32be9773ed
I0213 10:59:10.279349   65860 request.go:1212] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"kubernetes-admin\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0213 10:59:10.712023   65860 round_trippers.go:463] GET https://95.217.118.240:6443/healthz?timeout=10s
I0213 10:59:10.712042   65860 round_trippers.go:469] Request Headers:
I0213 10:59:10.712055   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:10.712066   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:10.712788   65860 round_trippers.go:574] Response Status: 403 Forbidden in 0 milliseconds
I0213 10:59:10.712801   65860 round_trippers.go:577] Response Headers:
I0213 10:59:10.712812   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:10.712825   65860 round_trippers.go:580]     X-Content-Type-Options: nosniff
I0213 10:59:10.712835   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d1d6e709-3922-4c7a-863a-605b000fe1a2
I0213 10:59:10.712843   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 644bf8d1-f29a-4287-8bc6-b855e98c99ac
I0213 10:59:10.712855   65860 round_trippers.go:580]     Content-Length: 192
I0213 10:59:10.712863   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:10 GMT
I0213 10:59:10.712871   65860 round_trippers.go:580]     Audit-Id: bc436977-8e73-4f1e-85e0-5ed1f343cb1d
I0213 10:59:10.712879   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:10.712901   65860 request.go:1212] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"kubernetes-admin\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0213 10:59:11.212471   65860 round_trippers.go:463] GET https://95.217.118.240:6443/healthz?timeout=10s
I0213 10:59:11.212488   65860 round_trippers.go:469] Request Headers:
I0213 10:59:11.212499   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:11.212508   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:11.213231   65860 round_trippers.go:574] Response Status: 403 Forbidden in 0 milliseconds
I0213 10:59:11.213247   65860 round_trippers.go:577] Response Headers:
I0213 10:59:11.213256   65860 round_trippers.go:580]     Audit-Id: a653d7ac-3e34-4c0e-bb78-ef0a78de3225
I0213 10:59:11.213264   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:11.213273   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:11.213281   65860 round_trippers.go:580]     X-Content-Type-Options: nosniff
I0213 10:59:11.213289   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d1d6e709-3922-4c7a-863a-605b000fe1a2
I0213 10:59:11.213298   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 644bf8d1-f29a-4287-8bc6-b855e98c99ac
I0213 10:59:11.213306   65860 round_trippers.go:580]     Content-Length: 192
I0213 10:59:11.213315   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:11 GMT
I0213 10:59:11.213332   65860 request.go:1212] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"kubernetes-admin\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0213 10:59:11.712515   65860 round_trippers.go:463] GET https://95.217.118.240:6443/healthz?timeout=10s
I0213 10:59:11.712535   65860 round_trippers.go:469] Request Headers:
I0213 10:59:11.712548   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:11.712565   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:11.713340   65860 round_trippers.go:574] Response Status: 403 Forbidden in 0 milliseconds
I0213 10:59:11.713357   65860 round_trippers.go:577] Response Headers:
I0213 10:59:11.713367   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:11 GMT
I0213 10:59:11.713376   65860 round_trippers.go:580]     Audit-Id: 086232fd-92b2-4302-bbbb-5cb485cb1380
I0213 10:59:11.713385   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:11.713394   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:11.713423   65860 round_trippers.go:580]     X-Content-Type-Options: nosniff
I0213 10:59:11.713443   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d1d6e709-3922-4c7a-863a-605b000fe1a2
I0213 10:59:11.713451   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 644bf8d1-f29a-4287-8bc6-b855e98c99ac
I0213 10:59:11.713460   65860 round_trippers.go:580]     Content-Length: 192
I0213 10:59:11.713497   65860 request.go:1212] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"kubernetes-admin\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0213 10:59:12.211561   65860 round_trippers.go:463] GET https://95.217.118.240:6443/healthz?timeout=10s
I0213 10:59:12.211578   65860 round_trippers.go:469] Request Headers:
I0213 10:59:12.211588   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:12.211596   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:12.212487   65860 round_trippers.go:574] Response Status: 500 Internal Server Error in 0 milliseconds
I0213 10:59:12.212508   65860 round_trippers.go:577] Response Headers:
I0213 10:59:12.212520   65860 round_trippers.go:580]     X-Content-Type-Options: nosniff
I0213 10:59:12.212530   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d1d6e709-3922-4c7a-863a-605b000fe1a2
I0213 10:59:12.212538   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 644bf8d1-f29a-4287-8bc6-b855e98c99ac
I0213 10:59:12.212547   65860 round_trippers.go:580]     Content-Length: 1533
I0213 10:59:12.212555   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:12 GMT
I0213 10:59:12.212564   65860 round_trippers.go:580]     Audit-Id: b3c670b0-be37-4a53-a2f1-d7ca6a7a4f68
I0213 10:59:12.212576   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:12.212584   65860 round_trippers.go:580]     Content-Type: text/plain; charset=utf-8
I0213 10:59:12.212616   65860 request.go:1212] Response Body: [+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy [truncated 509 chars]
I0213 10:59:12.712233   65860 round_trippers.go:463] GET https://95.217.118.240:6443/healthz?timeout=10s
I0213 10:59:12.712252   65860 round_trippers.go:469] Request Headers:
I0213 10:59:12.712263   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:12.712272   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:12.713115   65860 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds
I0213 10:59:12.713135   65860 round_trippers.go:577] Response Headers:
I0213 10:59:12.713144   65860 round_trippers.go:580]     Content-Type: text/plain; charset=utf-8
I0213 10:59:12.713156   65860 round_trippers.go:580]     X-Content-Type-Options: nosniff
I0213 10:59:12.713165   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d1d6e709-3922-4c7a-863a-605b000fe1a2
I0213 10:59:12.713175   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 644bf8d1-f29a-4287-8bc6-b855e98c99ac
I0213 10:59:12.713184   65860 round_trippers.go:580]     Content-Length: 2
I0213 10:59:12.713193   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:12 GMT
I0213 10:59:12.713205   65860 round_trippers.go:580]     Audit-Id: 12fcf242-bb03-4f10-a5f6-03edc39a617a
I0213 10:59:12.713215   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:12.713235   65860 request.go:1212] Response Body: ok
[apiclient] All control plane components are healthy after 4.502227 seconds
I0213 10:59:12.713809   65860 loader.go:395] Config loaded from file:  /etc/kubernetes/admin.conf
I0213 10:59:12.714547   65860 loader.go:395] Config loaded from file:  /etc/kubernetes/super-admin.conf
I0213 10:59:12.715259   65860 kubeconfig.go:606] ensuring that the ClusterRoleBinding for the kubeadm:cluster-admins Group exists
I0213 10:59:12.715408   65860 request.go:1212] Request Body: {"kind":"ClusterRoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:cluster-admins","creationTimestamp":null},"subjects":[{"kind":"Group","name":"kubeadm:cluster-admins"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"ClusterRole","name":"cluster-admin"}}
I0213 10:59:12.715467   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s
I0213 10:59:12.715478   65860 round_trippers.go:469] Request Headers:
I0213 10:59:12.715490   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:12.715500   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:12.715510   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:12.716292   65860 round_trippers.go:574] Response Status: 403 Forbidden in 0 milliseconds
I0213 10:59:12.716305   65860 round_trippers.go:577] Response Headers:
I0213 10:59:12.716317   65860 round_trippers.go:580]     X-Content-Type-Options: nosniff
I0213 10:59:12.716326   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:12.716335   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:12.716347   65860 round_trippers.go:580]     Content-Length: 387
I0213 10:59:12.716355   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:12 GMT
I0213 10:59:12.716364   65860 round_trippers.go:580]     Audit-Id: ea438134-22d4-409f-86fd-a852c593e6c8
I0213 10:59:12.716372   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:12.716380   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:12.716399   65860 request.go:1212] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"clusterrolebindings.rbac.authorization.k8s.io is forbidden: User \"kubernetes-admin\" cannot create resource \"clusterrolebindings\" in API group \"rbac.authorization.k8s.io\" at the cluster scope","reason":"Forbidden","details":{"group":"rbac.authorization.k8s.io","kind":"clusterrolebindings"},"code":403}
I0213 10:59:12.716568   65860 kubeconfig.go:682] creating the ClusterRoleBinding for the kubeadm:cluster-admins Group by using super-admin.conf
I0213 10:59:12.716603   65860 request.go:1212] Request Body: {"kind":"ClusterRoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:cluster-admins","creationTimestamp":null},"subjects":[{"kind":"Group","name":"kubeadm:cluster-admins"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"ClusterRole","name":"cluster-admin"}}
I0213 10:59:12.716645   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s
I0213 10:59:12.716654   65860 round_trippers.go:469] Request Headers:
I0213 10:59:12.716664   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:12.716673   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:12.716682   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:12.734471   65860 round_trippers.go:574] Response Status: 201 Created in 17 milliseconds
I0213 10:59:12.734487   65860 round_trippers.go:577] Response Headers:
I0213 10:59:12.734499   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:12.734509   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: d7098d51-738d-4a51-93d9-d8557a99a63c
I0213 10:59:12.734518   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 644bf8d1-f29a-4287-8bc6-b855e98c99ac
I0213 10:59:12.734527   65860 round_trippers.go:580]     Content-Length: 630
I0213 10:59:12.734536   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:12 GMT
I0213 10:59:12.734545   65860 round_trippers.go:580]     Audit-Id: f9cb170d-e23b-4cbd-8443-ba1c7ed4806c
I0213 10:59:12.734554   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:12.734578   65860 request.go:1212] Response Body: {"kind":"ClusterRoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:cluster-admins","uid":"a69c92ce-bf71-437d-a844-04de55999884","resourceVersion":"249","creationTimestamp":"2024-02-13T09:59:12Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2024-02-13T09:59:12Z","fieldsType":"FieldsV1","fieldsV1":{"f:roleRef":{},"f:subjects":{}}}]},"subjects":[{"kind":"Group","apiGroup":"rbac.authorization.k8s.io","name":"kubeadm:cluster-admins"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"ClusterRole","name":"cluster-admin"}}
I0213 10:59:12.734814   65860 uploadconfig.go:112] [upload-config] Uploading the kubeadm ClusterConfiguration to a ConfigMap
[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0213 10:59:12.735342   65860 request.go:1212] Request Body: {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"kubeadm-config","namespace":"kube-system","creationTimestamp":null},"data":{"ClusterConfiguration":"apiServer:\n  extraArgs:\n    authorization-mode: Node,RBAC\n  timeoutForControlPlane: 4m0s\napiVersion: kubeadm.k8s.io/v1beta3\ncertificatesDir: /etc/kubernetes/pki\nclusterName: kubernetes\ncontrollerManager: {}\ndns: {}\netcd:\n  local:\n    dataDir: /var/lib/etcd\nimageRepository: registry.k8s.io\nkind: ClusterConfiguration\nkubernetesVersion: v1.29.1\nnetworking:\n  dnsDomain: organisation.local\n  podSubnet: 10.1.0.0/16\n  serviceSubnet: 10.96.0.0/12\nscheduler: {}\n"}}
I0213 10:59:12.735392   65860 round_trippers.go:463] POST https://95.217.118.240:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s
I0213 10:59:12.735404   65860 round_trippers.go:469] Request Headers:
I0213 10:59:12.735415   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:12.735425   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:12.735435   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:12.739781   65860 round_trippers.go:574] Response Status: 201 Created in 4 milliseconds
I0213 10:59:12.739794   65860 round_trippers.go:577] Response Headers:
I0213 10:59:12.739803   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:12.739814   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:12.739824   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:12.739833   65860 round_trippers.go:580]     Content-Length: 918
I0213 10:59:12.739841   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:12 GMT
I0213 10:59:12.739850   65860 round_trippers.go:580]     Audit-Id: b0c01373-de7b-46b0-b561-75cfa5dff08d
I0213 10:59:12.739858   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:12.739878   65860 request.go:1212] Response Body: {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"kubeadm-config","namespace":"kube-system","uid":"563373d6-2299-4e55-929a-cc0038568522","resourceVersion":"250","creationTimestamp":"2024-02-13T09:59:12Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time":"2024-02-13T09:59:12Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:ClusterConfiguration":{}}}}]},"data":{"ClusterConfiguration":"apiServer:\n  extraArgs:\n    authorization-mode: Node,RBAC\n  timeoutForControlPlane: 4m0s\napiVersion: kubeadm.k8s.io/v1beta3\ncertificatesDir: /etc/kubernetes/pki\nclusterName: kubernetes\ncontrollerManager: {}\ndns: {}\netcd:\n  local:\n    dataDir: /var/lib/etcd\nimageRepository: registry.k8s.io\nkind: ClusterConfiguration\nkubernetesVersion: v1.29.1\nnetworking:\n  dnsDomain: organisation.local\n  podSubnet: 10.1.0.0/16\n  serviceSubnet: 10.96.0.0/12\nscheduler: {}\n"}}
I0213 10:59:12.740077   65860 request.go:1212] Request Body: {"kind":"Role","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:nodes-kubeadm-config","namespace":"kube-system","creationTimestamp":null},"rules":[{"verbs":["get"],"apiGroups":[""],"resources":["configmaps"],"resourceNames":["kubeadm-config"]}]}
I0213 10:59:12.740127   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s
I0213 10:59:12.740136   65860 round_trippers.go:469] Request Headers:
I0213 10:59:12.740146   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:12.740155   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:12.740165   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:12.744418   65860 round_trippers.go:574] Response Status: 201 Created in 4 milliseconds
I0213 10:59:12.744431   65860 round_trippers.go:577] Response Headers:
I0213 10:59:12.744440   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:12 GMT
I0213 10:59:12.744450   65860 round_trippers.go:580]     Audit-Id: 4f54cad5-fd0b-4a44-bfde-5fae6373da20
I0213 10:59:12.744461   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:12.744470   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:12.744478   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:12.744488   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:12.744497   65860 round_trippers.go:580]     Content-Length: 541
I0213 10:59:12.744541   65860 request.go:1212] Response Body: {"kind":"Role","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:nodes-kubeadm-config","namespace":"kube-system","uid":"e5590289-434b-4d47-a3e2-4d2f6aaafde2","resourceVersion":"251","creationTimestamp":"2024-02-13T09:59:12Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2024-02-13T09:59:12Z","fieldsType":"FieldsV1","fieldsV1":{"f:rules":{}}}]},"rules":[{"verbs":["get"],"apiGroups":[""],"resources":["configmaps"],"resourceNames":["kubeadm-config"]}]}
I0213 10:59:12.744732   65860 request.go:1212] Request Body: {"kind":"RoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:nodes-kubeadm-config","namespace":"kube-system","creationTimestamp":null},"subjects":[{"kind":"Group","name":"system:bootstrappers:kubeadm:default-node-token"},{"kind":"Group","name":"system:nodes"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"Role","name":"kubeadm:nodes-kubeadm-config"}}
I0213 10:59:12.744782   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s
I0213 10:59:12.744790   65860 round_trippers.go:469] Request Headers:
I0213 10:59:12.744800   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:12.744809   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:12.744818   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:12.749013   65860 round_trippers.go:574] Response Status: 201 Created in 4 milliseconds
I0213 10:59:12.749026   65860 round_trippers.go:577] Response Headers:
I0213 10:59:12.749036   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:12.749045   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:12.749057   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:12.749066   65860 round_trippers.go:580]     Content-Length: 766
I0213 10:59:12.749074   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:12 GMT
I0213 10:59:12.749082   65860 round_trippers.go:580]     Audit-Id: 5725df90-a5bb-4e17-aef9-46cd7fb8eb42
I0213 10:59:12.749090   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:12.749111   65860 request.go:1212] Response Body: {"kind":"RoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:nodes-kubeadm-config","namespace":"kube-system","uid":"bfba729a-2aa3-4430-bffb-e464411d678e","resourceVersion":"252","creationTimestamp":"2024-02-13T09:59:12Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2024-02-13T09:59:12Z","fieldsType":"FieldsV1","fieldsV1":{"f:roleRef":{},"f:subjects":{}}}]},"subjects":[{"kind":"Group","apiGroup":"rbac.authorization.k8s.io","name":"system:bootstrappers:kubeadm:default-node-token"},{"kind":"Group","apiGroup":"rbac.authorization.k8s.io","name":"system:nodes"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"Role","name":"kubeadm:nodes-kubeadm-config"}}
I0213 10:59:12.749227   65860 uploadconfig.go:126] [upload-config] Uploading the kubelet component config to a ConfigMap
[kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0213 10:59:12.749678   65860 request.go:1212] Request Body: {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"kubelet-config","namespace":"kube-system","creationTimestamp":null,"annotations":{"kubeadm.kubernetes.io/component-config.hash":"sha256:7e9ddcb004dcda1797ddde742b58dfdae46a3537ba0fc03e24a980dd8fbb15e9"}},"data":{"kubelet":"apiVersion: kubelet.config.k8s.io/v1beta1\nauthentication:\n  anonymous:\n    enabled: false\n  webhook:\n    cacheTTL: 0s\n    enabled: true\n  x509:\n    clientCAFile: /etc/kubernetes/pki/ca.crt\nauthorization:\n  mode: Webhook\n  webhook:\n    cacheAuthorizedTTL: 0s\n    cacheUnauthorizedTTL: 0s\ncgroupDriver: systemd\nclusterDNS:\n- 10.96.0.10\nclusterDomain: organisation.local\ncontainerRuntimeEndpoint: \"\"\ncpuManagerReconcilePeriod: 0s\nevictionPressureTransitionPeriod: 0s\nfileCheckFrequency: 0s\nhealthzBindAddress: 127.0.0.1\nhealthzPort: 10248\nhttpCheckFrequency: 0s\nimageMaximumGCAge: 0s\nimageMinimumGCAge: 0s\nkind: KubeletConfiguration\nlogging:\n  flushFrequency: 0\n  options:\n    json:\n      infoBufferSize: \"0\"\n [truncated 336 chars]
I0213 10:59:12.749726   65860 round_trippers.go:463] POST https://95.217.118.240:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s
I0213 10:59:12.749734   65860 round_trippers.go:469] Request Headers:
I0213 10:59:12.749748   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:12.749758   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:12.749767   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:12.759299   65860 round_trippers.go:574] Response Status: 201 Created in 9 milliseconds
I0213 10:59:12.759323   65860 round_trippers.go:577] Response Headers:
I0213 10:59:12.759334   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:12.759343   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:12.759352   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:12.759362   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:12.759370   65860 round_trippers.go:580]     Content-Length: 1717
I0213 10:59:12.759379   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:12 GMT
I0213 10:59:12.759388   65860 round_trippers.go:580]     Audit-Id: 815f8438-8a99-4e14-b782-709748340f2d
I0213 10:59:12.759421   65860 request.go:1212] Response Body: {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"kubelet-config","namespace":"kube-system","uid":"31485862-7987-437a-a780-a581a78a5933","resourceVersion":"253","creationTimestamp":"2024-02-13T09:59:12Z","annotations":{"kubeadm.kubernetes.io/component-config.hash":"sha256:7e9ddcb004dcda1797ddde742b58dfdae46a3537ba0fc03e24a980dd8fbb15e9"},"managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time":"2024-02-13T09:59:12Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:kubelet":{}},"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kubernetes.io/component-config.hash":{}}}}}]},"data":{"kubelet":"apiVersion: kubelet.config.k8s.io/v1beta1\nauthentication:\n  anonymous:\n    enabled: false\n  webhook:\n    cacheTTL: 0s\n    enabled: true\n  x509:\n    clientCAFile: /etc/kubernetes/pki/ca.crt\nauthorization:\n  mode: Webhook\n  webhook:\n    cacheAuthorizedTTL: 0s\n    cacheUnauthorizedTTL: 0s\ncgroupDriver: systemd\nclusterDNS:\n- 10.96.0.10\nclusterDomain: organisation.local\n [truncated 693 chars]
I0213 10:59:12.759568   65860 request.go:1212] Request Body: {"kind":"Role","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:kubelet-config","namespace":"kube-system","creationTimestamp":null},"rules":[{"verbs":["get"],"apiGroups":[""],"resources":["configmaps"],"resourceNames":["kubelet-config"]}]}
I0213 10:59:12.759615   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s
I0213 10:59:12.759624   65860 round_trippers.go:469] Request Headers:
I0213 10:59:12.759639   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:12.759648   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:12.759658   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:12.763742   65860 round_trippers.go:574] Response Status: 201 Created in 4 milliseconds
I0213 10:59:12.763758   65860 round_trippers.go:577] Response Headers:
I0213 10:59:12.763771   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:12.763783   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:12.763791   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:12.763800   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:12.763809   65860 round_trippers.go:580]     Content-Length: 535
I0213 10:59:12.763817   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:12 GMT
I0213 10:59:12.763826   65860 round_trippers.go:580]     Audit-Id: cd9d7287-ecb0-4b73-aa86-242b56d0c34f
I0213 10:59:12.763848   65860 request.go:1212] Response Body: {"kind":"Role","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:kubelet-config","namespace":"kube-system","uid":"797eb560-e791-47c8-8b98-2dac307ae35e","resourceVersion":"254","creationTimestamp":"2024-02-13T09:59:12Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2024-02-13T09:59:12Z","fieldsType":"FieldsV1","fieldsV1":{"f:rules":{}}}]},"rules":[{"verbs":["get"],"apiGroups":[""],"resources":["configmaps"],"resourceNames":["kubelet-config"]}]}
I0213 10:59:12.763960   65860 request.go:1212] Request Body: {"kind":"RoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:kubelet-config","namespace":"kube-system","creationTimestamp":null},"subjects":[{"kind":"Group","name":"system:nodes"},{"kind":"Group","name":"system:bootstrappers:kubeadm:default-node-token"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"Role","name":"kubeadm:kubelet-config"}}
I0213 10:59:12.764011   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s
I0213 10:59:12.764020   65860 round_trippers.go:469] Request Headers:
I0213 10:59:12.764030   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:12.764040   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:12.764049   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:12.768163   65860 round_trippers.go:574] Response Status: 201 Created in 4 milliseconds
I0213 10:59:12.768176   65860 round_trippers.go:577] Response Headers:
I0213 10:59:12.768190   65860 round_trippers.go:580]     Audit-Id: 693d26a7-7dd3-450a-9a52-33c77719885b
I0213 10:59:12.768200   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:12.768208   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:12.768217   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:12.768226   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:12.768235   65860 round_trippers.go:580]     Content-Length: 754
I0213 10:59:12.768244   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:12 GMT
I0213 10:59:12.768269   65860 request.go:1212] Response Body: {"kind":"RoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:kubelet-config","namespace":"kube-system","uid":"ed09fa62-41ff-4f2b-be3c-8574e9b73cb2","resourceVersion":"255","creationTimestamp":"2024-02-13T09:59:12Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2024-02-13T09:59:12Z","fieldsType":"FieldsV1","fieldsV1":{"f:roleRef":{},"f:subjects":{}}}]},"subjects":[{"kind":"Group","apiGroup":"rbac.authorization.k8s.io","name":"system:nodes"},{"kind":"Group","apiGroup":"rbac.authorization.k8s.io","name":"system:bootstrappers:kubeadm:default-node-token"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"Role","name":"kubeadm:kubelet-config"}}
I0213 10:59:12.768354   65860 uploadconfig.go:131] [upload-config] Preserving the CRISocket information for the control-plane node
I0213 10:59:12.768365   65860 patchnode.go:31] [patchnode] Uploading the CRI Socket information "unix:///var/run/containerd/containerd.sock" to the Node API object "m1.mycluster.k8s.organisation.net" as an annotation
I0213 10:59:13.269113   65860 round_trippers.go:463] GET https://95.217.118.240:6443/api/v1/nodes/m1.mycluster.k8s.organisation.net?timeout=10s
I0213 10:59:13.269133   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.269145   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.269155   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.270775   65860 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0213 10:59:13.270796   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.270808   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.270819   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.270829   65860 round_trippers.go:580]     Audit-Id: a187cde2-1eb6-4686-8f58-74d7d9a2857b
I0213 10:59:13.270839   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.270851   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.270861   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.270941   65860 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"m1.mycluster.k8s.organisation.net","uid":"46c18260-16e3-4271-9efa-ba92bc7ba160","resourceVersion":"19","creationTimestamp":"2024-02-13T09:59:10Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"m1.mycluster.k8s.organisation.net","kubernetes.io/os":"linux"},"annotations":{"volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2024-02-13T09:59:10Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2024-02-13T09:59:10Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{"f:conditions":{ [truncated 3571 chars]
I0213 10:59:13.272321   65860 request.go:1212] Request Body: {"metadata":{"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/containerd/containerd.sock"}}}
I0213 10:59:13.272379   65860 round_trippers.go:463] PATCH https://95.217.118.240:6443/api/v1/nodes/m1.mycluster.k8s.organisation.net?timeout=10s
I0213 10:59:13.272389   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.272401   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.272414   65860 round_trippers.go:473]     Content-Type: application/strategic-merge-patch+json
I0213 10:59:13.272427   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.283214   65860 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds
I0213 10:59:13.283243   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.283254   65860 round_trippers.go:580]     Audit-Id: b62c7632-ea2c-4169-99bb-7d62233a40dd
I0213 10:59:13.283265   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.283274   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.283282   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.283293   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.283304   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.283417   65860 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"m1.mycluster.k8s.organisation.net","uid":"46c18260-16e3-4271-9efa-ba92bc7ba160","resourceVersion":"260","creationTimestamp":"2024-02-13T09:59:10Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"m1.mycluster.k8s.organisation.net","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/containerd/containerd.sock","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2024-02-13T09:59:10Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time": [truncated 3865 chars]
[upload-certs] Storing the certificates in Secret "kubeadm-certs" in the "kube-system" Namespace
I0213 10:59:13.283884   65860 round_trippers.go:463] GET https://95.217.118.240:6443/api/v1/namespaces/kube-system/secrets/bootstrap-token-11m78u?timeout=10s
I0213 10:59:13.283893   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.283903   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.283916   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.285244   65860 round_trippers.go:574] Response Status: 404 Not Found in 1 milliseconds
I0213 10:59:13.285261   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.285271   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.285280   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.285290   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.285300   65860 round_trippers.go:580]     Content-Length: 218
I0213 10:59:13.285308   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.285317   65860 round_trippers.go:580]     Audit-Id: 5cf52b37-42c8-4c50-8e47-7a2ea2762b4f
I0213 10:59:13.285326   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.285346   65860 request.go:1212] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"secrets \"bootstrap-token-11m78u\" not found","reason":"NotFound","details":{"name":"bootstrap-token-11m78u","kind":"secrets"},"code":404}
I0213 10:59:13.285487   65860 request.go:1212] Request Body: {"kind":"Secret","apiVersion":"v1","metadata":{"name":"bootstrap-token-11m78u","namespace":"kube-system","creationTimestamp":null},"data":{"description":"UHJveHkgZm9yIG1hbmFnaW5nIFRUTCBmb3IgdGhlIGt1YmVhZG0tY2VydHMgc2VjcmV0","expiration":"MjAyNC0wMi0xM1QxMTo1OToxM1o=","token-id":"MTFtNzh1","token-secret":"eDRqd3lvbnhpMzl2YWU4Mw=="},"type":"bootstrap.kubernetes.io/token"}
I0213 10:59:13.285534   65860 round_trippers.go:463] POST https://95.217.118.240:6443/api/v1/namespaces/kube-system/secrets?timeout=10s
I0213 10:59:13.285542   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.285551   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.285561   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.285570   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:13.290155   65860 round_trippers.go:574] Response Status: 201 Created in 4 milliseconds
I0213 10:59:13.290169   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.290179   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.290188   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.290196   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.290205   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.290214   65860 round_trippers.go:580]     Content-Length: 709
I0213 10:59:13.290222   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.290231   65860 round_trippers.go:580]     Audit-Id: 912ff26d-cef8-4b22-b101-0190cbec65e7
I0213 10:59:13.290256   65860 request.go:1212] Response Body: {"kind":"Secret","apiVersion":"v1","metadata":{"name":"bootstrap-token-11m78u","namespace":"kube-system","uid":"2c28d774-c3ef-48b9-9e65-7b5cf07af6c1","resourceVersion":"261","creationTimestamp":"2024-02-13T09:59:13Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time":"2024-02-13T09:59:13Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:description":{},"f:expiration":{},"f:token-id":{},"f:token-secret":{}},"f:type":{}}}]},"data":{"description":"UHJveHkgZm9yIG1hbmFnaW5nIFRUTCBmb3IgdGhlIGt1YmVhZG0tY2VydHMgc2VjcmV0","expiration":"MjAyNC0wMi0xM1QxMTo1OToxM1o=","token-id":"MTFtNzh1","token-secret":"eDRqd3lvbnhpMzl2YWU4Mw=="},"type":"bootstrap.kubernetes.io/token"}
I0213 10:59:13.290613   65860 round_trippers.go:463] GET https://95.217.118.240:6443/api/v1/namespaces/kube-system/secrets/bootstrap-token-11m78u?timeout=10s
I0213 10:59:13.290624   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.290634   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.290644   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.291856   65860 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0213 10:59:13.291871   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.291881   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.291890   65860 round_trippers.go:580]     Audit-Id: 2bf0b189-d410-4854-9a73-8ba5106a4356
I0213 10:59:13.291900   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.291909   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.291918   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.291927   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.291936   65860 round_trippers.go:580]     Content-Length: 709
I0213 10:59:13.291959   65860 request.go:1212] Response Body: {"kind":"Secret","apiVersion":"v1","metadata":{"name":"bootstrap-token-11m78u","namespace":"kube-system","uid":"2c28d774-c3ef-48b9-9e65-7b5cf07af6c1","resourceVersion":"261","creationTimestamp":"2024-02-13T09:59:13Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time":"2024-02-13T09:59:13Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:description":{},"f:expiration":{},"f:token-id":{},"f:token-secret":{}},"f:type":{}}}]},"data":{"description":"UHJveHkgZm9yIG1hbmFnaW5nIFRUTCBmb3IgdGhlIGt1YmVhZG0tY2VydHMgc2VjcmV0","expiration":"MjAyNC0wMi0xM1QxMTo1OToxM1o=","token-id":"MTFtNzh1","token-secret":"eDRqd3lvbnhpMzl2YWU4Mw=="},"type":"bootstrap.kubernetes.io/token"}
I0213 10:59:13.292146   65860 request.go:1212] Request Body: {"kind":"Secret","apiVersion":"v1","metadata":{"name":"kubeadm-certs","namespace":"kube-system","creationTimestamp":null,"ownerReferences":[{"apiVersion":"v1","kind":"Secret","name":"bootstrap-token-11m78u","uid":"2c28d774-c3ef-48b9-9e65-7b5cf07af6c1","controller":true,"blockOwnerDeletion":true}]},"data":{"ca.crt":"OO8a62Nu9ZTAMdIXza8sHKr2Xr0ttXAYGQX67iGbXGq6pgu2fiLr1HW4192tjda0g344REkNXj8+JVDBfVZznoPFTbX1a9x6VrfC5l5xMHb42Y0VAR5s8492i9nAUkB3b42HiOUEMqLfCafzuwOG7dS2WSrA9MM6NfG2DluP6h0f369DGp/W0IzaKn6UUNgYA4lEo5uQ/vv2GNeBnurRcrnyW8vWT9hhGo9hr2Pm2yidlvUu4HN2bPrfmt3KmFRgSr6qR05eutAlPh6bUAHTq0j4BJX1jnCh5wFJ6CRnd96ADRknBKNzbenQYvxx4FkB9ugbpioDIvxusAaykKPy/wFafV100SBg8fz5uvRuXTe6Lou8WB+aJtnJx8CthHK8kek3cTvgmPw2M5Xe0DaH4kaDN2d9XusK4g45O7lve51Dk7Y0O3pWsnjCeLaVRv0oa+c2mhaDYdh3wZzYPaa5E6Jve+nl72FyaTr2FdtFldOJYzdaVH3cJhgLMusgnYpbik2qgoqUhk7fgmxOERy+6NUFcpfCyiLiqraA7PwuTPkxg3UBzE1JusOWNjWt2TeG9PmuzQyxsMTUHaMVZfIDzw4+eRUVLBEiHDUSrNNn6t+DJbewbhYBM7MinNVzcb8p8iZRt6jkep7q+R0/mHJEJxsgYApVBXebmcgTGSaPmlAUNgJNtq27ENFsgvNKyQylBRa [truncated 13703 chars]
I0213 10:59:13.292191   65860 round_trippers.go:463] POST https://95.217.118.240:6443/api/v1/namespaces/kube-system/secrets?timeout=10s
I0213 10:59:13.292199   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.292210   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.292223   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:13.292235   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.302293   65860 round_trippers.go:574] Response Status: 201 Created in 10 milliseconds
I0213 10:59:13.302309   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.302324   65860 round_trippers.go:580]     Audit-Id: 217e7a72-4cac-45d7-b611-de5a22ce99c5
I0213 10:59:13.302336   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.302345   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.302354   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.302362   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.302371   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.302515   65860 request.go:1212] Response Body: {"kind":"Secret","apiVersion":"v1","metadata":{"name":"kubeadm-certs","namespace":"kube-system","uid":"ec795ac4-50d2-4de8-9905-b6e30054abf5","resourceVersion":"262","creationTimestamp":"2024-02-13T09:59:13Z","ownerReferences":[{"apiVersion":"v1","kind":"Secret","name":"bootstrap-token-11m78u","uid":"2c28d774-c3ef-48b9-9e65-7b5cf07af6c1","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time":"2024-02-13T09:59:13Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:ca.crt":{},"f:ca.key":{},"f:etcd-ca.crt":{},"f:etcd-ca.key":{},"f:front-proxy-ca.crt":{},"f:front-proxy-ca.key":{},"f:sa.key":{},"f:sa.pub":{}},"f:metadata":{"f:ownerReferences":{".":{},"k:{\"uid\":\"2c28d774-c3ef-48b9-9e65-7b5cf07af6c1\"}":{}}},"f:type":{}}}]},"data":{"ca.crt":"OO8a62Nu9ZTAMdIXza8sHKr2Xr0ttXAYGQX67iGbXGq6pgu2fiLr1HW4192tjda0g344REkNXj8+JVDBfVZznoPFTbX1a9x6VrfC5l5xMHb42Y0VAR5s8492i9nAUkB3b42HiOUEMqLfCafzuwOG7dS2WSrA9MM6NfG2DluP6h0f369DGp/W0IzaKn6UUNgYA4lE [truncated 14230 chars]
I0213 10:59:13.302951   65860 request.go:1212] Request Body: {"kind":"Role","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:kubeadm-certs","namespace":"kube-system","creationTimestamp":null},"rules":[{"verbs":["get"],"apiGroups":[""],"resources":["secrets"],"resourceNames":["kubeadm-certs"]}]}
I0213 10:59:13.303003   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s
I0213 10:59:13.303014   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.303025   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.303035   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:13.303044   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.307403   65860 round_trippers.go:574] Response Status: 201 Created in 4 milliseconds
I0213 10:59:13.307417   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.307430   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.307440   65860 round_trippers.go:580]     Content-Length: 530
I0213 10:59:13.307448   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.307456   65860 round_trippers.go:580]     Audit-Id: fbed496d-45d2-4c74-aa7b-12eecff6b27f
I0213 10:59:13.307465   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.307476   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.307484   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.307507   65860 request.go:1212] Response Body: {"kind":"Role","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:kubeadm-certs","namespace":"kube-system","uid":"e9645067-771e-4355-b230-4c9eaf92e297","resourceVersion":"263","creationTimestamp":"2024-02-13T09:59:13Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2024-02-13T09:59:13Z","fieldsType":"FieldsV1","fieldsV1":{"f:rules":{}}}]},"rules":[{"verbs":["get"],"apiGroups":[""],"resources":["secrets"],"resourceNames":["kubeadm-certs"]}]}
I0213 10:59:13.307617   65860 request.go:1212] Request Body: {"kind":"RoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:kubeadm-certs","namespace":"kube-system","creationTimestamp":null},"subjects":[{"kind":"Group","name":"system:bootstrappers:kubeadm:default-node-token"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"Role","name":"kubeadm:kubeadm-certs"}}
I0213 10:59:13.307666   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s
I0213 10:59:13.307674   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.307683   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.307693   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.307702   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:13.311955   65860 round_trippers.go:574] Response Status: 201 Created in 4 milliseconds
I0213 10:59:13.311976   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.311987   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.311997   65860 round_trippers.go:580]     Content-Length: 674
I0213 10:59:13.312007   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.312016   65860 round_trippers.go:580]     Audit-Id: a5b2988c-6707-4ba1-9ef9-8721da5714f6
I0213 10:59:13.312026   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.312034   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.312043   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.312068   65860 request.go:1212] Response Body: {"kind":"RoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:kubeadm-certs","namespace":"kube-system","uid":"7ce21054-938e-4caa-99dc-d29fc010e976","resourceVersion":"264","creationTimestamp":"2024-02-13T09:59:13Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2024-02-13T09:59:13Z","fieldsType":"FieldsV1","fieldsV1":{"f:roleRef":{},"f:subjects":{}}}]},"subjects":[{"kind":"Group","apiGroup":"rbac.authorization.k8s.io","name":"system:bootstrappers:kubeadm:default-node-token"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"Role","name":"kubeadm:kubeadm-certs"}}
[upload-certs] Using certificate key:
d4f80619630bb9eeccd3d73f871a29b1102b7bab148b99b5651e7c832bb85341
[mark-control-plane] Marking the node m1.mycluster.k8s.organisation.net as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
[mark-control-plane] Marking the node m1.mycluster.k8s.organisation.net as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]
I0213 10:59:13.812492   65860 round_trippers.go:463] GET https://95.217.118.240:6443/api/v1/nodes/m1.mycluster.k8s.organisation.net?timeout=10s
I0213 10:59:13.812510   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.812520   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.812529   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.813971   65860 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0213 10:59:13.813991   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.814001   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.814011   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.814024   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.814033   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.814041   65860 round_trippers.go:580]     Audit-Id: 343342c5-35e7-4ba4-8a03-dceea9bf44eb
I0213 10:59:13.814049   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.814134   65860 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"m1.mycluster.k8s.organisation.net","uid":"46c18260-16e3-4271-9efa-ba92bc7ba160","resourceVersion":"260","creationTimestamp":"2024-02-13T09:59:10Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"m1.mycluster.k8s.organisation.net","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/containerd/containerd.sock","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2024-02-13T09:59:10Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time": [truncated 3865 chars]
I0213 10:59:13.815022   65860 request.go:1212] Request Body: {"metadata":{"labels":{"node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""}},"spec":{"taints":[{"effect":"NoSchedule","key":"node-role.kubernetes.io/control-plane"},{"effect":"NoSchedule","key":"node.kubernetes.io/not-ready"}]}}
I0213 10:59:13.815080   65860 round_trippers.go:463] PATCH https://95.217.118.240:6443/api/v1/nodes/m1.mycluster.k8s.organisation.net?timeout=10s
I0213 10:59:13.815091   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.815101   65860 round_trippers.go:473]     Content-Type: application/strategic-merge-patch+json
I0213 10:59:13.815111   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.815119   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.833960   65860 round_trippers.go:574] Response Status: 200 OK in 18 milliseconds
I0213 10:59:13.833984   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.833995   65860 round_trippers.go:580]     Audit-Id: d7701da9-556c-49b7-8ebb-8aa3598ead64
I0213 10:59:13.834004   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.834014   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.834023   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.834035   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.834047   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.834130   65860 request.go:1212] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"m1.mycluster.k8s.organisation.net","uid":"46c18260-16e3-4271-9efa-ba92bc7ba160","resourceVersion":"267","creationTimestamp":"2024-02-13T09:59:10Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"m1.mycluster.k8s.organisation.net","kubernetes.io/os":"linux","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/containerd/containerd.sock","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2024-02-13T09:59:10Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/host [truncated 4185 chars]
[bootstrap-token] Using token: 6s5d2o.li1hb9gr8ex2g360
[bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0213 10:59:13.834526   65860 round_trippers.go:463] GET https://95.217.118.240:6443/api/v1/namespaces/kube-system/secrets/bootstrap-token-6s5d2o?timeout=10s
I0213 10:59:13.834539   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.834550   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.834560   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.835845   65860 round_trippers.go:574] Response Status: 404 Not Found in 1 milliseconds
I0213 10:59:13.835860   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.835870   65860 round_trippers.go:580]     Content-Length: 218
I0213 10:59:13.835879   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.835888   65860 round_trippers.go:580]     Audit-Id: b1f1d043-0ab1-4c8c-9514-deee05c60987
I0213 10:59:13.835897   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.835905   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.835914   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.835923   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.835946   65860 request.go:1212] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"secrets \"bootstrap-token-6s5d2o\" not found","reason":"NotFound","details":{"name":"bootstrap-token-6s5d2o","kind":"secrets"},"code":404}
I0213 10:59:13.836052   65860 request.go:1212] Request Body: {"kind":"Secret","apiVersion":"v1","metadata":{"name":"bootstrap-token-6s5d2o","namespace":"kube-system","creationTimestamp":null},"data":{"auth-extra-groups":"c3lzdGVtOmJvb3RzdHJhcHBlcnM6a3ViZWFkbTpkZWZhdWx0LW5vZGUtdG9rZW4=","description":"VGhlIGRlZmF1bHQgYm9vdHN0cmFwIHRva2VuIGdlbmVyYXRlZCBieSAna3ViZWFkbSBpbml0Jy4=","expiration":"MjAyNC0wMi0xNFQwOTo1OToxM1o=","token-id":"NnM1ZDJv","token-secret":"bGkxaGI5Z3I4ZXgyZzM2MA==","usage-bootstrap-authentication":"dHJ1ZQ==","usage-bootstrap-signing":"dHJ1ZQ=="},"type":"bootstrap.kubernetes.io/token"}
I0213 10:59:13.836096   65860 round_trippers.go:463] POST https://95.217.118.240:6443/api/v1/namespaces/kube-system/secrets?timeout=10s
I0213 10:59:13.836106   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.836116   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.836126   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.836136   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:13.840394   65860 round_trippers.go:574] Response Status: 201 Created in 4 milliseconds
I0213 10:59:13.840409   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.840418   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.840426   65860 round_trippers.go:580]     Audit-Id: 1e52faf7-3b37-4bd1-9dc7-550f26b1f624
I0213 10:59:13.840435   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.840444   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.840453   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.840462   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.840471   65860 round_trippers.go:580]     Content-Length: 979
I0213 10:59:13.840492   65860 request.go:1212] Response Body: {"kind":"Secret","apiVersion":"v1","metadata":{"name":"bootstrap-token-6s5d2o","namespace":"kube-system","uid":"0aa8e017-b03d-473d-9b12-80824427182d","resourceVersion":"268","creationTimestamp":"2024-02-13T09:59:13Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time":"2024-02-13T09:59:13Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:auth-extra-groups":{},"f:description":{},"f:expiration":{},"f:token-id":{},"f:token-secret":{},"f:usage-bootstrap-authentication":{},"f:usage-bootstrap-signing":{}},"f:type":{}}}]},"data":{"auth-extra-groups":"c3lzdGVtOmJvb3RzdHJhcHBlcnM6a3ViZWFkbTpkZWZhdWx0LW5vZGUtdG9rZW4=","description":"VGhlIGRlZmF1bHQgYm9vdHN0cmFwIHRva2VuIGdlbmVyYXRlZCBieSAna3ViZWFkbSBpbml0Jy4=","expiration":"MjAyNC0wMi0xNFQwOTo1OToxM1o=","token-id":"NnM1ZDJv","token-secret":"bGkxaGI5Z3I4ZXgyZzM2MA==","usage-bootstrap-authentication":"dHJ1ZQ==","usage-bootstrap-signing":"dHJ1ZQ=="},"type":"bootstrap.kubernetes.io/token"}
[bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0213 10:59:13.840690   65860 request.go:1212] Request Body: {"kind":"ClusterRole","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:get-nodes","creationTimestamp":null},"rules":[{"verbs":["get"],"apiGroups":[""],"resources":["nodes"]}]}
I0213 10:59:13.841002   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/clusterroles?timeout=10s
I0213 10:59:13.841036   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.841051   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.841065   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:13.841077   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.845708   65860 round_trippers.go:574] Response Status: 201 Created in 4 milliseconds
I0213 10:59:13.845736   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.845752   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.845765   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.845778   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.845792   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.845806   65860 round_trippers.go:580]     Content-Length: 471
I0213 10:59:13.845820   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.845833   65860 round_trippers.go:580]     Audit-Id: a401d8f9-6c78-4fc9-b175-65f4505f1908
I0213 10:59:13.845867   65860 request.go:1212] Response Body: {"kind":"ClusterRole","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:get-nodes","uid":"e38b4c74-7abd-43d5-93fc-126d04e151b3","resourceVersion":"269","creationTimestamp":"2024-02-13T09:59:13Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2024-02-13T09:59:13Z","fieldsType":"FieldsV1","fieldsV1":{"f:rules":{}}}]},"rules":[{"verbs":["get"],"apiGroups":[""],"resources":["nodes"]}]}
I0213 10:59:13.846103   65860 request.go:1212] Request Body: {"kind":"ClusterRoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:get-nodes","creationTimestamp":null},"subjects":[{"kind":"Group","name":"system:bootstrappers:kubeadm:default-node-token"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"ClusterRole","name":"kubeadm:get-nodes"}}
I0213 10:59:13.846170   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s
I0213 10:59:13.846180   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.846195   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.846209   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:13.846224   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.850410   65860 round_trippers.go:574] Response Status: 201 Created in 4 milliseconds
I0213 10:59:13.850430   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.850443   65860 round_trippers.go:580]     Audit-Id: fb80581f-8c5c-4664-852a-6baac89b5002
I0213 10:59:13.850455   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.850468   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.850480   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.850493   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.850506   65860 round_trippers.go:580]     Content-Length: 654
I0213 10:59:13.850518   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.850573   65860 request.go:1212] Response Body: {"kind":"ClusterRoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:get-nodes","uid":"2ab5a2b1-3144-44ab-8730-66db8332686d","resourceVersion":"270","creationTimestamp":"2024-02-13T09:59:13Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2024-02-13T09:59:13Z","fieldsType":"FieldsV1","fieldsV1":{"f:roleRef":{},"f:subjects":{}}}]},"subjects":[{"kind":"Group","apiGroup":"rbac.authorization.k8s.io","name":"system:bootstrappers:kubeadm:default-node-token"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"ClusterRole","name":"kubeadm:get-nodes"}}
[bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0213 10:59:13.850707   65860 request.go:1212] Request Body: {"kind":"ClusterRoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:kubelet-bootstrap","creationTimestamp":null},"subjects":[{"kind":"Group","name":"system:bootstrappers:kubeadm:default-node-token"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"ClusterRole","name":"system:node-bootstrapper"}}
I0213 10:59:13.850762   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s
I0213 10:59:13.850772   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.850785   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.850799   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.850812   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:13.855107   65860 round_trippers.go:574] Response Status: 201 Created in 4 milliseconds
I0213 10:59:13.855128   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.855141   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.855153   65860 round_trippers.go:580]     Audit-Id: 7bd53942-5d01-4c36-88e6-7f6e5a06fb18
I0213 10:59:13.855165   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.855177   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.855191   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.855202   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.855212   65860 round_trippers.go:580]     Content-Length: 669
I0213 10:59:13.855239   65860 request.go:1212] Response Body: {"kind":"ClusterRoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:kubelet-bootstrap","uid":"58181998-1406-4ba5-bf67-84d55a6ff664","resourceVersion":"271","creationTimestamp":"2024-02-13T09:59:13Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2024-02-13T09:59:13Z","fieldsType":"FieldsV1","fieldsV1":{"f:roleRef":{},"f:subjects":{}}}]},"subjects":[{"kind":"Group","apiGroup":"rbac.authorization.k8s.io","name":"system:bootstrappers:kubeadm:default-node-token"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"ClusterRole","name":"system:node-bootstrapper"}}
[bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0213 10:59:13.855390   65860 request.go:1212] Request Body: {"kind":"ClusterRoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:node-autoapprove-bootstrap","creationTimestamp":null},"subjects":[{"kind":"Group","name":"system:bootstrappers:kubeadm:default-node-token"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"ClusterRole","name":"system:certificates.k8s.io:certificatesigningrequests:nodeclient"}}
I0213 10:59:13.855448   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s
I0213 10:59:13.855459   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.855470   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:13.855484   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.855496   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.869385   65860 round_trippers.go:574] Response Status: 201 Created in 13 milliseconds
I0213 10:59:13.869400   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.869411   65860 round_trippers.go:580]     Audit-Id: 9011f888-6343-4319-a871-1203b8432e70
I0213 10:59:13.869423   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.869432   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.869440   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.869449   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.869457   65860 round_trippers.go:580]     Content-Length: 718
I0213 10:59:13.869466   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.869487   65860 request.go:1212] Response Body: {"kind":"ClusterRoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:node-autoapprove-bootstrap","uid":"ffe44cd6-f72c-43f6-b380-afa36f6ed6f0","resourceVersion":"273","creationTimestamp":"2024-02-13T09:59:13Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2024-02-13T09:59:13Z","fieldsType":"FieldsV1","fieldsV1":{"f:roleRef":{},"f:subjects":{}}}]},"subjects":[{"kind":"Group","apiGroup":"rbac.authorization.k8s.io","name":"system:bootstrappers:kubeadm:default-node-token"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"ClusterRole","name":"system:certificates.k8s.io:certificatesigningrequests:nodeclient"}}
[bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0213 10:59:13.869596   65860 request.go:1212] Request Body: {"kind":"ClusterRoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:node-autoapprove-certificate-rotation","creationTimestamp":null},"subjects":[{"kind":"Group","name":"system:nodes"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"ClusterRole","name":"system:certificates.k8s.io:certificatesigningrequests:selfnodeclient"}}
I0213 10:59:13.869639   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s
I0213 10:59:13.869649   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.869660   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.869669   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:13.869679   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.874029   65860 round_trippers.go:574] Response Status: 201 Created in 4 milliseconds
I0213 10:59:13.874048   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.874060   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.874070   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.874081   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.874091   65860 round_trippers.go:580]     Content-Length: 698
I0213 10:59:13.874105   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.874116   65860 round_trippers.go:580]     Audit-Id: 53a8a5d6-2ea8-4fd2-a998-bd5089341fa6
I0213 10:59:13.874126   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.874154   65860 request.go:1212] Response Body: {"kind":"ClusterRoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:node-autoapprove-certificate-rotation","uid":"2aeace18-fa84-4c05-8ddc-133fc090fa7a","resourceVersion":"274","creationTimestamp":"2024-02-13T09:59:13Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2024-02-13T09:59:13Z","fieldsType":"FieldsV1","fieldsV1":{"f:roleRef":{},"f:subjects":{}}}]},"subjects":[{"kind":"Group","apiGroup":"rbac.authorization.k8s.io","name":"system:nodes"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"ClusterRole","name":"system:certificates.k8s.io:certificatesigningrequests:selfnodeclient"}}
[bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0213 10:59:13.874264   65860 clusterinfo.go:47] [bootstrap-token] loading admin kubeconfig
I0213 10:59:13.874838   65860 loader.go:395] Config loaded from file:  /etc/kubernetes/admin.conf
I0213 10:59:13.874852   65860 clusterinfo.go:58] [bootstrap-token] copying the cluster from admin.conf to the bootstrap kubeconfig
I0213 10:59:13.875093   65860 clusterinfo.go:70] [bootstrap-token] creating/updating ConfigMap in kube-public namespace
I0213 10:59:13.875145   65860 request.go:1212] Request Body: {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"cluster-info","namespace":"kube-public","creationTimestamp":null},"data":{"kubeconfig":"apiVersion: v1\nclusters:\n- cluster:\n    certificate-authority-data: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURCVENDQWUyZ0F3SUJBZ0lJTkxzRHNxbFRDbVV3RFFZSktvWklodmNOQVFFTEJRQXdGVEVUTUJFR0ExVUUKQXhNS2EzVmlaWEp1WlhSbGN6QWVGdzB5TkRBeU1UTXdPVFUwTURWYUZ3MHpOREF5TVRBd09UVTVNRFZhTUJVeApFekFSQmdOVkJBTVRDbXQxWW1WeWJtVjBaWE13Z2dFaU1BMEdDU3FHU0liM0RRRUJBUVVBQTRJQkR3QXdnZ0VLCkFvSUJBUUNhNE02Nm5SOTBrUFpLU2V6bFpBKzVLTWJHb3lvdXdGU2tmbHZ4Vkp6aXpXRmtSZWt5d3RuQ3NwbVUKekU2SkhWV3BPQml6eG5wZkk5RzkxVnV3dExlenU0enpuWUpia2w1dWU3RGt2NUJmYkFOemd2Syt3QmMxT1lYbgpPa2tuVUswaXZsNTRHZEZTN2k3OUNZaEdhbUN2QUtOQmNLMHlSUk42dDVOVldYQ0Q5K0ZicG45alVEb0FMQlhRCnVucjJZSU1mSXhWdHQ0alBZYVY0RkIxcCs4bkRKdUd4QUxPSUd4elNkTUhNZU5oWFI5OG9DZWdaT1BBVW4xQXYKS1FEbTFDeTNnb0I0NVF5U1Jlb1NldUtBWVUzdmtCU1pLSHQ0aUFCT050OU1SN2ZEbDZId3UvYUZQdlNnYlFFQgpDbHAvb2lZdjN4OFdpTjZRMEVpV1FBNWRDdGRWQWdNQkFBR2pXVEJYTUE0R0ExVWREd0VCL3dRRUF [truncated 813 chars]
I0213 10:59:13.875210   65860 round_trippers.go:463] POST https://95.217.118.240:6443/api/v1/namespaces/kube-public/configmaps?timeout=10s
I0213 10:59:13.875224   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.875240   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:13.875254   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.875267   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.885062   65860 round_trippers.go:574] Response Status: 201 Created in 9 milliseconds
I0213 10:59:13.885081   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.885094   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.885105   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.885115   65860 round_trippers.go:580]     Content-Length: 2106
I0213 10:59:13.885125   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.885139   65860 round_trippers.go:580]     Audit-Id: 6883b70f-3d4c-466f-b402-dd84b694c19f
I0213 10:59:13.885151   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.885161   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.885233   65860 request.go:1212] Response Body: {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"cluster-info","namespace":"kube-public","uid":"ba5b60fd-50d7-42a4-b5a7-32acd2ba521e","resourceVersion":"277","creationTimestamp":"2024-02-13T09:59:13Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time":"2024-02-13T09:59:13Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:kubeconfig":{}}}}]},"data":{"kubeconfig":"apiVersion: v1\nclusters:\n- cluster:\n    certificate-authority-data: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURCVENDQWUyZ0F3SUJBZ0lJTkxzRHNxbFRDbVV3RFFZSktvWklodmNOQVFFTEJRQXdGVEVUTUJFR0ExVUUKQXhNS2EzVmlaWEp1WlhSbGN6QWVGdzB5TkRBeU1UTXdPVFUwTURWYUZ3MHpOREF5TVRBd09UVTVNRFZhTUJVeApFekFSQmdOVkJBTVRDbXQxWW1WeWJtVjBaWE13Z2dFaU1BMEdDU3FHU0liM0RRRUJBUVVBQTRJQkR3QXdnZ0VLCkFvSUJBUUNhNE02Nm5SOTBrUFpLU2V6bFpBKzVLTWJHb3lvdXdGU2tmbHZ4Vkp6aXpXRmtSZWt5d3RuQ3NwbVUKekU2SkhWV3BPQml6eG5wZkk5RzkxVnV3dExlenU0enpuWUpia2w1dWU3RGt2NUJmYkFOemd2Syt3QmMxT1lYbgpPa2tuVUswaXZsNTRHZEZTN2k3OUNZaEdhbUN2QUtOQmNLMHlSUk42dDVOVldYQ0Q5K0 [truncated 1082 chars]
I0213 10:59:13.885376   65860 clusterinfo.go:84] creating the RBAC rules for exposing the cluster-info ConfigMap in the kube-public namespace
I0213 10:59:13.885423   65860 request.go:1212] Request Body: {"kind":"Role","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:bootstrap-signer-clusterinfo","namespace":"kube-public","creationTimestamp":null},"rules":[{"verbs":["get"],"apiGroups":[""],"resources":["configmaps"],"resourceNames":["cluster-info"]}]}
I0213 10:59:13.885479   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-public/roles?timeout=10s
I0213 10:59:13.885490   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.885501   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.885513   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.885524   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:13.892129   65860 round_trippers.go:574] Response Status: 201 Created in 6 milliseconds
I0213 10:59:13.892149   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.892164   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.892175   65860 round_trippers.go:580]     Content-Length: 547
I0213 10:59:13.892185   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.892195   65860 round_trippers.go:580]     Audit-Id: 95a1ddcc-7a33-4d74-90ab-712752a55b3e
I0213 10:59:13.892206   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.892216   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.892228   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.892254   65860 request.go:1212] Response Body: {"kind":"Role","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:bootstrap-signer-clusterinfo","namespace":"kube-public","uid":"58c507a0-2bbb-4aec-8323-3b0d1c8506a2","resourceVersion":"279","creationTimestamp":"2024-02-13T09:59:13Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2024-02-13T09:59:13Z","fieldsType":"FieldsV1","fieldsV1":{"f:rules":{}}}]},"rules":[{"verbs":["get"],"apiGroups":[""],"resources":["configmaps"],"resourceNames":["cluster-info"]}]}
I0213 10:59:13.892378   65860 request.go:1212] Request Body: {"kind":"RoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:bootstrap-signer-clusterinfo","namespace":"kube-public","creationTimestamp":null},"subjects":[{"kind":"User","name":"system:anonymous"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"Role","name":"kubeadm:bootstrap-signer-clusterinfo"}}
I0213 10:59:13.892434   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-public/rolebindings?timeout=10s
I0213 10:59:13.892444   65860 round_trippers.go:469] Request Headers:
I0213 10:59:13.892456   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:13.892472   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:13.892483   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:13.896930   65860 round_trippers.go:574] Response Status: 201 Created in 4 milliseconds
I0213 10:59:13.896948   65860 round_trippers.go:577] Response Headers:
I0213 10:59:13.896963   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:13.896973   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:13.896984   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:13.896994   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:13.897005   65860 round_trippers.go:580]     Content-Length: 672
I0213 10:59:13.897015   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:13 GMT
I0213 10:59:13.897026   65860 round_trippers.go:580]     Audit-Id: 2a2d345a-3519-490e-9710-d800ed324bc8
I0213 10:59:13.897051   65860 request.go:1212] Response Body: {"kind":"RoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"kubeadm:bootstrap-signer-clusterinfo","namespace":"kube-public","uid":"93d7f5a0-1b36-446c-838a-0babc5662149","resourceVersion":"280","creationTimestamp":"2024-02-13T09:59:13Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2024-02-13T09:59:13Z","fieldsType":"FieldsV1","fieldsV1":{"f:roleRef":{},"f:subjects":{}}}]},"subjects":[{"kind":"User","apiGroup":"rbac.authorization.k8s.io","name":"system:anonymous"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"Role","name":"kubeadm:bootstrap-signer-clusterinfo"}}
I0213 10:59:13.897181   65860 kubeletfinalize.go:91] [kubelet-finalize] Assuming that kubelet client certificate rotation is enabled: found "/var/lib/kubelet/pki/kubelet-client-current.pem"
[kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0213 10:59:13.897756   65860 loader.go:395] Config loaded from file:  /etc/kubernetes/kubelet.conf
I0213 10:59:13.898237   65860 kubeletfinalize.go:135] [kubelet-finalize] Restarting the kubelet to enable client certificate rotation
I0213 10:59:14.276615   65860 round_trippers.go:463] GET https://95.217.118.240:6443/apis/apps/v1/namespaces/kube-system/deployments?labelSelector=k8s-app%3Dkube-dns
I0213 10:59:14.276631   65860 round_trippers.go:469] Request Headers:
I0213 10:59:14.276639   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:14.276645   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:14.280221   65860 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0213 10:59:14.280240   65860 round_trippers.go:577] Response Headers:
I0213 10:59:14.280251   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:14.280261   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:14.280270   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:14.280281   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:14.280293   65860 round_trippers.go:580]     Content-Length: 97
I0213 10:59:14.280298   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:14 GMT
I0213 10:59:14.280305   65860 round_trippers.go:580]     Audit-Id: 029f18e1-25cf-47f5-b8f8-d644c759bd92
I0213 10:59:14.280324   65860 request.go:1212] Response Body: {"kind":"DeploymentList","apiVersion":"apps/v1","metadata":{"resourceVersion":"289"},"items":[]}
I0213 10:59:14.281476   65860 round_trippers.go:463] GET https://95.217.118.240:6443/api/v1/namespaces/kube-system/configmaps/coredns?timeout=10s
I0213 10:59:14.281483   65860 round_trippers.go:469] Request Headers:
I0213 10:59:14.281491   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:14.281498   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:14.282844   65860 round_trippers.go:574] Response Status: 404 Not Found in 1 milliseconds
I0213 10:59:14.282857   65860 round_trippers.go:577] Response Headers:
I0213 10:59:14.282864   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:14 GMT
I0213 10:59:14.282871   65860 round_trippers.go:580]     Audit-Id: eb507629-934b-4e43-b66a-122333461fd5
I0213 10:59:14.282876   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:14.282881   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:14.282885   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:14.282890   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:14.282896   65860 round_trippers.go:580]     Content-Length: 194
I0213 10:59:14.282907   65860 request.go:1212] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"configmaps \"coredns\" not found","reason":"NotFound","details":{"name":"coredns","kind":"configmaps"},"code":404}
I0213 10:59:14.282976   65860 request.go:1212] Request Body: {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"coredns","namespace":"kube-system","creationTimestamp":null},"data":{"Corefile":".:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes organisation.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n"}}
I0213 10:59:14.283003   65860 round_trippers.go:463] POST https://95.217.118.240:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s
I0213 10:59:14.283008   65860 round_trippers.go:469] Request Headers:
I0213 10:59:14.283013   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:14.283020   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:14.283025   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:14.292699   65860 round_trippers.go:574] Response Status: 201 Created in 9 milliseconds
I0213 10:59:14.292723   65860 round_trippers.go:577] Response Headers:
I0213 10:59:14.292735   65860 round_trippers.go:580]     Content-Length: 774
I0213 10:59:14.292745   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:14 GMT
I0213 10:59:14.292755   65860 round_trippers.go:580]     Audit-Id: 45bdc4c6-c543-4137-bd51-51673a96f2b4
I0213 10:59:14.292766   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:14.292776   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:14.292787   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:14.292798   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:14.292833   65860 request.go:1212] Response Body: {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"coredns","namespace":"kube-system","uid":"d8ac4c97-0332-4165-9597-054b67690764","resourceVersion":"290","creationTimestamp":"2024-02-13T09:59:14Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time":"2024-02-13T09:59:14Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:Corefile":{}}}}]},"data":{"Corefile":".:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes organisation.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n"}}
I0213 10:59:14.293179   65860 request.go:1212] Request Body: {"kind":"ClusterRole","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"system:coredns","creationTimestamp":null},"rules":[{"verbs":["list","watch"],"apiGroups":[""],"resources":["endpoints","services","pods","namespaces"]},{"verbs":["list","watch"],"apiGroups":["discovery.k8s.io"],"resources":["endpointslices"]}]}
I0213 10:59:14.293244   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/clusterroles?timeout=10s
I0213 10:59:14.293254   65860 round_trippers.go:469] Request Headers:
I0213 10:59:14.293266   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:14.293276   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:14.293288   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:14.297246   65860 round_trippers.go:574] Response Status: 201 Created in 3 milliseconds
I0213 10:59:14.297263   65860 round_trippers.go:577] Response Headers:
I0213 10:59:14.297276   65860 round_trippers.go:580]     Content-Length: 603
I0213 10:59:14.297287   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:14 GMT
I0213 10:59:14.297298   65860 round_trippers.go:580]     Audit-Id: ec5405c9-5140-4374-8b82-4eefc941bdb7
I0213 10:59:14.297309   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:14.297319   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:14.297329   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:14.297341   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:14.297371   65860 request.go:1212] Response Body: {"kind":"ClusterRole","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"system:coredns","uid":"53d0a641-0bde-47f8-bc69-f1008de6d090","resourceVersion":"291","creationTimestamp":"2024-02-13T09:59:14Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2024-02-13T09:59:14Z","fieldsType":"FieldsV1","fieldsV1":{"f:rules":{}}}]},"rules":[{"verbs":["list","watch"],"apiGroups":[""],"resources":["endpoints","services","pods","namespaces"]},{"verbs":["list","watch"],"apiGroups":["discovery.k8s.io"],"resources":["endpointslices"]}]}
I0213 10:59:14.297620   65860 request.go:1212] Request Body: {"kind":"ClusterRoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"system:coredns","creationTimestamp":null},"subjects":[{"kind":"ServiceAccount","name":"coredns","namespace":"kube-system"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"ClusterRole","name":"system:coredns"}}
I0213 10:59:14.297677   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s
I0213 10:59:14.297687   65860 round_trippers.go:469] Request Headers:
I0213 10:59:14.297700   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:14.297712   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:14.297723   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:14.306849   65860 round_trippers.go:574] Response Status: 201 Created in 9 milliseconds
I0213 10:59:14.306865   65860 round_trippers.go:577] Response Headers:
I0213 10:59:14.306872   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:14.306877   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:14.306882   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:14.306887   65860 round_trippers.go:580]     Content-Length: 604
I0213 10:59:14.306892   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:14 GMT
I0213 10:59:14.306897   65860 round_trippers.go:580]     Audit-Id: eaef1ff4-91ef-4bb9-9109-79401098ad77
I0213 10:59:14.306903   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:14.306922   65860 request.go:1212] Response Body: {"kind":"ClusterRoleBinding","apiVersion":"rbac.authorization.k8s.io/v1","metadata":{"name":"system:coredns","uid":"cb78f2c9-4e05-4640-9804-ac28b20663c7","resourceVersion":"292","creationTimestamp":"2024-02-13T09:59:14Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"rbac.authorization.k8s.io/v1","time":"2024-02-13T09:59:14Z","fieldsType":"FieldsV1","fieldsV1":{"f:roleRef":{},"f:subjects":{}}}]},"subjects":[{"kind":"ServiceAccount","name":"coredns","namespace":"kube-system"}],"roleRef":{"apiGroup":"rbac.authorization.k8s.io","kind":"ClusterRole","name":"system:coredns"}}
I0213 10:59:14.307150   65860 request.go:1212] Request Body: {"kind":"ServiceAccount","apiVersion":"v1","metadata":{"name":"coredns","namespace":"kube-system","creationTimestamp":null}}
I0213 10:59:14.307192   65860 round_trippers.go:463] POST https://95.217.118.240:6443/api/v1/namespaces/kube-system/serviceaccounts?timeout=10s
I0213 10:59:14.307197   65860 round_trippers.go:469] Request Headers:
I0213 10:59:14.307203   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:14.307209   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:14.307214   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:14.311541   65860 round_trippers.go:574] Response Status: 201 Created in 4 milliseconds
I0213 10:59:14.311575   65860 round_trippers.go:577] Response Headers:
I0213 10:59:14.311585   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:14.311593   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:14.311600   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:14.311606   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:14.311613   65860 round_trippers.go:580]     Content-Length: 212
I0213 10:59:14.311620   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:14 GMT
I0213 10:59:14.311627   65860 round_trippers.go:580]     Audit-Id: 9969c4d3-ef31-47ab-b694-0f57163846ac
I0213 10:59:14.311758   65860 request.go:1212] Response Body: {"kind":"ServiceAccount","apiVersion":"v1","metadata":{"name":"coredns","namespace":"kube-system","uid":"60567e2a-2de4-4a75-8031-827fead9cc34","resourceVersion":"293","creationTimestamp":"2024-02-13T09:59:14Z"}}
I0213 10:59:14.312598   65860 request.go:1212] Request Body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"coredns","namespace":"kube-system","creationTimestamp":null,"labels":{"k8s-app":"kube-dns"}},"spec":{"replicas":2,"selector":{"matchLabels":{"k8s-app":"kube-dns"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"k8s-app":"kube-dns"}},"spec":{"volumes":[{"name":"config-volume","configMap":{"name":"coredns","items":[{"key":"Corefile","path":"Corefile"}]}}],"containers":[{"name":"coredns","image":"registry.k8s.io/coredns/coredns:v1.11.1","args":["-conf","/etc/coredns/Corefile"],"ports":[{"name":"dns","containerPort":53,"protocol":"UDP"},{"name":"dns-tcp","containerPort":53,"protocol":"TCP"},{"name":"metrics","containerPort":9153,"protocol":"TCP"}],"resources":{"limits":{"memory":"170Mi"},"requests":{"cpu":"100m","memory":"70Mi"}},"volumeMounts":[{"name":"config-volume","readOnly":true,"mountPath":"/etc/coredns"}],"livenessProbe":{"httpGet":{"path":"/health","port":8080,"scheme":"HTTP"},"initialDelaySeconds":60,"timeoutSeconds":5,"success [truncated 908 chars]
I0213 10:59:14.312644   65860 round_trippers.go:463] POST https://95.217.118.240:6443/apis/apps/v1/namespaces/kube-system/deployments?timeout=10s
I0213 10:59:14.312649   65860 round_trippers.go:469] Request Headers:
I0213 10:59:14.312655   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:14.312661   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:14.312666   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:14.324883   65860 round_trippers.go:574] Response Status: 201 Created in 12 milliseconds
I0213 10:59:14.324911   65860 round_trippers.go:577] Response Headers:
I0213 10:59:14.324921   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:14 GMT
I0213 10:59:14.324928   65860 round_trippers.go:580]     Audit-Id: 889297f2-fd49-4a23-939a-da6382bc7dc4
I0213 10:59:14.324933   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:14.324937   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:14.324942   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:14.324946   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:14.325047   65860 request.go:1212] Response Body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"coredns","namespace":"kube-system","uid":"73e06989-538b-456c-bf7b-f511f2f0de3d","resourceVersion":"294","generation":1,"creationTimestamp":"2024-02-13T09:59:14Z","labels":{"k8s-app":"kube-dns"},"managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"apps/v1","time":"2024-02-13T09:59:14Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:labels":{".":{},"f:k8s-app":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:replicas":{},"f:revisionHistoryLimit":{},"f:selector":{},"f:strategy":{"f:rollingUpdate":{".":{},"f:maxSurge":{},"f:maxUnavailable":{}},"f:type":{}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:k8s-app":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f [truncated 3633 chars]
I0213 10:59:14.325911   65860 request.go:1212] Request Body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"kube-dns","namespace":"kube-system","resourceVersion":"0","creationTimestamp":null,"labels":{"k8s-app":"kube-dns","kubernetes.io/cluster-service":"true","kubernetes.io/name":"CoreDNS"},"annotations":{"prometheus.io/port":"9153","prometheus.io/scrape":"true"}},"spec":{"ports":[{"name":"dns","protocol":"UDP","port":53,"targetPort":53},{"name":"dns-tcp","protocol":"TCP","port":53,"targetPort":53},{"name":"metrics","protocol":"TCP","port":9153,"targetPort":9153}],"selector":{"k8s-app":"kube-dns"},"clusterIP":"10.96.0.10"},"status":{"loadBalancer":{}}}
I0213 10:59:14.325978   65860 round_trippers.go:463] POST https://95.217.118.240:6443/api/v1/namespaces/kube-system/services?timeout=10s
I0213 10:59:14.325986   65860 round_trippers.go:469] Request Headers:
I0213 10:59:14.325997   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:14.326007   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:14.326015   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:14.344329   65860 round_trippers.go:574] Response Status: 201 Created in 18 milliseconds
I0213 10:59:14.344350   65860 round_trippers.go:577] Response Headers:
I0213 10:59:14.344358   65860 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: fcf6eef6-be19-4760-9a13-395e0e8c1a65
I0213 10:59:14.344364   65860 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: 27a1612f-c7b5-47b6-8cc4-5d188525ac53
I0213 10:59:14.344369   65860 round_trippers.go:580]     Content-Length: 1619
I0213 10:59:14.344375   65860 round_trippers.go:580]     Date: Tue, 13 Feb 2024 09:59:14 GMT
I0213 10:59:14.344380   65860 round_trippers.go:580]     Audit-Id: 0c851a3d-fa4f-490c-af1a-2599de4baf24
I0213 10:59:14.344385   65860 round_trippers.go:580]     Cache-Control: no-cache, private
I0213 10:59:14.344394   65860 round_trippers.go:580]     Content-Type: application/json
I0213 10:59:14.344423   65860 request.go:1212] Response Body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"kube-dns","namespace":"kube-system","uid":"b86f3ec4-74cb-4458-a27a-3ee9c4a64190","resourceVersion":"299","creationTimestamp":"2024-02-13T09:59:14Z","labels":{"k8s-app":"kube-dns","kubernetes.io/cluster-service":"true","kubernetes.io/name":"CoreDNS"},"annotations":{"prometheus.io/port":"9153","prometheus.io/scrape":"true"},"managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time":"2024-02-13T09:59:14Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:prometheus.io/port":{},"f:prometheus.io/scrape":{}},"f:labels":{".":{},"f:k8s-app":{},"f:kubernetes.io/cluster-service":{},"f:kubernetes.io/name":{}}},"f:spec":{"f:clusterIP":{},"f:internalTrafficPolicy":{},"f:ports":{".":{},"k:{\"port\":53,\"protocol\":\"TCP\"}":{".":{},"f:name":{},"f:port":{},"f:protocol":{},"f:targetPort":{}},"k:{\"port\":53,\"protocol\":\"UDP\"}":{".":{},"f:name":{},"f:port":{},"f:protocol":{},"f:targetPort":{}},"k:{\"port\":9153,\"pro [truncated 595 chars]
[addons] Applied essential addon: CoreDNS
I0213 10:59:14.345176   65860 request.go:1212] Request Body: {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"kube-proxy","namespace":"kube-system","creationTimestamp":null,"labels":{"app":"kube-proxy"},"annotations":{"kubeadm.kubernetes.io/component-config.hash":"sha256:0e8c284afea56435ba166d8340232b0a9a8d0783927a2a3696bedcdc0f9693ca"}},"data":{"config.conf":"apiVersion: kubeproxy.config.k8s.io/v1alpha1\nbindAddress: 0.0.0.0\nbindAddressHardFail: false\nclientConnection:\n  acceptContentTypes: \"\"\n  burst: 0\n  contentType: \"\"\n  kubeconfig: /var/lib/kube-proxy/kubeconfig.conf\n  qps: 0\nclusterCIDR: 10.1.0.0/16\nconfigSyncPeriod: 0s\nconntrack:\n  maxPerCore: null\n  min: null\n  tcpBeLiberal: false\n  tcpCloseWaitTimeout: null\n  tcpEstablishedTimeout: null\n  udpStreamTimeout: 0s\n  udpTimeout: 0s\ndetectLocal:\n  bridgeInterface: \"\"\n  interfaceNamePrefix: \"\"\ndetectLocalMode: \"\"\nenableProfiling: false\nhealthzBindAddress: \"\"\nhostnameOverride: \"\"\niptables:\n  localhostNodePorts: null\n  masqueradeAll: false\n  masqueradeBit: null\n  minSy [truncated 1135 chars]
I0213 10:59:14.469405   65860 request.go:629] Waited for 124.190994ms due to client-side throttling, not priority and fairness, request: POST:https://95.217.118.240:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s
I0213 10:59:14.469464   65860 round_trippers.go:463] POST https://95.217.118.240:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s
I0213 10:59:14.469469   65860 round_trippers.go:469] Request Headers:
I0213 10:59:14.469474   65860 round_trippers.go:473]     Accept: application/json, */*
I0213 10:59:14.469480   65860 round_trippers.go:473]     Content-Type: application/json
I0213 10:59:14.469486   65860 round_trippers.go:473]     User-Agent: kubeadm/v1.29.1 (linux/amd64) kubernetes/bc401b9
I0213 10:59:14.469659   65860 round_trippers.go:574] Response Status:  in 0 milliseconds
I0213 10:59:14.469678   65860 round_trippers.go:577] Response Headers:
Post "https://95.217.118.240:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s": dial tcp 95.217.118.240:6443: connect: connection refused
unable to create ConfigMap
k8s.io/kubernetes/cmd/kubeadm/app/util/apiclient.CreateOrUpdateConfigMap
        cmd/kubeadm/app/util/apiclient/idempotency.go:48
k8s.io/kubernetes/cmd/kubeadm/app/phases/addons/proxy.createKubeProxyConfigMap
        cmd/kubeadm/app/phases/addons/proxy/proxy.go:239
k8s.io/kubernetes/cmd/kubeadm/app/phases/addons/proxy.EnsureProxyAddon
        cmd/kubeadm/app/phases/addons/proxy/proxy.go:53
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/init.runKubeProxyAddon
        cmd/kubeadm/app/cmd/phases/init/addons.go:121
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
        cmd/kubeadm/app/cmd/phases/workflow/runner.go:259
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
        cmd/kubeadm/app/cmd/phases/workflow/runner.go:446
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
        cmd/kubeadm/app/cmd/phases/workflow/runner.go:232
k8s.io/kubernetes/cmd/kubeadm/app/cmd.newCmdInit.func1
        cmd/kubeadm/app/cmd/init.go:124
github.com/spf13/cobra.(*Command).execute
        vendor/github.com/spf13/cobra/command.go:940
github.com/spf13/cobra.(*Command).ExecuteC
        vendor/github.com/spf13/cobra/command.go:1068
github.com/spf13/cobra.(*Command).Execute
        vendor/github.com/spf13/cobra/command.go:992
k8s.io/kubernetes/cmd/kubeadm/app.Run
        cmd/kubeadm/app/kubeadm.go:50
main.main
        cmd/kubeadm/kubeadm.go:25
runtime.main
        /usr/local/go/src/runtime/proc.go:267
runtime.goexit
        /usr/local/go/src/runtime/asm_amd64.s:1650
error execution phase addon/kube-proxy
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
        cmd/kubeadm/app/cmd/phases/workflow/runner.go:260
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
        cmd/kubeadm/app/cmd/phases/workflow/runner.go:446
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
        cmd/kubeadm/app/cmd/phases/workflow/runner.go:232
k8s.io/kubernetes/cmd/kubeadm/app/cmd.newCmdInit.func1
        cmd/kubeadm/app/cmd/init.go:124
github.com/spf13/cobra.(*Command).execute
        vendor/github.com/spf13/cobra/command.go:940
github.com/spf13/cobra.(*Command).ExecuteC
        vendor/github.com/spf13/cobra/command.go:1068
github.com/spf13/cobra.(*Command).Execute
        vendor/github.com/spf13/cobra/command.go:992
k8s.io/kubernetes/cmd/kubeadm/app.Run
        cmd/kubeadm/app/kubeadm.go:50
main.main
        cmd/kubeadm/kubeadm.go:25
runtime.main
        /usr/local/go/src/runtime/proc.go:267
runtime.goexit
        /usr/local/go/src/runtime/asm_amd64.s:1650

neolit123 · 2024-02-13T10:25:48Z

thanks for the logs, my responses here are the same as on the kubernetes ticket.
your API server seems to be down at the moment when the kubeadm client tries to connect to it.
you should try to debug why that's happening.

some kubeadm API calls have retries, but some do not. the CreateOrUpdateConfigMap does not have retries.
https://github.com/kubernetes/kubernetes/blob/release-1.29/cmd/kubeadm/app/util/apiclient/idempotency.go#L45

we could add retries to a number of those remaining functions in kubernetes master branch, but i don't think such a patch should be backported to 1.29 or earlier versions, so you have to understand what's going on your side and workaround.

meezaan · 2024-02-13T11:04:58Z

I'll do some more research / debugging and see if I can come up with something else, or atleast a workaround. Thanks.

neolit123 · 2024-02-13T11:07:36Z

let's continue the discussion here:
#1606 (comment)

please post your results there if you find anything.
this is now tracked for 1.30.

neolit123 added kind/support Categorizes issue or PR as a support question. priority/awaiting-more-evidence Lowest priority. Possibly useful, but not yet enough support to actually get it done. labels Feb 13, 2024

neolit123 added this to the v1.30 milestone Feb 13, 2024

neolit123 mentioned this issue Feb 13, 2024

kubeadm init fails to create ConfigMap when --upload certs is set kubernetes/kubernetes#112411

Closed

neolit123 mentioned this issue Feb 13, 2024

evaluate the retry logic for API calls #1606

Closed

neolit123 closed this as completed Feb 13, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

kubeadm on version 1.29.1 with upload-certs times out during the configMap POST #3022

kubeadm on version 1.29.1 with upload-certs times out during the configMap POST #3022

meezaan commented Feb 13, 2024

neolit123 commented Feb 13, 2024 •

edited

Loading

neolit123 commented Feb 13, 2024

neolit123 commented Feb 13, 2024

meezaan commented Feb 13, 2024

meezaan commented Feb 13, 2024 •

edited

Loading

neolit123 commented Feb 13, 2024 •

edited

Loading

meezaan commented Feb 13, 2024 •

edited by neolit123

Loading

neolit123 commented Feb 13, 2024 •

edited

Loading

meezaan commented Feb 13, 2024

neolit123 commented Feb 13, 2024

kubeadm on version 1.29.1 with upload-certs times out during the configMap POST #3022

kubeadm on version 1.29.1 with upload-certs times out during the configMap POST #3022

Comments

meezaan commented Feb 13, 2024

What keywords did you search in kubeadm issues before filing this one?

Is this a BUG REPORT or FEATURE REQUEST?

Versions

What happened?

What you expected to happen?

How to reproduce it (as minimally and precisely as possible)?

Anything else we need to know?

neolit123 commented Feb 13, 2024 • edited Loading

neolit123 commented Feb 13, 2024

neolit123 commented Feb 13, 2024

meezaan commented Feb 13, 2024

meezaan commented Feb 13, 2024 • edited Loading

neolit123 commented Feb 13, 2024 • edited Loading

meezaan commented Feb 13, 2024 • edited by neolit123 Loading

neolit123 commented Feb 13, 2024 • edited Loading

meezaan commented Feb 13, 2024

neolit123 commented Feb 13, 2024

neolit123 commented Feb 13, 2024 •

edited

Loading

meezaan commented Feb 13, 2024 •

edited

Loading

neolit123 commented Feb 13, 2024 •

edited

Loading

meezaan commented Feb 13, 2024 •

edited by neolit123

Loading

neolit123 commented Feb 13, 2024 •

edited

Loading