mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.105+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=eaa1d919-371b-d86e-483b-8c8b38dc2b87 task=tls-proxy type=Received msg="Task received by client" failed =false mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.106+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=eaa1d919-371b-d86e-483b-8c8b38dc2b87 task=alertmanager type=Received msg="Task received by client" fai led=false mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.106+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=eaa1d919-371b-d86e-483b-8c8b38dc2b87 task=connect-proxy-alertmanager type=Received msg="Task received by client" failed=false mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.110+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=dae91d49-e956-42b3-5c58-4ebd1ba1dec2 task=ping-exporter type=Received msg="Task received by client" fa iled=false mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.110+0100 [INFO] agent: (runner) stopping mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.110+0100 [INFO] agent: (runner) stopping mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.110+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=dae91d49-e956-42b3-5c58-4ebd1ba1dec2 task=blackbox-exporter type=Received msg="Task received by client " failed=false mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.111+0100 [INFO] agent: (runner) creating new runner (dry: false, once: false) mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.111+0100 [INFO] agent: (runner) received finish mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.111+0100 [INFO] agent: (runner) creating new runner (dry: false, once: false) mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.111+0100 [INFO] agent: (runner) creating watcher mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.111+0100 [INFO] agent: (runner) creating watcher mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.111+0100 [INFO] agent: (runner) starting mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.111+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=dae91d49-e956-42b3-5c58-4ebd1ba1dec2 task=consul-exporter type=Received msg="Task received by client" failed=false mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.113+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=dae91d49-e956-42b3-5c58-4ebd1ba1dec2 task=metrics-proxy type=Received msg="Task received by client" fa iled=false mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.114+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=dae91d49-e956-42b3-5c58-4ebd1ba1dec2 task=prometheus type=Received msg="Task received by client" faile d=false mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.114+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=dae91d49-e956-42b3-5c58-4ebd1ba1dec2 task=cluster-metrics-proxy type=Received msg="Task received by cl ient" failed=false mars 23 14:41:06 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:06.115+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=dae91d49-e956-42b3-5c58-4ebd1ba1dec2 task=connect-proxy-prometheus type=Received msg="Task received by client" failed=false mars 23 14:41:06 ct-wn-2 containerd[897]: time="2023-03-23T14:41:06.322194583+01:00" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 mars 23 14:41:06 ct-wn-2 containerd[897]: time="2023-03-23T14:41:06.322291268+01:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 mars 23 14:41:06 ct-wn-2 containerd[897]: time="2023-03-23T14:41:06.322313683+01:00" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 mars 23 14:41:06 ct-wn-2 containerd[897]: time="2023-03-23T14:41:06.322621052+01:00" level=info msg="starting signal loop" namespace=moby path=/run/containerd/io.containerd.runtime.v2.task/moby/8c498c12623117e1df92967fa0cb8d7b3e25ce5bf4de9bdff206b2fc17baf3a0 pid=1584707 runtime=io.containerd.runc.v2 mars 23 14:41:06 ct-wn-2 dockerd[1584758]: time="2023-03-23T14:41:06+01:00" level=warning msg="file does not exist: /proc/sys/net/ipv6/conf/all/disable_ipv6 : stat /proc/sys/net/ipv6/conf/all/disable_ipv6: no such file or directory Has IPv6 been disabled in this node's kernel?" mars 23 14:41:06 ct-wn-2 systemd-udevd[1584792]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. mars 23 14:41:06 ct-wn-2 systemd-udevd[1584792]: Could not generate persistent MAC address for vethcc778364: No such file or directory mars 23 14:41:06 ct-wn-2 NetworkManager[882]: [1679578866.7192] manager: (vethcc778364): new Veth device (/org/freedesktop/NetworkManager/Devices/185) mars 23 14:41:06 ct-wn-2 kernel: nomad: port 20(vethcc778364) entered blocking state mars 23 14:41:06 ct-wn-2 kernel: nomad: port 20(vethcc778364) entered disabled state mars 23 14:41:06 ct-wn-2 kernel: device vethcc778364 entered promiscuous mode mars 23 14:41:06 ct-wn-2 kernel: nomad: port 20(vethcc778364) entered blocking state mars 23 14:41:06 ct-wn-2 kernel: nomad: port 20(vethcc778364) entered forwarding state mars 23 14:41:06 ct-wn-2 NetworkManager[882]: [1679578866.7290] device (vethcc778364): carrier: link connected mars 23 14:41:07 ct-wn-2 systemd[1]: opt-nomad-data-client-csi-monolith-linstor.csi.linbit.com-per\x2dalloc-b2c491cf\x2d3776\x2de2cb\x2de95d\x2d1baf62a9e4c5-prometheus\x5b0\x5d-rw\x2dfile\x2dsystem\x2dsingle\x2dnode\x2dwriter.mount: Succeeded. mars 23 14:41:07 ct-wn-2 consul[1460949]: 2023-03-23T14:41:07.444+0100 [INFO] agent: Synced service: service=_nomad-task-f7ec557d-6ce5-6b10-b9de-7c11ca281e58-group-device-services-eventbus-device-services-consumer-8080-sidecar-proxy mars 23 14:41:07 ct-wn-2 consul[1460949]: 2023-03-23T14:41:07.482+0100 [INFO] agent: Synced service: service=_nomad-task-944fbdf9-c8d2-b789-281e-23c168d51d01-group-log-collector-vector-agent--sidecar-proxy mars 23 14:41:07 ct-wn-2 consul[1460949]: 2023-03-23T14:41:07.515+0100 [INFO] agent: Synced service: service=_nomad-task-a4db9983-9ae1-d40a-6dc8-bd95513a7aae-group-rest-appliance-services-6016-sidecar-proxy mars 23 14:41:07 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:07.524+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=eaa1d919-371b-d86e-483b-8c8b38dc2b87 task=connect-proxy-alertmanager type="Task Setup" msg="Building Task Directory" failed=false mars 23 14:41:07 ct-wn-2 consul[1460949]: 2023-03-23T14:41:07.551+0100 [INFO] agent: Synced service: service=_nomad-task-e9a6bc6f-c268-95e6-0044-ba323da5fd79-group-tracking-exchange-tracking-consumer-8080-sidecar-proxy mars 23 14:41:07 ct-wn-2 consul[1460949]: 2023-03-23T14:41:07.591+0100 [INFO] agent: Synced service: service=_nomad-task-ca81ba99-08ef-37ca-3892-3b9dede18987-group-tracking-eventbus-tracking-consumer-8080-sidecar-proxy mars 23 14:41:07 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:07.609+0100 [INFO] client.alloc_runner.task_runner.task_hook.consul_si_token: derived SI token: alloc_id=eaa1d919-371b-d86e-483b-8c8b38dc2b87 task=connect-proxy-alertmanager task=connect-proxy-alertmanager si_task=alertmanager mars 23 14:41:07 ct-wn-2 consul[1460949]: 2023-03-23T14:41:07.620+0100 [INFO] agent: Synced service: service=_nomad-task-49d4f5f2-7f33-6257-2496-945d877d7f05-group-provider-services-eventbus-provider-services-consumer-8080-sidecar-proxy mars 23 14:41:07 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:07.624+0100 [INFO] client.alloc_runner.task_runner.task_hook.envoy_bootstrap: bootstrapping envoy: alloc_id=eaa1d919-371b-d86e-483b-8c8b38dc2b87 task=connect-proxy-alertmanager namespace="" proxy_id=_nomad-task-eaa1d919-371b-d86e-483b-8c8b38dc2b87-group-alertmanager-alertmanager-9093-sidecar-proxy service=alertmanager gateway="" bootstrap_file=/opt/nomad/data/alloc/eaa1d919-371b-d86e-483b-8c8b38dc2b87/connect-proxy-alertmanager/secrets/envoy_bootstrap.json grpc_addr=unix://alloc/tmp/consul_grpc.sock admin_bind=127.0.0.2:19002 ready_bind=127.0.0.1:19102 mars 23 14:41:07 ct-wn-2 consul[1460949]: 2023-03-23T14:41:07.638+0100 [INFO] agent: Synced service: service=_nomad-task-eaa1d919-371b-d86e-483b-8c8b38dc2b87-group-alertmanager-alertmanager-gossip-cluster mars 23 14:41:07 ct-wn-2 consul[1460949]: 2023-03-23T14:41:07.671+0100 [INFO] agent: Synced service: service=_nomad-task-c92f2a00-d720-778a-33cc-2b34a4bc3976-group-transient-error-autoreplay-eventbus-transient-error-autoreplay--sidecar-proxy mars 23 14:41:07 ct-wn-2 consul[1460949]: 2023-03-23T14:41:07.697+0100 [INFO] agent: Synced service: service=_nomad-task-c5fe2dd9-871d-e9c3-419d-1f44bee71ab4-group-logs-aggregator-vector-aggregator-9000-sidecar-proxy mars 23 14:41:07 ct-wn-2 consul[1460949]: 2023-03-23T14:41:07.725+0100 [INFO] agent: Synced service: service=_nomad-task-63007764-1f50-2d65-1b92-b02eeed121a5-group-traefik-traefik-https mars 23 14:41:07 ct-wn-2 consul[1460949]: 2023-03-23T14:41:07.739+0100 [INFO] agent: Synced service: service=_nomad-task-eaa1d919-371b-d86e-483b-8c8b38dc2b87-group-alertmanager-alertmanager-9093 mars 23 14:41:07 ct-wn-2 consul[1460949]: 2023-03-23T14:41:07.739+0100 [ERROR] agent.http: Request error: method=GET url=/v1/agent/service/_nomad-task-eaa1d919-371b-d86e-483b-8c8b38dc2b87-group-alertmanager-alertmanager-9093-sidecar-proxy from=127.0.0.1:39430 error="unknown service ID: _nomad-task-eaa1d919-371b-d86e-483b-8c8b38dc2b87-group-alertmanager-alertmanager-9093-sidecar-proxy" mars 23 14:41:07 ct-wn-2 consul[1460949]: 2023-03-23T14:41:07.778+0100 [INFO] agent: Synced service: service=_nomad-task-eaa1d919-371b-d86e-483b-8c8b38dc2b87-group-alertmanager-alertmanager-9093-sidecar-proxy mars 23 14:41:07 ct-wn-2 consul[1460949]: 2023-03-23T14:41:07.829+0100 [INFO] agent: Synced service: service=_nomad-task-c4c07378-4857-aa4e-0f81-00b6eec6e3a8-group-rest-provider-services-6006-sidecar-proxy mars 23 14:41:07 ct-wn-2 consul[1460949]: 2023-03-23T14:41:07.904+0100 [INFO] agent: Synced service: service=_nomad-task-402b8d27-77ed-1af0-662f-6db35c69f4df-group-appliance-services-eventbus-appliance-services-consumer-8080-sidecar-proxy mars 23 14:41:07 ct-wn-2 consul[1460949]: 2023-03-23T14:41:07.921+0100 [INFO] agent: Synced service: service=_nomad-task-eaa1d919-371b-d86e-483b-8c8b38dc2b87-group-alertmanager-alertmanager-tls-web-tls mars 23 14:41:09 ct-wn-2 systemd[1]: opt-docker-100000.100000-overlay2-44e9c706c1f43036e9ef1cef5e6a50f29d61f5c2f6016010db7fbed5f80b0d88\x2dinit-merged.mount: Succeeded. mars 23 14:41:09 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:09.455+0100 [INFO] client.driver_mgr.docker: created container: driver=docker container_id=2161d6a36d0f8ea5c3d1b9a0ac2ab461d4ed7a089842ccf51fa6e080ce024f5a mars 23 14:41:09 ct-wn-2 containerd[897]: time="2023-03-23T14:41:09.475151071+01:00" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 mars 23 14:41:09 ct-wn-2 containerd[897]: time="2023-03-23T14:41:09.475405270+01:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 mars 23 14:41:09 ct-wn-2 containerd[897]: time="2023-03-23T14:41:09.475438567+01:00" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 mars 23 14:41:09 ct-wn-2 containerd[897]: time="2023-03-23T14:41:09.475774114+01:00" level=info msg="starting signal loop" namespace=moby path=/run/containerd/io.containerd.runtime.v2.task/moby/2161d6a36d0f8ea5c3d1b9a0ac2ab461d4ed7a089842ccf51fa6e080ce024f5a pid=1585058 runtime=io.containerd.runc.v2 mars 23 14:41:09 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:09.668+0100 [INFO] client.driver_mgr.docker: started container: driver=docker container_id=2161d6a36d0f8ea5c3d1b9a0ac2ab461d4ed7a089842ccf51fa6e080ce024f5a mars 23 14:41:09 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:09.716+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=eaa1d919-371b-d86e-483b-8c8b38dc2b87 task=connect-proxy-alertmanager type=Started msg="Task started by client" failed=false mars 23 14:41:09 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:09.719+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=eaa1d919-371b-d86e-483b-8c8b38dc2b87 task=alertmanager type="Task Setup" msg="Building Task Directory" failed=false mars 23 14:41:09 ct-wn-2 consul[1460949]: 2023-03-23T14:41:09.759+0100 [WARN] agent: Check is now critical: check=_nomad-check-3e4948f79ec97d8a883a6d3920fda8a64d817c8d mars 23 14:41:09 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:09.971+0100 [INFO] agent: (runner) creating new runner (dry: false, once: false) mars 23 14:41:09 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:09.971+0100 [INFO] agent: (runner) creating watcher mars 23 14:41:09 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:09.972+0100 [INFO] agent: (runner) starting mars 23 14:41:09 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:09.974+0100 [INFO] agent: (runner) rendered "(dynamic)" => "/opt/nomad/data/alloc/eaa1d919-371b-d86e-483b-8c8b38dc2b87/alertmanager/local/cluster_tls.yml" mars 23 14:41:10 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:10.012+0100 [INFO] agent: (runner) rendered "(dynamic)" => "/opt/nomad/data/alloc/eaa1d919-371b-d86e-483b-8c8b38dc2b87/alertmanager/local/web_tls.yml" mars 23 14:41:10 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:10.021+0100 [INFO] agent: (runner) rendered "(dynamic)" => "/opt/nomad/data/alloc/eaa1d919-371b-d86e-483b-8c8b38dc2b87/alertmanager/local/entrypoint.sh" mars 23 14:41:10 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:10.059+0100 [INFO] agent: (runner) rendered "(dynamic)" => "/opt/nomad/data/alloc/eaa1d919-371b-d86e-483b-8c8b38dc2b87/alertmanager/secrets/alertmanager.yml" mars 23 14:41:10 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:10.063+0100 [INFO] agent: (runner) rendered "(dynamic)" => "/opt/nomad/data/alloc/eaa1d919-371b-d86e-483b-8c8b38dc2b87/alertmanager/local/monitoring.ca.pem" mars 23 14:41:10 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:10.319+0100 [INFO] agent: (runner) rendered "(dynamic)" => "/opt/nomad/data/alloc/eaa1d919-371b-d86e-483b-8c8b38dc2b87/alertmanager/secrets/alertmanager.bundle.pem" mars 23 14:41:10 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:10.325+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=eaa1d919-371b-d86e-483b-8c8b38dc2b87 task=alertmanager type=Driver msg="Downloading image" failed=false mars 23 14:41:10 ct-wn-2 systemd[1]: run-docker-runtime\x2drunc-moby-895088e81aef53cdf619fe0ec7c41e000e1e28b4fdac3b4ba18d0352d883ca37-runc.Icb4Ma.mount: Succeeded. mars 23 14:41:11 ct-wn-2 consul[1460949]: 2023-03-23T14:41:11.557+0100 [INFO] agent: Synced check: check=service:_nomad-task-eaa1d919-371b-d86e-483b-8c8b38dc2b87-group-alertmanager-alertmanager-9093-sidecar-proxy:2 mars 23 14:41:12 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:12.103+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=prometheus type=Killing msg="Sent interrupt. Waiting 5s before force killing" failed=false mars 23 14:41:12 ct-wn-2 kernel: XFS (drbd1020): Unmounting Filesystem mars 23 14:41:12 ct-wn-2 kernel: drbd prometheus-0: Preparing cluster-wide state change 3748034448 (3->-1 3/2) mars 23 14:41:12 ct-wn-2 kernel: drbd prometheus-0: State change 3748034448: primary_nodes=0, weak_nodes=0 mars 23 14:41:12 ct-wn-2 kernel: drbd prometheus-0: Committing cluster-wide state change 3748034448 (1ms) mars 23 14:41:12 ct-wn-2 kernel: drbd prometheus-0: role( Primary -> Secondary ) mars 23 14:41:12 ct-wn-2 dockerd[1460680]: time="2023-03-23T14:41:12.393603776+01:00" level=info msg="ignoring event" container=4c55c7d89f4fd5193b80f495af786a068c3c958b0945b09e8edc00fc9cac93b1 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete" mars 23 14:41:12 ct-wn-2 containerd[897]: time="2023-03-23T14:41:12.394088124+01:00" level=info msg="shim disconnected" id=4c55c7d89f4fd5193b80f495af786a068c3c958b0945b09e8edc00fc9cac93b1 mars 23 14:41:12 ct-wn-2 containerd[897]: time="2023-03-23T14:41:12.394144468+01:00" level=warning msg="cleaning up after shim disconnected" id=4c55c7d89f4fd5193b80f495af786a068c3c958b0945b09e8edc00fc9cac93b1 namespace=moby mars 23 14:41:12 ct-wn-2 containerd[897]: time="2023-03-23T14:41:12.394158980+01:00" level=info msg="cleaning up dead shim" mars 23 14:41:12 ct-wn-2 containerd[897]: time="2023-03-23T14:41:12.410227113+01:00" level=warning msg="cleanup warnings time=\"2023-03-23T14:41:12+01:00\" level=info msg=\"starting signal loop\" namespace=moby pid=1585228 runtime=io.containerd.runc.v2\n" mars 23 14:41:12 ct-wn-2 systemd[1]: opt-docker-100000.100000-overlay2-a9b49799d90e2219f0df94bf9fea7e3689c9b72d28bc98fd497c1fc192dedc14-merged.mount: Succeeded. mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.015+0100 [INFO] client.driver_mgr.docker: stopped container: container_id=4c55c7d89f4fd5193b80f495af786a068c3c958b0945b09e8edc00fc9cac93b1 driver=docker mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.024+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=prometheus type=Terminated msg="Exit Code: 0" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.025+0100 [INFO] client.driver_mgr.docker: created container: driver=docker container_id=c962ebdc9f60525baa799770fa06888695eaef16ff3d383a8b504a46c8454930 mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.031+0100 [INFO] client.driver_mgr.docker.docker_logger: plugin process exited: driver=docker path=/opt/nomad/bin/nomad pid=1583805 mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.044+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=prometheus type=Killed msg="Task successfully killed" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.051+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=cluster-metrics-proxy type="Main Tasks Dead" msg="Main tasks in the group died" failed=false mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.051995542+01:00" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.052080002+01:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.052095110+01:00" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.052278772+01:00" level=info msg="starting signal loop" namespace=moby path=/run/containerd/io.containerd.runtime.v2.task/moby/c962ebdc9f60525baa799770fa06888695eaef16ff3d383a8b504a46c8454930 pid=1585247 runtime=io.containerd.runc.v2 mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.055+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=connect-proxy-prometheus type="Main Tasks Dead" msg="Main tasks in the group died" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.056+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=ping-exporter type="Main Tasks Dead" msg="Main tasks in the group died" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.056+0100 [INFO] client.alloc_runner.task_runner.task_hook.logmon: plugin process exited: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=prometheus path=/opt/nomad/bin/nomad pid=1583563 mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.056+0100 [INFO] agent: (runner) stopping mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.057+0100 [INFO] agent: (runner) received finish mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.057+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=blackbox-exporter type=Killing msg="Sent interrupt. Waiting 5s before force killing" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.057+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=consul-exporter type=Killing msg="Sent interrupt. Waiting 5s before force killing" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.057+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=metrics-proxy type=Killing msg="Sent interrupt. Waiting 5s before force killing" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.058+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=cluster-metrics-proxy type=Killing msg="Sent interrupt. Waiting 5s before force killing" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.058+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=connect-proxy-prometheus type=Killing msg="Sent interrupt. Waiting 5s before force killing" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.058+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=ping-exporter type=Killing msg="Sent interrupt. Waiting 5s before force killing" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.059+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=blackbox-exporter type="Main Tasks Dead" msg="Main tasks in the group died" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.063+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=consul-exporter type="Main Tasks Dead" msg="Main tasks in the group died" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.071+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=metrics-proxy type="Main Tasks Dead" msg="Main tasks in the group died" failed=false mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.151084928+01:00" level=info msg="shim disconnected" id=822ebde6faff5aa58bf6bb99d75986f0d251c88848d31a1de065834f64c265de mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.151153612+01:00" level=warning msg="cleaning up after shim disconnected" id=822ebde6faff5aa58bf6bb99d75986f0d251c88848d31a1de065834f64c265de namespace=moby mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.151167678+01:00" level=info msg="cleaning up dead shim" mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.151069514+01:00" level=info msg="shim disconnected" id=165291e2745c8a2ccd8fb837c90690841acc56b5344799574ac8da9191afe98b mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.151248545+01:00" level=warning msg="cleaning up after shim disconnected" id=165291e2745c8a2ccd8fb837c90690841acc56b5344799574ac8da9191afe98b namespace=moby mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.151270183+01:00" level=info msg="cleaning up dead shim" mars 23 14:41:13 ct-wn-2 dockerd[1460680]: time="2023-03-23T14:41:13.151192453+01:00" level=info msg="ignoring event" container=822ebde6faff5aa58bf6bb99d75986f0d251c88848d31a1de065834f64c265de module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete" mars 23 14:41:13 ct-wn-2 dockerd[1460680]: time="2023-03-23T14:41:13.151257836+01:00" level=info msg="ignoring event" container=165291e2745c8a2ccd8fb837c90690841acc56b5344799574ac8da9191afe98b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete" mars 23 14:41:13 ct-wn-2 consul[1460949]: 2023-03-23T14:41:13.168+0100 [ERROR] agent.envoy: Error receiving new DeltaDiscoveryRequest; closing request channel: error="rpc error: code = Canceled desc = context canceled" mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.176335802+01:00" level=warning msg="cleanup warnings time=\"2023-03-23T14:41:13+01:00\" level=info msg=\"starting signal loop\" namespace=moby pid=1585320 runtime=io.containerd.runc.v2\n" mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.187440489+01:00" level=warning msg="cleanup warnings time=\"2023-03-23T14:41:13+01:00\" level=info msg=\"starting signal loop\" namespace=moby pid=1585324 runtime=io.containerd.runc.v2\n" mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.208485843+01:00" level=info msg="shim disconnected" id=2711a597a09f0a13fd6663ba2f018579b42bbfae0e3a389d3f446b5aed2f104a mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.208565720+01:00" level=warning msg="cleaning up after shim disconnected" id=2711a597a09f0a13fd6663ba2f018579b42bbfae0e3a389d3f446b5aed2f104a namespace=moby mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.208582408+01:00" level=info msg="cleaning up dead shim" mars 23 14:41:13 ct-wn-2 dockerd[1460680]: time="2023-03-23T14:41:13.210486198+01:00" level=info msg="ignoring event" container=2711a597a09f0a13fd6663ba2f018579b42bbfae0e3a389d3f446b5aed2f104a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete" mars 23 14:41:13 ct-wn-2 dockerd[1460680]: time="2023-03-23T14:41:13.211760148+01:00" level=info msg="ignoring event" container=42de004c882c513367fcfda20393f5e40ec9b3c469eeb603cf8df261f75415db module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete" mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.216368061+01:00" level=info msg="shim disconnected" id=42de004c882c513367fcfda20393f5e40ec9b3c469eeb603cf8df261f75415db mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.216435779+01:00" level=warning msg="cleaning up after shim disconnected" id=42de004c882c513367fcfda20393f5e40ec9b3c469eeb603cf8df261f75415db namespace=moby mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.216449297+01:00" level=info msg="cleaning up dead shim" mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.226+0100 [INFO] client.driver_mgr.docker: stopped container: container_id=165291e2745c8a2ccd8fb837c90690841acc56b5344799574ac8da9191afe98b driver=docker mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.233015606+01:00" level=warning msg="cleanup warnings time=\"2023-03-23T14:41:13+01:00\" level=info msg=\"starting signal loop\" namespace=moby pid=1585359 runtime=io.containerd.runc.v2\n" mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.234+0100 [INFO] client.driver_mgr.docker: stopped container: container_id=822ebde6faff5aa58bf6bb99d75986f0d251c88848d31a1de065834f64c265de driver=docker mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.238+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=blackbox-exporter type=Terminated msg="Exit Code: 0" failed=false mars 23 14:41:13 ct-wn-2 dockerd[1460680]: time="2023-03-23T14:41:13.244794225+01:00" level=info msg="ignoring event" container=b8e02f715e66ffb3415723606ae89b9246119f4e081b21e9f003d3e5e5be3c17 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete" mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.247+0100 [INFO] client.driver_mgr.docker.docker_logger: plugin process exited: driver=docker path=/opt/nomad/bin/nomad pid=1584153 mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.247250992+01:00" level=warning msg="cleanup warnings time=\"2023-03-23T14:41:13+01:00\" level=info msg=\"starting signal loop\" namespace=moby pid=1585366 runtime=io.containerd.runc.v2\n" mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.250765092+01:00" level=info msg="shim disconnected" id=b8e02f715e66ffb3415723606ae89b9246119f4e081b21e9f003d3e5e5be3c17 mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.250824413+01:00" level=warning msg="cleaning up after shim disconnected" id=b8e02f715e66ffb3415723606ae89b9246119f4e081b21e9f003d3e5e5be3c17 namespace=moby mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.250868104+01:00" level=info msg="cleaning up dead shim" mars 23 14:41:13 ct-wn-2 dockerd[1460680]: time="2023-03-23T14:41:13.262395609+01:00" level=info msg="ignoring event" container=2b7fd080a7cc95b722a59e561868333f33745388b00c8a78a1f7d9ce8c44b8a7 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete" mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.263058638+01:00" level=info msg="shim disconnected" id=2b7fd080a7cc95b722a59e561868333f33745388b00c8a78a1f7d9ce8c44b8a7 mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.263142344+01:00" level=warning msg="cleaning up after shim disconnected" id=2b7fd080a7cc95b722a59e561868333f33745388b00c8a78a1f7d9ce8c44b8a7 namespace=moby mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.263160235+01:00" level=info msg="cleaning up dead shim" mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.272+0100 [INFO] client.driver_mgr.docker: started container: driver=docker container_id=c962ebdc9f60525baa799770fa06888695eaef16ff3d383a8b504a46c8454930 mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.278576241+01:00" level=warning msg="cleanup warnings time=\"2023-03-23T14:41:13+01:00\" level=info msg=\"starting signal loop\" namespace=moby pid=1585410 runtime=io.containerd.runc.v2\n" mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.282056757+01:00" level=warning msg="cleanup warnings time=\"2023-03-23T14:41:13+01:00\" level=info msg=\"starting signal loop\" namespace=moby pid=1585422 runtime=io.containerd.runc.v2\n" mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.301+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=consul-exporter type=Terminated msg="Exit Code: 2, Exit Message: \"Docker container exited with non-zero exit code: 2\"" failed=false mars 23 14:41:13 ct-wn-2 systemd[1]: opt-docker-100000.100000-overlay2-7ca56eeb481c32fdfea7232b5a0c21a1708e8d3d3be29cb523db2a5c169671e6-merged.mount: Succeeded. mars 23 14:41:13 ct-wn-2 systemd[1]: opt-docker-100000.100000-overlay2-b7a8fb1de7ed506a275e42c58968fd07a5922f3506f517c25814cea13f343530-merged.mount: Succeeded. mars 23 14:41:13 ct-wn-2 systemd[1]: opt-docker-100000.100000-overlay2-9d162f50ae68de15ecbce7ee5fe559dc2109020b1b6ab4bbe4116663d9525b54-merged.mount: Succeeded. mars 23 14:41:13 ct-wn-2 systemd[1]: opt-docker-100000.100000-overlay2-bfbdee2fa2fea7104d86602fc5e40f2480b9019eec74b6954f83c736918929ab-merged.mount: Succeeded. mars 23 14:41:13 ct-wn-2 systemd[1]: opt-docker-100000.100000-overlay2-eb862d464f5c6e16e3b848ec328f91fc647ce14416f7a771642d62d9b0cf2c04-merged.mount: Succeeded. mars 23 14:41:13 ct-wn-2 systemd[1]: opt-docker-100000.100000-overlay2-3d41936ccc15029ee9029fecd073c292341e9c166b3501e6b3f9fc4ee9201b3a-merged.mount: Succeeded. mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.309+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=blackbox-exporter type=Killed msg="Task successfully killed" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.328+0100 [INFO] client.driver_mgr.docker.docker_logger: plugin process exited: driver=docker path=/opt/nomad/bin/nomad pid=1584179 mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.329+0100 [INFO] client.driver_mgr.docker: stopped container: container_id=2b7fd080a7cc95b722a59e561868333f33745388b00c8a78a1f7d9ce8c44b8a7 driver=docker mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.333+0100 [INFO] client.alloc_runner.task_runner.task_hook.logmon: plugin process exited: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=blackbox-exporter path=/opt/nomad/bin/nomad pid=1583837 mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.334+0100 [INFO] client.driver_mgr.docker: stopped container: container_id=2711a597a09f0a13fd6663ba2f018579b42bbfae0e3a389d3f446b5aed2f104a driver=docker mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.334+0100 [INFO] client.driver_mgr.docker: stopped container: container_id=42de004c882c513367fcfda20393f5e40ec9b3c469eeb603cf8df261f75415db driver=docker mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.335+0100 [INFO] client.driver_mgr.docker: stopped container: container_id=b8e02f715e66ffb3415723606ae89b9246119f4e081b21e9f003d3e5e5be3c17 driver=docker mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.336+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=eaa1d919-371b-d86e-483b-8c8b38dc2b87 task=alertmanager type=Started msg="Task started by client" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.338+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=consul-exporter type=Killed msg="Task successfully killed" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.343+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=cluster-metrics-proxy type=Terminated msg="Exit Code: 0" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.343+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=connect-proxy-prometheus type=Terminated msg="Exit Code: 0" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.349+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=eaa1d919-371b-d86e-483b-8c8b38dc2b87 task=tls-proxy type="Task Setup" msg="Building Task Directory" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.353+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=ping-exporter type=Terminated msg="Exit Code: 2, Exit Message: \"Docker container exited with non-zero exit code: 2\"" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.353+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=metrics-proxy type=Terminated msg="Exit Code: 0" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.370+0100 [INFO] client.driver_mgr.docker.docker_logger: plugin process exited: driver=docker path=/opt/nomad/bin/nomad pid=1584061 mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.370+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=connect-proxy-prometheus type=Killed msg="Task successfully killed" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.371+0100 [INFO] client.driver_mgr.docker.docker_logger: plugin process exited: driver=docker path=/opt/nomad/bin/nomad pid=1583994 mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.371+0100 [INFO] client.driver_mgr.docker.docker_logger: plugin process exited: driver=docker path=/opt/nomad/bin/nomad pid=1584337 mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.371+0100 [INFO] client.alloc_runner.task_runner.task_hook.logmon: plugin process exited: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=consul-exporter path=/opt/nomad/bin/nomad pid=1583820 mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.372+0100 [INFO] agent: (runner) stopping mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.372+0100 [INFO] agent: (runner) received finish mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.372+0100 [INFO] client.driver_mgr.docker.docker_logger: plugin process exited: driver=docker path=/opt/nomad/bin/nomad pid=1583551 mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.377+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=cluster-metrics-proxy type=Killed msg="Task successfully killed" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.385+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=ping-exporter type=Killed msg="Task successfully killed" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.396+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=metrics-proxy type=Killed msg="Task successfully killed" failed=false mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.407+0100 [INFO] client.alloc_runner.task_runner.task_hook.logmon: plugin process exited: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=connect-proxy-prometheus path=/opt/nomad/bin/nomad pid=1583487 mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.407+0100 [INFO] client.alloc_runner.task_runner.task_hook.logmon: plugin process exited: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=cluster-metrics-proxy path=/opt/nomad/bin/nomad pid=1583834 mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.407+0100 [INFO] agent: (runner) stopping mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.408+0100 [INFO] agent: (runner) received finish mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.416+0100 [INFO] client.alloc_runner.task_runner.task_hook.logmon: plugin process exited: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=metrics-proxy path=/opt/nomad/bin/nomad pid=1583823 mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.416+0100 [INFO] client.alloc_runner.task_runner.task_hook.logmon: plugin process exited: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=ping-exporter path=/opt/nomad/bin/nomad pid=1583817 mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.416+0100 [INFO] agent: (runner) stopping mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.416+0100 [INFO] agent: (runner) received finish mars 23 14:41:13 ct-wn-2 kernel: nomad: port 12(veth2b02b486) entered disabled state mars 23 14:41:13 ct-wn-2 kernel: device veth2b02b486 left promiscuous mode mars 23 14:41:13 ct-wn-2 kernel: nomad: port 12(veth2b02b486) entered disabled state mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.560+0100 [INFO] agent: (runner) creating new runner (dry: false, once: false) mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.560+0100 [INFO] agent: (runner) creating watcher mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.560+0100 [INFO] agent: (runner) starting mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.562+0100 [INFO] agent: (runner) rendered "(dynamic)" => "/opt/nomad/data/alloc/eaa1d919-371b-d86e-483b-8c8b38dc2b87/tls-proxy/local/alertmanager.conf" mars 23 14:41:13 ct-wn-2 dockerd[1460680]: time="2023-03-23T14:41:13.609634981+01:00" level=info msg="ignoring event" container=6f8d089ac0dc317b47518ae5277ce6a405d0746f6fc77a595754963e5e3b97ed module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete" mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.611290964+01:00" level=info msg="shim disconnected" id=6f8d089ac0dc317b47518ae5277ce6a405d0746f6fc77a595754963e5e3b97ed mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.611348018+01:00" level=warning msg="cleaning up after shim disconnected" id=6f8d089ac0dc317b47518ae5277ce6a405d0746f6fc77a595754963e5e3b97ed namespace=moby mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.611361482+01:00" level=info msg="cleaning up dead shim" mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.620+0100 [INFO] agent: (runner) rendered "(dynamic)" => "/opt/nomad/data/alloc/eaa1d919-371b-d86e-483b-8c8b38dc2b87/tls-proxy/local/monitoring.ca.pem" mars 23 14:41:13 ct-wn-2 containerd[897]: time="2023-03-23T14:41:13.625713877+01:00" level=warning msg="cleanup warnings time=\"2023-03-23T14:41:13+01:00\" level=info msg=\"starting signal loop\" namespace=moby pid=1585529 runtime=io.containerd.runc.v2\n" mars 23 14:41:13 ct-wn-2 dockerd[1460680]: time="2023-03-23T14:41:13.626532348+01:00" level=warning msg="ShouldRestart failed, container will not be restarted" container=6f8d089ac0dc317b47518ae5277ce6a405d0746f6fc77a595754963e5e3b97ed daemonShuttingDown=false error="restart canceled" execDuration=4m39.841309471s exitStatus="{137 false 2023-03-23 13:41:13.591674529 +0000 UTC}" hasBeenManuallyStopped=true restartCount=0 mars 23 14:41:13 ct-wn-2 systemd[1]: run-docker-netns-518caa0d364e.mount: Succeeded. mars 23 14:41:13 ct-wn-2 systemd[1]: opt-docker-100000.100000-overlay2-dd2e6e49a37476e445370bc4d684a573513e99e939092b0cbe4b70b4ff934c80-merged.mount: Succeeded. mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.964+0100 [WARN] agent: vault.pki(pki/monitoring/issue/metrics->/opt/nomad/data/alloc/eaa1d919-371b-d86e-483b-8c8b38dc2b87/tls-proxy/secrets/metrics.bundle.pem): TTL "768h0m0s" is longer than permitted maxTTL "72h0m0s", so maxTTL is being used mars 23 14:41:13 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:13.965+0100 [INFO] agent: (runner) rendered "(dynamic)" => "/opt/nomad/data/alloc/eaa1d919-371b-d86e-483b-8c8b38dc2b87/tls-proxy/secrets/metrics.bundle.pem" mars 23 14:41:14 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:14.263+0100 [INFO] agent: (runner) rendered "(dynamic)" => "/opt/nomad/data/alloc/eaa1d919-371b-d86e-483b-8c8b38dc2b87/tls-proxy/secrets/alertmanager.bundle.pem" mars 23 14:41:14 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:14.352+0100 [INFO] client.driver_mgr.docker: created container: driver=docker container_id=51262bad74aaccc9ea3ec83671a62b75d82596332e65ffe484871d453d4eea1d mars 23 14:41:14 ct-wn-2 containerd[897]: time="2023-03-23T14:41:14.379531552+01:00" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 mars 23 14:41:14 ct-wn-2 containerd[897]: time="2023-03-23T14:41:14.379655110+01:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 mars 23 14:41:14 ct-wn-2 containerd[897]: time="2023-03-23T14:41:14.379676415+01:00" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 mars 23 14:41:14 ct-wn-2 containerd[897]: time="2023-03-23T14:41:14.380022613+01:00" level=info msg="starting signal loop" namespace=moby path=/run/containerd/io.containerd.runtime.v2.task/moby/51262bad74aaccc9ea3ec83671a62b75d82596332e65ffe484871d453d4eea1d pid=1585568 runtime=io.containerd.runc.v2 mars 23 14:41:14 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:14.523+0100 [INFO] client.driver_mgr.docker: started container: driver=docker container_id=51262bad74aaccc9ea3ec83671a62b75d82596332e65ffe484871d453d4eea1d mars 23 14:41:14 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:14.565+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=eaa1d919-371b-d86e-483b-8c8b38dc2b87 task=tls-proxy type=Started msg="Task started by client" failed=false mars 23 14:41:14 ct-wn-2 consul[1460949]: 2023-03-23T14:41:14.768+0100 [WARN] agent: Check is now critical: check=_nomad-check-3e4948f79ec97d8a883a6d3920fda8a64d817c8d mars 23 14:41:15 ct-wn-2 consul[1460949]: 2023-03-23T14:41:15.788+0100 [WARN] agent: Check is now critical: check=_nomad-check-8d3f873b28c99d04c5ea4ab270f3e52116857fe9 mars 23 14:41:15 ct-wn-2 consul[1460949]: 2023-03-23T14:41:15.797+0100 [INFO] agent: Synced check: check=_nomad-check-8d3f873b28c99d04c5ea4ab270f3e52116857fe9 mars 23 14:41:15 ct-wn-2 consul[1460949]: 2023-03-23T14:41:15.805+0100 [INFO] agent: Synced check: check=service:_nomad-task-b2c491cf-3776-e2cb-e95d-1baf62a9e4c5-group-metrics-server-prometheus-9090-sidecar-proxy:1 mars 23 14:41:16 ct-wn-2 consul[1460949]: 2023-03-23T14:41:16.901+0100 [WARN] agent: Check socket connection failed: check=service:_nomad-task-b2c491cf-3776-e2cb-e95d-1baf62a9e4c5-group-metrics-server-prometheus-9090-sidecar-proxy:2 error="dial tcp 10.118.7.22:24276: connect: connection refused" mars 23 14:41:16 ct-wn-2 consul[1460949]: 2023-03-23T14:41:16.901+0100 [WARN] agent: Check is now critical: check=service:_nomad-task-b2c491cf-3776-e2cb-e95d-1baf62a9e4c5-group-metrics-server-prometheus-9090-sidecar-proxy:2 mars 23 14:41:16 ct-wn-2 consul[1460949]: 2023-03-23T14:41:16.910+0100 [INFO] agent: Synced check: check=service:_nomad-task-b2c491cf-3776-e2cb-e95d-1baf62a9e4c5-group-metrics-server-prometheus-9090-sidecar-proxy:2 mars 23 14:41:19 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:19.082+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=prometheus type=Killing msg="Sent interrupt. Waiting 5s before force killing" failed=false mars 23 14:41:19 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:19.083+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=connect-proxy-prometheus type=Killing msg="Sent interrupt. Waiting 5s before force killing" failed=false mars 23 14:41:19 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:19.083+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=consul-exporter type=Killing msg="Sent interrupt. Waiting 5s before force killing" failed=false mars 23 14:41:19 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:19.083+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=ping-exporter type=Killing msg="Sent interrupt. Waiting 5s before force killing" failed=false mars 23 14:41:19 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:19.083+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=blackbox-exporter type=Killing msg="Sent interrupt. Waiting 5s before force killing" failed=false mars 23 14:41:19 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:19.084+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=cluster-metrics-proxy type=Killing msg="Sent interrupt. Waiting 5s before force killing" failed=false mars 23 14:41:19 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:19.083+0100 [INFO] client.alloc_runner.task_runner: Task event: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=metrics-proxy type=Killing msg="Sent interrupt. Waiting 5s before force killing" failed=false mars 23 14:41:19 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:19.093+0100 [INFO] client.alloc_runner: waiting for task to exit: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=cluster-metrics-proxy mars 23 14:41:19 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:19.093+0100 [INFO] client.alloc_runner: waiting for task to exit: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=connect-proxy-prometheus mars 23 14:41:19 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:19.093+0100 [INFO] client.alloc_runner: waiting for task to exit: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=ping-exporter mars 23 14:41:19 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:19.093+0100 [INFO] client.alloc_runner: waiting for task to exit: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=blackbox-exporter mars 23 14:41:19 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:19.093+0100 [INFO] client.alloc_runner: waiting for task to exit: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=consul-exporter mars 23 14:41:19 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:19.093+0100 [INFO] client.alloc_runner: waiting for task to exit: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 task=metrics-proxy mars 23 14:41:19 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:19.093+0100 [INFO] client.gc: marking allocation for GC: alloc_id=b2c491cf-3776-e2cb-e95d-1baf62a9e4c5 mars 23 14:41:19 ct-wn-2 linstor-satellite[363317]: 14:41:19.135 [MainWorkerPool-2] INFO LINSTOR/Satellite - SYSTEM - Resource 'prometheus-0' updated for node 'ct-s-1'. mars 23 14:41:19 ct-wn-2 linstor-satellite[363317]: 14:41:19.135 [MainWorkerPool-2] INFO LINSTOR/Satellite - SYSTEM - Resource 'prometheus-0' updated for node 'ct-s-2'. mars 23 14:41:19 ct-wn-2 linstor-satellite[363317]: 14:41:19.135 [MainWorkerPool-2] INFO LINSTOR/Satellite - SYSTEM - Resource 'prometheus-0' updated for node 'ct-s-3'. mars 23 14:41:19 ct-wn-2 linstor-satellite[363317]: 14:41:19.135 [MainWorkerPool-2] INFO LINSTOR/Satellite - SYSTEM - Resource 'prometheus-0' updated for node 'ct-wn-2'. mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0: Preparing cluster-wide state change 651131257 (3->0 496/16) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0: State change 651131257: primary_nodes=0, weak_nodes=0 mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0: Committing cluster-wide state change 651131257 (0ms) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-1: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown ) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0/0 drbd1020 ct-s-1: pdsk( UpToDate -> DUnknown ) repl( Established -> Off ) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-1: ack_receiver terminated mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-1: Terminating ack_recv thread mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-2: Preparing remote state change 1959616540 mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-1: Terminating sender thread mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-1: Starting sender thread (from drbd_r_promethe [1582451]) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-2: Committing remote state change 1959616540 (primary_nodes=0) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-1: Connection closed mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-1: helper command: /sbin/drbdadm disconnected mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-1: helper command: /sbin/drbdadm disconnected exit code 0 mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-1: conn( Disconnecting -> StandAlone ) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-1: Terminating receiver thread mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-1: Terminating sender thread mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0: Preparing cluster-wide state change 533896792 (3->1 496/16) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0: State change 533896792: primary_nodes=0, weak_nodes=0 mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0: Committing cluster-wide state change 533896792 (1ms) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-2: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown ) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0/0 drbd1020 ct-s-2: pdsk( UpToDate -> DUnknown ) repl( Established -> Off ) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-2: ack_receiver terminated mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-2: Terminating ack_recv thread mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-2: Terminating sender thread mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-2: Starting sender thread (from drbd_r_promethe [1582452]) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-2: Connection closed mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-2: helper command: /sbin/drbdadm disconnected mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-2: helper command: /sbin/drbdadm disconnected exit code 0 mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-2: conn( Disconnecting -> StandAlone ) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-2: Terminating receiver thread mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-2: Terminating sender thread mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0: Preparing cluster-wide state change 1382897779 (3->2 496/16) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0: State change 1382897779: primary_nodes=0, weak_nodes=0 mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-3: Cluster is now split mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0: Committing cluster-wide state change 1382897779 (3ms) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-3: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown ) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0/0 drbd1020: quorum( yes -> no ) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0/0 drbd1020 ct-s-3: pdsk( UpToDate -> DUnknown ) repl( Established -> Off ) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-3: ack_receiver terminated mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-3: Terminating ack_recv thread mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-3: Terminating sender thread mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-3: Starting sender thread (from drbd_r_promethe [1582453]) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-3: Connection closed mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-3: helper command: /sbin/drbdadm disconnected mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-3: helper command: /sbin/drbdadm disconnected exit code 0 mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-3: conn( Disconnecting -> StandAlone ) mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-3: Terminating receiver thread mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0 ct-s-3: Terminating sender thread mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0/0 drbd1020: drbd_bm_resize called with capacity == 0 mars 23 14:41:19 ct-wn-2 kernel: drbd prometheus-0: Terminating worker thread mars 23 14:41:19 ct-wn-2 containerd[897]: time="2023-03-23T14:41:19.260969244+01:00" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 mars 23 14:41:19 ct-wn-2 containerd[897]: time="2023-03-23T14:41:19.261095358+01:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 mars 23 14:41:19 ct-wn-2 containerd[897]: time="2023-03-23T14:41:19.261129913+01:00" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 mars 23 14:41:19 ct-wn-2 containerd[897]: time="2023-03-23T14:41:19.261395712+01:00" level=info msg="starting signal loop" namespace=moby path=/run/containerd/io.containerd.runtime.v2.task/moby/eaa86d65debe6b062afcaf0ac1281cd9e293a633bfe5dd1ec54838c752130d53 pid=1585675 runtime=io.containerd.runc.v2 mars 23 14:41:19 ct-wn-2 dockerd[1585709]: time="2023-03-23T14:41:19+01:00" level=warning msg="file does not exist: /proc/sys/net/ipv6/conf/all/disable_ipv6 : stat /proc/sys/net/ipv6/conf/all/disable_ipv6: no such file or directory Has IPv6 been disabled in this node's kernel?" mars 23 14:41:19 ct-wn-2 systemd-udevd[1585740]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. mars 23 14:41:19 ct-wn-2 systemd-udevd[1585740]: Could not generate persistent MAC address for veth89ae63ed: No such file or directory mars 23 14:41:19 ct-wn-2 NetworkManager[882]: [1679578879.6072] manager: (veth89ae63ed): new Veth device (/org/freedesktop/NetworkManager/Devices/186) mars 23 14:41:19 ct-wn-2 kernel: nomad: port 12(veth89ae63ed) entered blocking state mars 23 14:41:19 ct-wn-2 kernel: nomad: port 12(veth89ae63ed) entered disabled state mars 23 14:41:19 ct-wn-2 kernel: device veth89ae63ed entered promiscuous mode mars 23 14:41:19 ct-wn-2 kernel: nomad: port 12(veth89ae63ed) entered blocking state mars 23 14:41:19 ct-wn-2 kernel: nomad: port 12(veth89ae63ed) entered forwarding state mars 23 14:41:19 ct-wn-2 NetworkManager[882]: [1679578879.6188] device (veth89ae63ed): carrier: link connected mars 23 14:41:19 ct-wn-2 consul[1460949]: 2023-03-23T14:41:19.771+0100 [WARN] agent: Check is now critical: check=_nomad-check-3e4948f79ec97d8a883a6d3920fda8a64d817c8d mars 23 14:41:19 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:19.951+0100 [ERROR] client.rpc: error performing RPC to server: error="rpc error: rpc error: volume max claims reached" rpc=CSIVolume.Claim server=10.118.7.18:4647 mars 23 14:41:19 ct-wn-2 nomad[1460691]: 2023-03-23T14:41:19.951+0100 [ERROR] client.rpc: error performing RPC to server which is not safe to automatically retry: error="rpc error: rpc error: volume max claims reached" rpc=CSIVolume.Claim server=10.118.7.18:4647 mars 23 14:41:20 ct-wn-2 consul[1460949]: 2023-03-23T14:41:20.037+0100 [INFO] agent: Synced service: service=_nomad-task-dae91d49-e956-42b3-5c58-4ebd1ba1dec2-group-metrics-server-prometheus-9090 mars 23 14:41:20 ct-wn-2 consul[1460949]: 2023-03-23T14:41:20.051+0100 [INFO] agent: Synced service: service=_nomad-task-dae91d49-e956-42b3-5c58-4ebd1ba1dec2-group-metrics-server-prometheus-9090-sidecar-proxy mars 23 14:41:20 ct-wn-2 consul[1460949]: 2023-03-23T14:41:20.789+0100 [WARN] agent: Check is now critical: check=_nomad-check-8d3f873b28c99d04c5ea4ab270f3e52116857fe9