Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

IMDS query failed , exit code: 28 #4757

Open
ravinayag opened this issue Jan 20, 2025 · 2 comments
Open

IMDS query failed , exit code: 28 #4757

ravinayag opened this issue Jan 20, 2025 · 2 comments

Comments

@ravinayag
Copy link

I have recently launched the AKS node pool with spot instances, The node get launched, I can see from the Kubectl get nodes in Ready Stattus.
However when i check with kubectl describe node i see some errors in the events. I thought it may be a random error. to check i deleted the node and autoscaler was able launch new node. But the erorrs on events still appeared on new node.

Can i continue this node with worloads ? what is the impact continuing with the errors.?
Any known issue or fix available?

  Type     Reason                   Age                From                                                          Message
  ----     ------                   ----               ----                                                          -------
  Normal   Starting                 55s                kube-proxy
  Normal   NodeHasSufficientMemory  73s (x2 over 73s)  kubelet                                                       Node aks-apppoolspot-31828581-vmss000001 status is now: NodeHasSufficientMemory
  Warning  InvalidDiskCapacity      73s                kubelet                                                       invalid capacity 0 on image filesystem
  Normal   NodeHasNoDiskPressure    73s (x2 over 73s)  kubelet                                                       Node aks-apppoolspot-31828581-vmss000001 status is now: NodeHasNoDiskPressure
  Normal   NodeHasSufficientPID     73s (x2 over 73s)  kubelet                                                       Node aks-apppoolspot-31828581-vmss000001 status is now: NodeHasSufficientPID
  Normal   NodeAllocatableEnforced  73s                kubelet                                                       Updated Node Allocatable limit across pods
  Normal   Starting                 73s                kubelet                                                       Starting kubelet.
  Normal   NodeReady                72s                kubelet                                                       Node aks-apppoolspot-31828581-vmss000001 status is now: NodeReady
  Normal   RegisteredNode           68s                node-controller                                               Node aks-apppoolspot-31828581-vmss000001 event: Registered Node aks-apppoolspot-31828581-vmss000001 in Controller
  Warning  ContainerdStart          63s (x2 over 63s)  systemd-monitor                                               Starting containerd container runtime...
  Normal   NoVMEventScheduled       41s                custom-scheduledevents-consolidated-condition-plugin-monitor  Node condition VMEventScheduled is now: Unknown, reason: NoVMEventScheduled, message: "IMDS query failed, exit code: 28\nConnection timed out after 24 seconds."
  Warning  PreemptScheduled         41s                custom-scheduledevents-consolidated-preempt-plugin-monitor    IMDS query failed, exit code: 28
Connection timed out after 24 seconds.
  Normal  NoVMEventScheduled  41s  custom-scheduledevents-consolidated-condition-plugin-monitor  Node condition VMEventScheduled is now: False, reason: NoVMEventScheduled, message: "VM has no scheduled event"
Copy link
Contributor

@Azure/aks-pm issue needs labels

Copy link
Contributor

@allyford, @justindavies, @stl327 would you be able to assist?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants