Liveness and Readiness probe failed / failing. #10145
Replies: 3 comments 2 replies
-
I think you should start by configuring some reasonable resource and memory requests for all the nodes -> that way we will know for sure what amount of resources they have and if that can be an issue or not. I do not know what you use your Kafka cluster for, but for development and testing locally, I normally give it something like: resources:
requests:
memory: 2Gi
cpu: 500m
limits:
memory: 2Gi
cpu: "1" which might be a good start. |
Beta Was this translation helpful? Give feedback.
-
Updated to strimzi-kafka-operator-0.41.0 - same issue. |
Beta Was this translation helpful? Give feedback.
-
Problem disappeared and I didn't manage to reproduce it on different clusters. |
Beta Was this translation helpful? Give feedback.
-
After migration to KRaft mode:
strimzi-kafka-operator-0.40.0
I experience failing probes (liveness and readiness) on both controller and broker nodes.
Can't find anything helpful in logs, very few WARNs usually just after start of the node, then any logs even when status is reported as unhealthy due to failing probes.
I've tried extending timeout, which is currently at:
Cluster is running on 3 controller nodes and 5 broker nodes:
CPU & memory usage:
![image](https://private-user-images.githubusercontent.com/35076949/332742579-49ea36e1-77bc-4399-8a9c-5c83a24141a8.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQ5NjI2ODQsIm5iZiI6MTcyNDk2MjM4NCwicGF0aCI6Ii8zNTA3Njk0OS8zMzI3NDI1NzktNDllYTM2ZTEtNzdiYy00Mzk5LThhOWMtNWM4M2EyNDE0MWE4LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MjklMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODI5VDIwMTMwNFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTM3MmI4Njc3NmExM2FlZDM3Yjg5YWIwOTdjOWFhM2Y3M2E1YTFlNzc2OTk4ODg0MjY3ZTM0MGY5Y2FjY2I2NDMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.Nry7Xs1bxhrvLvwvfYURYgBj9ptf1Yk2JHBCb8yCvOk)
Beta Was this translation helpful? Give feedback.
All reactions