Facing issues while trying to run snowflake kafka connector using strimzi kafka connect CR #9825
-
Hi, I'm trying to setup a consumer using strimzi kafka connect CR and use snowflake kafka connector.
Here is my Dockerfile definition:
I'm building, tagging and pushing this dockerfile to AWS ECR, since my Kafka cluster is deployed on EKS.
Currently for testing I'm deploying this using Post deploying I can see that the pod is running but not in ready state. Sometimes it takes 5 mins to get into ready state whereas sometimes it never gets into ready state. So not sure what is going wrong in this case. How do I go about debugging this?
Here are the last few logs for the pod:
Once the strimzi-kafka-connect pod is in ready state, I'm applying the snowflake-kafka-connector.yaml.
But the connector fails to start with following error:
I am adding the |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 3 replies
-
Not really sure why are you putting the JARs into the |
Beta Was this translation helpful? Give feedback.
Not really sure why are you putting the JARs into the
libs
directory. You should have it just in the/opt/kafka/plugins/snowflake/
. You should also keep in mind that these errors are a bit tricky. It sometimes means that some other JARs with classes used by this class are missing etc. So you should make sure the JARs you add there are really all that is needed.