How to configure errorHandler when using @RetryableTopic

[TheLeftHandOfGod]

When I use @RetryableTopic, the errorHandler configuration of @KafkaListener does not take effect and is replaced with SeekToCurrentErrorHandler, I want to print the error stack trace. How should I configure?

@RetryableTopic(
        attempts = "2",
        backoff = @Backoff(delay = 1000L, multiplier = 2.0),
        topicSuffixingStrategy = TopicSuffixingStrategy.SUFFIX_WITH_INDEX_VALUE,
        fixedDelayTopicStrategy = FixedDelayStrategy.SINGLE_TOPIC,
        listenerContainerFactory = "retryKafkaListenerContainerFactory"
)
@KafkaListener(
        topics = TOPIC_ENTERPRISE,
        clientIdPrefix = "enterprise",
        containerFactory = "kafkaListenerContainerFactory",
        errorHandler = "customKafkaListenerErrorHandler"
)
public void enterpriseConsumer(ConsumerRecord<Long, String> record) {
    LOGGER.info("{} - topoc:{}, part: {}, offset: {}， key: {}, value: {}", Thread.currentThread().getName(), record.topic(), record.partition(), record.offset(), record.key(), record.value());
    int i = 1 / 0;
}

[garyrussell]

It's a bug; the error handler is not set up when it's retryable.

It's not actually replaced; the STCEH is a container error handler used to handle the retries. The errorHandler is a KafkaListenerErrorHandler and it is (incorrectly) ignored.

The KLEH must re-throw the exception to make the retries work.

Thanks for reporting.

[h0riz4n]

Sorry, but now is it possible to configure errorHandler while using RetryableTopic annotation?

If it's possible, can u show me how can I configure errorHandler?
I need it cause I want log errors by my self without stacktrace in console

[artembilan]

See @KafkaListener(errorHandler).
This test demonstrate such a feature: https://github.com/spring-projects/spring-kafka/blob/main/spring-kafka/src/test/java/org/springframework/kafka/retrytopic/RetryTopicIntegrationTests.java#L328

[h0riz4n]

See @KafkaListener(errorHandler). This test demonstrate such a feature: https://github.com/spring-projects/spring-kafka/blob/main/spring-kafka/src/test/java/org/springframework/kafka/retrytopic/RetryTopicIntegrationTests.java#L328

Yes, I have this one variant, but when I throwing errors in my errorHandler then @RetryableTopic annotation takes this and throwing full stacktrace in console and I want to log error by my self without stacktrace

[artembilan]

There is option like this:

			@Override
			protected void configureCustomizers(CustomizersConfigurer customizersConfigurer) {
				customizersConfigurer
						.customizeDeadLetterPublishingRecoverer(dlprCustomizer)
						.customizeListenerContainer(listenerContainerCustomizer)
						.customizeErrorHandler(errorHandlerCustomizer);
			}

on the RetryTopicConfigurationSupport.
In that errorHandlerCustomizer you can do errorHandler.setLogLevel(KafkaException.Level.ERROR); to lose that debug by default.

This part of documentation how to configure that Support: https://docs.spring.io/spring-kafka/reference/retrytopic/retry-config.html#retry-topic-global-settings

[h0riz4n]

I apologize for my stupidity, but no matter how I work with the configs, I still get this stacktrace, I want just log exception message

[artembilan]

Thanks for sharing stacktrace!

Now I see where it is:

		if (nextDestination.isDltTopic()
				&& !ListenerExceptionLoggingStrategy.NEVER.equals(this.loggingStrategy)) {
			LOGGER.error(e, () -> getErrorMessage(cr) + " and won't be retried. "
					+ "Sending to DLT with name " + nextDestination.getDestinationName() + ".");
		}

So, apparently we can configure that loggingStrategy to ListenerExceptionLoggingStrategy.NEVER.

See same RetryTopicConfigurationSupport:

		@Override
		protected Consumer<DeadLetterPublishingRecovererFactory> configureDeadLetterPublishingContainerFactory() {
			return DeadLetterPublishingRecovererFactory::neverLogListenerException;
		}