Skip to content

Add multi-topic listening for Kafka#2300

Merged
jeremydmiller merged 1 commit intomainfrom
kafka-multi-topic-listening
Mar 12, 2026
Merged

Add multi-topic listening for Kafka#2300
jeremydmiller merged 1 commit intomainfrom
kafka-multi-topic-listening

Conversation

@jeremydmiller
Copy link
Member

Summary

Closes #2297

  • Adds ListenToKafkaTopics() extension method to subscribe to multiple Kafka topics with a single consumer
  • KafkaTopicGroup extends KafkaTopic so it integrates seamlessly with the existing BrokerTransport<KafkaTopic> endpoint discovery
  • URI pattern uses concatenated topic names: kafka://topic/orders_invoices_shipments
  • Supports consumer config overrides, dead letter queues, and all standard listener modes (inline, buffered, durable)
  • End-to-end tests verify messages from multiple topics arrive through a single consumer
  • Documentation added to the Kafka transport guide

Test plan

  • multi_topic_listening.receive_from_multiple_topics_with_single_consumer — verifies messages from two topics are received
  • multi_topic_listening.topic_group_uri_uses_concatenated_names — verifies endpoint discovery and URI pattern
  • Existing KafkaTransportTests all pass (no regressions)
  • Configuration precedence tests pass

🤖 Generated with Claude Code

Introduces ListenToKafkaTopics() to subscribe to multiple Kafka topics
with a single consumer, reducing consumer group rebalances and startup
time. KafkaTopicGroup extends KafkaTopic for seamless endpoint discovery.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Kafka: Support a single listener subscribing to multiple topics

1 participant