Skip to content

Latest commit

 

History

History
54 lines (36 loc) · 1.51 KB

README.md

File metadata and controls

54 lines (36 loc) · 1.51 KB
Raw

Legacy examples

This directory contains examples for no longer recommended functionality

Channel-Based Consumer (deprecated)

Deprecated: The channel-based consumer is deprecated due to the channel issues mentioned below. Use the function-based consumer.

Messages, errors and events are posted on the consumer.Events() channel for the application to read.

Pros:

  • Possibly more Golang:ish
  • Makes reading from multiple channels easy
  • Fast

Cons:

  • Outdated events and messages may be consumed due to the buffering nature of channels. The extent is limited, but not remedied, by the Events channel buffer size (go.events.channel.size).

See consumer_channel_example

Channel-Based Producer

Application writes messages to the producer.ProducerChannel(). Delivery reports are emitted on the producer.Events() or specified private channel.

Pros:

  • Go:ish
  • Proper channel backpressure if librdkafka internal queue is full.

Cons:

  • Double queueing: messages are first queued in the channel (size is configurable) and then inside librdkafka.
  • Flushing issues if using channel based producer due to a known bug in the implementation.

See producer_channel_example

Usage example

$ cd consumer_channel_example
$ go build   (or 'go install')
$ ./consumer_channel_example    # see usage
$ ./consumer_channel_example mybroker mygroup mytopic