-
Notifications
You must be signed in to change notification settings - Fork 339
/
Copy pathpartitioner.rb
35 lines (29 loc) · 1.11 KB
/
partitioner.rb
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
# frozen_string_literal: true
require "zlib"
module Kafka
# Assigns partitions to messages.
class Partitioner
# Assigns a partition number based on a partition key. If no explicit
# partition key is provided, the message key will be used instead.
#
# If the key is nil, then a random partition is selected. Otherwise, a digest
# of the key is used to deterministically find a partition. As long as the
# number of partitions doesn't change, the same key will always be assigned
# to the same partition.
#
# @param partition_count [Integer] the number of partitions in the topic.
# @param message [Kafka::PendingMessage] the message that should be assigned
# a partition.
# @return [Integer] the partition number.
def self.partition_for_key(partition_count, message)
raise ArgumentError if partition_count == 0
# If no explicit partition key is specified we use the message key instead.
key = message.partition_key || message.key
if key.nil?
rand(partition_count)
else
Zlib.crc32(key) % partition_count
end
end
end
end