Skip to content

set buffer memory to control max memory usage when produce lots of topic #3181

@mikepop7

Description

@mikepop7
Description

has any config to set max memory usage for all topic on producer?
like java kafka sdk:
props.put("buffer.memory", 33554432); // 32MB

Versions
Sarama Kafka Go
v1.45.1 3.6.2 1.23.0
Configuration
cf := sarama.NewConfig()
cf.Producer.Return.Successes = true
cf.Producer.Return.Errors = true
cf.Producer.Compression = sarama.CompressionLZ4
cf.Producer.Flush.Bytes = 1048576
cf.Producer.Flush.Messages = 10000
cf.Producer.Flush.Frequency = 10 * time.Second
cf.Producer.Flush.MaxMessages = 12000
cf.Producer.MaxMessageBytes = 10485760

Additional Context

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions