Skip to content

Deprecate Batcher and configure QueueBatch with Partitioner#41373

Merged
songy23 merged 15 commits into
open-telemetry:mainfrom
lahsivjar:queuebatch
Aug 1, 2025
Merged

Deprecate Batcher and configure QueueBatch with Partitioner#41373
songy23 merged 15 commits into
open-telemetry:mainfrom
lahsivjar:queuebatch

Conversation

@lahsivjar
Copy link
Copy Markdown
Member

@lahsivjar lahsivjar commented Jul 17, 2025

Description

Deprecates the batcher config in favour of sending_queue#batch and introduces a partitioner based on the configured metadata_keys. Note that with batcher enabled, the values in the context will not be forwarded to the exporter's callback functions due to open-telemetry/opentelemetry-collector#13320

Link to tracking issue

Fixes #41338

Testing

Unit tests added

Documentation

Documentation updated

Comment thread exporter/elasticsearchexporter/partitioner.go
@lahsivjar lahsivjar marked this pull request as ready for review July 18, 2025 12:37
@lahsivjar lahsivjar requested a review from a team as a code owner July 18, 2025 12:37
@github-actions github-actions Bot requested review from JaredTan95 and carsonip July 18, 2025 12:37
Comment thread .chloggen/esexporter-queuebatch.yaml Outdated
Comment thread exporter/elasticsearchexporter/README.md Outdated
Comment thread exporter/elasticsearchexporter/README.md Outdated
Comment thread exporter/elasticsearchexporter/README.md Outdated
Comment thread exporter/elasticsearchexporter/config.go Outdated
Comment thread exporter/elasticsearchexporter/config.go Outdated
Comment thread exporter/elasticsearchexporter/README.md Outdated
Comment thread exporter/elasticsearchexporter/bulkindexer_test.go
Comment thread exporter/elasticsearchexporter/bulkindexer_test.go Outdated
Comment thread exporter/elasticsearchexporter/bulkindexer.go
Co-authored-by: Carson Ip <carsonip@users.noreply.github.com>
Comment thread exporter/elasticsearchexporter/README.md Outdated
Comment thread exporter/elasticsearchexporter/README.md
Comment thread exporter/elasticsearchexporter/bulkindexer.go
Comment thread exporter/elasticsearchexporter/README.md
Comment thread exporter/elasticsearchexporter/README.md Outdated
Comment thread exporter/elasticsearchexporter/README.md
Comment thread exporter/elasticsearchexporter/config_test.go
@lahsivjar
Copy link
Copy Markdown
Member Author

@ArthurSens The PR is reviewed by code-owners, could we mark this ready to merge now?

Comment thread exporter/elasticsearchexporter/config.go Outdated
Co-authored-by: Edmo Vamerlatti Costa <11836452+edmocosta@users.noreply.github.com>
@edmocosta edmocosta added ready to merge Code review completed; ready to merge by maintainers and removed waiting-for-code-owners labels Aug 1, 2025
@songy23 songy23 merged commit ff1736b into open-telemetry:main Aug 1, 2025
181 checks passed
@lahsivjar lahsivjar deleted the queuebatch branch August 4, 2025 08:01
Dylan-M pushed a commit to Dylan-M/opentelemetry-collector-contrib that referenced this pull request Aug 5, 2025
…emetry#41373)

<!--Ex. Fixing a bug - Describe the bug and how this fixes the issue.
Ex. Adding a feature - Explain what this achieves.-->
#### Description
Deprecates the `batcher` config in favour of `sending_queue#batch` and
introduces a partitioner based on the configured `metadata_keys`. Note
that with batcher enabled, the values in the context will not be
forwarded to the exporter's callback functions due to
open-telemetry/opentelemetry-collector#13320

<!-- Issue number (e.g. open-telemetry#1234) or full URL to issue, if applicable. -->
#### Link to tracking issue
Fixes
open-telemetry#41338

<!--Describe what testing was performed and which tests were added.-->
#### Testing
Unit tests added

<!--Describe the documentation added.-->
#### Documentation
Documentation updated

<!--Please delete paragraphs that you did not use before submitting.-->

---------

Co-authored-by: Carson Ip <carsonip@users.noreply.github.com>
Co-authored-by: Edmo Vamerlatti Costa <11836452+edmocosta@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

exporter/elasticsearch ready to merge Code review completed; ready to merge by maintainers

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Move to exporterhelper's QueueBatch

8 participants