mark the batchprocessor as deprecated by codeboten · Pull Request #15046 · open-telemetry/opentelemetry-collector

codeboten · 2026-04-01T16:41:56Z

This continues the work to deprecate the batch processor in favour of the exporter helper's batching capabilities.

Part of #12022

This continues the work to deprecate the batch processor in favour of the exporter helper's batching capabilities. Signed-off-by: alex boten <223565+codeboten@users.noreply.github.com>

atoulme

LGTM - no joke, it has been coming for a while

codeboten · 2026-04-01T16:44:19Z

LGTM - no joke, it has been coming for a while

The date it was opened on is unfortunate

songy23

cc @open-telemetry/collector-approvers

codecov · 2026-04-01T16:52:11Z

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 91.22%. Comparing base (01b07fc) to head (36e5fb3).
⚠️ Report is 165 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main   #15046      +/-   ##
==========================================
- Coverage   91.22%   91.22%   -0.01%     
==========================================
  Files         697      697              
  Lines       44627    44629       +2     
==========================================
+ Hits        40710    40711       +1     
- Misses       2773     2775       +2     
+ Partials     1144     1143       -1

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

codeboten · 2026-04-01T17:05:41Z

note i'm not putting in the changelog to avoid merging this until we have enough approvals

andrzej-stencel

I don't think we should deprecate it. The processor (or its v2 version if implemented) is still useful in some specific scenarios.

I propose we instead implement the fixes and also change the docs to explain that the exporter helper should be used in most scenarios, describing the use cases for this component (or rather of the new better version of it).

If we actually implement the improvements on the processor as some kind of a v2 version, then v1 could be deprecated.

jmacd · 2026-04-06T15:53:33Z

I volunteered myself to write an RFC to describe the difficult transition problem we're facing here. I have not seen the proposal to support major-versioning of components referred to in #13583 (comment), but it sounds like a potential solution.

jmacd · 2026-04-06T16:12:05Z

See #15047

github-actions · 2026-04-23T04:14:36Z

This PR was marked stale due to lack of activity. It will be closed in 14 days.

## Tulip LTS May 2026 This PR prepares the Tulip LTS (Long-Term Support) release by upgrading all components to v0.151.0 and making targeted component changes to ensure production stability. ### What is an LTS? The upstream OpenTelemetry Collector ships new releases every ~2 weeks. The Tulip LTS provides a curated, validated baseline with extended support — giving production environments a stable target without upgrade fatigue. ### Changes #### Version bump All components upgraded from **v0.145.0 → v0.151.0**, verified against the [official otelcol-contrib manifest](https://github.com/open-telemetry/opentelemetry-collector-releases/blob/main/distributions/otelcol-contrib/manifest.yaml). - Core components: `v0.151.0` - Core providers: `v1.57.0` #### Component changes **Removed: `batchprocessor`** - Formally deprecated upstream ([PR #15046](open-telemetry/opentelemetry-collector#15046)) - Known data loss bug ([#12443](open-telemetry/opentelemetry-collector#12443)) — silently drops data when downstream exporters reject without queue/retry - Replaced with exporter-level `sending_queue` + `batch` configuration, which provides durable queuing, crash recovery, and retry with backoff **Removed: `memorylimiterprocessor`** - Being replaced upstream by [`memorylimiterextension`](https://github.com/open-telemetry/opentelemetry-collector/tree/main/extension/memorylimiterextension) - Not suitable for an LTS release since the processor variant is on a deprecation path **Removed: `healthcheckextension`** - The healthcheck extension v1 and v2 share code via a feature flag ([#42256](open-telemetry/opentelemetry-collector-contrib#42256)) - Including v1 would indirectly support v2, which is not the objective for an LTS release where component behavior must be fully predictable **Added: `redactionprocessor`** - Redacts sensitive data from telemetry attributes before export - Essential for enterprise environments with data privacy requirements (PII, HIPAA, GDPR) **Added: `filestorage` extension** - Persistent file-based storage for durable state across collector restarts (e.g., exporter sending queues, receiver checkpoints) **Added: `hostmetricsreceiver`** - Collects host-level metrics (CPU, memory, disk, network, filesystem, processes) - Essential for infrastructure monitoring use cases **Added: `filelogreceiver`** - Reads and parses log data from files on the host - Enables log collection pipelines for application, system, and container logs #### Configuration updates The default `config.yaml` now includes: - Exporter-level `sending_queue` for durable queuing - Exporter-level `batch` for efficient batching at the export stage - `retry_on_failure` with exponential backoff on all network exporters - Removed `memory_limiter` processor and `health_check` extension references #### Bug fix - Fixed bash 3.2 compatibility in `test/generate-trace.sh` (`&>>` → `>> file 2>&1`) ### Final component manifest (28 components) | Category | Count | Components | |----------|-------|------------| | Extensions | 7 | zpages, pprof, basicauth, bearertokenauth, oauth2clientauth, oidcauth, filestorage | | Receivers | 4 | otlp, nop, hostmetrics, filelog | | Exporters | 5 | debug, nop, otlp, otlphttp, file | | Processors | 7 | attributes, resource, span, probabilisticsampler, filter, transform, redaction | | Connectors | 1 | forward | | Providers | 3 | env, file, yaml | ### Documentation Full upgrade plan with migration guide available at `docs/tulip-lts-may2026-upgrade-plan.md`. ### Validation - `make generate-sources` — PASS - `make build` — PASS (Tulip v0.151.0 compiles with all 28 components) - `make test` — PASS (collector starts, traces generated and verified)  ## Summary by CodeRabbit * **New Features** * Exporters gain buffered sending, exporter-level batching, and retry/backoff controls * Added filestorage extension, host metrics and file log receivers, and a redaction processor * **Documentation** * Added Tulip LTS May 2026 upgrade plan with migration guidance and final component manifest * **Chores** * Upgraded Tulip distribution and component pins to v0.151.0; removed pipeline-level batch processor * Replaced health-check extension with pprof as the enabled extension * **Tests** * Adjusted trace generation script log redirection form * **Bug Fixes** * Startup readiness now detects service readiness from startup logs rather than health endpoint  --------- Signed-off-by: perebaj <perebaj@gmail.com>

codeboten · 2026-05-08T17:22:06Z

Here's a link to the RFC with the deprecation proposal: #15273

github-actions · 2026-05-24T04:38:21Z

This PR was marked stale due to lack of activity. It will be closed in 14 days.

mark the batchprocessor as deprecated

36e5fb3

This continues the work to deprecate the batch processor in favour of the exporter helper's batching capabilities. Signed-off-by: alex boten <223565+codeboten@users.noreply.github.com>

codeboten requested a review from a team as a code owner April 1, 2026 16:42

codeboten requested a review from dmathieu April 1, 2026 16:42

github-actions Bot added the processor/batch label Apr 1, 2026

atoulme approved these changes Apr 1, 2026

View reviewed changes

songy23 approved these changes Apr 1, 2026

View reviewed changes

dmathieu approved these changes Apr 1, 2026

View reviewed changes

MikeGoldsmith approved these changes Apr 1, 2026

View reviewed changes

lalitb mentioned this pull request Apr 1, 2026

batch processor "before retry" guidance is unsafe when durable buffer processor is in the path open-telemetry/otel-arrow#2327

Open

1 task

axw approved these changes Apr 2, 2026

View reviewed changes

evan-bradley approved these changes Apr 2, 2026

View reviewed changes

andrzej-stencel requested changes Apr 2, 2026

View reviewed changes

github-actions Bot added Stale and removed Stale labels Apr 23, 2026

perebaj mentioned this pull request Apr 28, 2026

feat: Tulip LTS May 2026 — upgrade to v0.150.0 ollygarden/tulip#35

Merged

codeboten marked this pull request as draft May 8, 2026 17:22

github-actions Bot added Stale and removed Stale labels May 24, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

mark the batchprocessor as deprecated#15046

mark the batchprocessor as deprecated#15046
codeboten wants to merge 1 commit into
open-telemetry:mainfrom
codeboten:codeboten/deprecate-batchprocessor

codeboten commented Apr 1, 2026

Uh oh!

atoulme left a comment

Uh oh!

codeboten commented Apr 1, 2026

Uh oh!

songy23 left a comment

Uh oh!

codecov Bot commented Apr 1, 2026 •

edited

Loading

Uh oh!

codeboten commented Apr 1, 2026

Uh oh!

andrzej-stencel left a comment •

edited

Loading

Uh oh!

jmacd commented Apr 6, 2026

Uh oh!

jmacd commented Apr 6, 2026

Uh oh!

github-actions Bot commented Apr 23, 2026

Uh oh!

codeboten commented May 8, 2026

Uh oh!

github-actions Bot commented May 24, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

9 participants

Conversation

codeboten commented Apr 1, 2026

Uh oh!

atoulme left a comment

Choose a reason for hiding this comment

Uh oh!

codeboten commented Apr 1, 2026

Uh oh!

songy23 left a comment

Choose a reason for hiding this comment

Uh oh!

codecov Bot commented Apr 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

codeboten commented Apr 1, 2026

Uh oh!

andrzej-stencel left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

jmacd commented Apr 6, 2026

Uh oh!

jmacd commented Apr 6, 2026

Uh oh!

github-actions Bot commented Apr 23, 2026

Uh oh!

codeboten commented May 8, 2026

Uh oh!

github-actions Bot commented May 24, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

9 participants

codecov Bot commented Apr 1, 2026 •

edited

Loading

andrzej-stencel left a comment •

edited

Loading