Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -77,35 +77,25 @@ Data dropped intentionally or unintentionally
: **Description**: The number of events dropped. **Note**: To break down this metric, use the `intentional:true` tag to filter for events that are intentionally dropped or the `intentional:false` tag for events that are not intentionally dropped.
: **Available for**: Sources, processors, and destinations.

Timed out events
: **Metric**: `pipelines.component_timed_out_events_total`
: **Description**: The number of events that waited more than 5 seconds to be sent to the first processor and resulted in a HTTP 503 error. This could happen when delivery of events are blocked.
: **Available for**: HTTP-based sources that have a configured timeout, such as the Datadog Agent.

Timed out requests
: **Metric**: `pipelines.component_timed_out_requests_total`
: **Description**: The number of requests that timed out for sources that send events to the Worker in batches using HTTP requests.
: **Available for**: HTTP-based sources that have a configured timeout, such as the Datadog Agent.

Copy link
Contributor

@iadjivon iadjivon Jan 22, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This can be addressed in a different PR, but visually, I wonder if it might be best to emulate the Buffer metrics (when buffering is enabled) format without mentioning
Metric, Description, and Available for

Copy link
Contributor Author

@maycmlee maycmlee Jan 22, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @iadjivon! I don't quite understand. Are you saying to put the metric name as the header instead of Timed out request?

Utilization
: **Metric**: `pipelines.utilization`
: **Description**: The component's activity. A value of `0` indicates an idle component that is waiting for input. A value of `1` indicates a component that is never idle, which means that the component is likely a bottleneck in the processing topology that is creating backpressure, which might cause events to be dropped.
: **Available for**: Processors and destinations.

## Buffer metrics (when buffering is enabled)

Track buffer behavior with these metrics:

`pipelines.buffer_events`
: **Description**: Number of events currently in the buffer.

`pipelines.buffer_byte_size`
: **Description**: Current buffer size in bytes.

`pipelines.buffer_received_events_total`
: **Description**: Total events added to the buffer.

`pipelines.buffer_received_event_bytes_total`
: **Description**: Total bytes added to the buffer.

`pipelines.buffer_sent_events_total`
: **Description**: Total events successfully flushed from the buffer.

`pipelines.buffer_sent_event_bytes_total`
: **Description**: Total bytes successfully flushed from the buffer.

`pipelines.buffer_discarded_events_total`
: **Description**: Events discarded from the buffer (for example, due to overflow).
{{% observability_pipelines/metrics/buffer %}}

## Further reading

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -19,4 +19,16 @@ Track buffer behavior with these additional metrics:
: Total bytes successfully flushed from the buffer.

`pipelines.buffer_discarded_events_total`
: Events discarded from the buffer (for example, due to overflow).
: Total number of events discarded from the buffer (for example, due to overflow).

`pipelines.source_buffer_utilization`
: The percentage of a source's buffer that is used.

`pipelines.source_buffer_utilization_level`
: The number of events in a source's buffer.

`pipelines.transform_buffer_utilization`
: The percentage of a transform's buffer that is used.

`pipelines.transform_buffer_utilization_level`
: The number of events in a transform's buffer.
Loading