-
Notifications
You must be signed in to change notification settings - Fork 1.3k
[DOCS-13090] Add OP utilization metrics #33838
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from all commits
28ab498
663ff36
09bf9f2
f169e95
12773e0
792b987
447528b
03db895
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -77,35 +77,25 @@ Data dropped intentionally or unintentionally | |
| : **Description**: The number of events dropped. **Note**: To break down this metric, use the `intentional:true` tag to filter for events that are intentionally dropped or the `intentional:false` tag for events that are not intentionally dropped. | ||
| : **Available for**: Sources, processors, and destinations. | ||
|
|
||
| Timed out events | ||
| : **Metric**: `pipelines.component_timed_out_events_total` | ||
| : **Description**: The number of events that waited more than 5 seconds to be sent to the first processor and resulted in a HTTP 503 error. This could happen when delivery of events are blocked. | ||
| : **Available for**: HTTP-based sources that have a configured timeout, such as the Datadog Agent. | ||
|
|
||
| Timed out requests | ||
| : **Metric**: `pipelines.component_timed_out_requests_total` | ||
| : **Description**: The number of requests that timed out for sources that send events to the Worker in batches using HTTP requests. | ||
| : **Available for**: HTTP-based sources that have a configured timeout, such as the Datadog Agent. | ||
|
|
||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. This can be addressed in a different PR, but visually, I wonder if it might be best to emulate the Buffer metrics (when buffering is enabled) format without mentioning
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Hi @iadjivon! I don't quite understand. Are you saying to put the metric name as the header instead of |
||
| Utilization | ||
| : **Metric**: `pipelines.utilization` | ||
| : **Description**: The component's activity. A value of `0` indicates an idle component that is waiting for input. A value of `1` indicates a component that is never idle, which means that the component is likely a bottleneck in the processing topology that is creating backpressure, which might cause events to be dropped. | ||
| : **Available for**: Processors and destinations. | ||
|
|
||
| ## Buffer metrics (when buffering is enabled) | ||
|
|
||
| Track buffer behavior with these metrics: | ||
|
|
||
| `pipelines.buffer_events` | ||
| : **Description**: Number of events currently in the buffer. | ||
|
|
||
| `pipelines.buffer_byte_size` | ||
| : **Description**: Current buffer size in bytes. | ||
|
|
||
| `pipelines.buffer_received_events_total` | ||
| : **Description**: Total events added to the buffer. | ||
|
|
||
| `pipelines.buffer_received_event_bytes_total` | ||
| : **Description**: Total bytes added to the buffer. | ||
|
|
||
| `pipelines.buffer_sent_events_total` | ||
| : **Description**: Total events successfully flushed from the buffer. | ||
|
|
||
| `pipelines.buffer_sent_event_bytes_total` | ||
| : **Description**: Total bytes successfully flushed from the buffer. | ||
|
|
||
| `pipelines.buffer_discarded_events_total` | ||
| : **Description**: Events discarded from the buffer (for example, due to overflow). | ||
| {{% observability_pipelines/metrics/buffer %}} | ||
|
|
||
| ## Further reading | ||
|
|
||
|
|
||
Uh oh!
There was an error while loading. Please reload this page.