Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions packages/azure_metrics/changelog.yml
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
- version: "1.0.23"
changes:
- description: Add dimension and metric_type metadata to the compute_vm_scaleset datastream
type: enhancement
link: https://github.com/elastic/integrations/pull/7177
- version: "1.0.22"
changes:
- description: Add dimension and metric_type metadata to the container_registry datastream
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -48,6 +48,7 @@
ignore_above: 1024
description: Region in which this host is running.
example: us-east-1
dimension: true
- name: project.id
type: keyword
description: Name of the project in Google Cloud.
Expand All @@ -62,26 +63,11 @@
These fields help correlate data based containers from any runtime.'
type: group
fields:
- name: id
level: core
type: keyword
ignore_above: 1024
description: Unique container id.
- name: image.name
level: extended
type: keyword
ignore_above: 1024
description: Name of the image the container was built on.
- name: labels
level: extended
type: object
object_type: keyword
description: Image labels.
- name: name
level: extended
type: keyword
ignore_above: 1024
description: Container name.
- name: host
title: Host
group: 2
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -15,3 +15,6 @@
external: ecs
- name: host
external: ecs
- name: agent.id
external: ecs
dimension: true
Original file line number Diff line number Diff line change
@@ -1,7 +1,128 @@
- name: azure.compute_vm_scaleset.*.*
type: object
object_type: float
object_type_mapping_type: "*"
description: >
compute_vm_scaleset

- name: azure.compute_vm_scaleset
type: group
fields:
- name: cpu_credits_remaining.avg
type: float
metric_type: gauge
description: Total number of credits available to burst. Only available on B-series burstable VMs
- name: cpu_credits_consumed.avg
type: float
metric_type: gauge
description: Total number of credits consumed by the Virtual Machine. Only available on B-series burstable VMs
- name: available_memory_bytes.avg
type: float
unit: byte
metric_type: gauge
description: Amount of physical memory, in bytes, immediately available for allocation to a process or for system use in the Virtual Machine
- name: percentage_cpu.avg
type: float
unit: percent
metric_type: gauge
description: The percentage of allocated compute units that are currently in use by the Virtual Machine(s)
- name: disk_read_bytes.total
type: float
unit: byte
metric_type: gauge
description: Bytes read from disk during monitoring period
- name: disk_write_bytes.total
type: float
unit: byte
metric_type: gauge
description: Bytes written to disk during monitoring period
- name: disk_read_operations_per_sec.avg
type: float
metric_type: gauge
description: Disk Read IOPS
- name: disk_write_operations_per_sec.avg
type: float
metric_type: gauge
description: Disk Write IOPS
- name: data_disk_read_bytes_per_sec.avg
type: float
metric_type: gauge
description: Bytes/Sec read from a single disk during monitoring period
- name: data_disk_write_bytes_per_sec.avg
type: float
metric_type: gauge
description: Bytes/Sec written to a single disk during monitoring period
- name: network_out_total.total
type: float
metric_type: gauge
description: The number of bytes out on all network interfaces by the Virtual Machine(s) (Outgoing Traffic)
- name: network_in_total.total
type: float
metric_type: gauge
description: The number of bytes received on all network interfaces by the Virtual Machine(s) (Incoming Traffic)
- name: data_disk_read_operations_per_sec.avg
type: float
metric_type: gauge
description: Read IOPS from a single disk during monitoring period
- name: data_disk_write_operations_per_sec.avg
type: float
metric_type: gauge
description: Write IOPS from a single disk during monitoring period
- name: data_disk_queue_depth.avg
type: float
metric_type: gauge
description: Data Disk Queue Depth(or Queue Length)
- name: data_disk_bandwidth_consumed_percentage.avg
type: float
unit: percent
metric_type: gauge
description: Percentage of data disk bandwidth consumed per minute
- name: outbound_flows_maximum_creation_rate.avg
type: float
metric_type: gauge
description: The maximum creation rate of outbound flows (traffic going out of the VM)
- name: inbound_flows_maximum_creation_rate.avg
type: float
metric_type: gauge
description: The maximum creation rate of inbound flows (traffic going into the VM)
- name: outbound_flows.avg
type: float
metric_type: gauge
description: Outbound Flows are number of current flows in the outbound direction (traffic going out of the VM)
- name: inbound_flows.avg
type: float
metric_type: gauge
description: Inbound Flows are number of current flows in the inbound direction (traffic going into the VM)
- name: os_disk_queue_depth.avg
type: float
metric_type: gauge
description: OS Disk Queue Depth(or Queue Length)
- name: os_disk_write_operations_per_sec.avg
type: float
metric_type: gauge
description: Write IOPS from a single disk during monitoring period for OS disk
- name: os_disk_read_operations_per_sec.avg
type: float
metric_type: gauge
description: Read IOPS from a single disk during monitoring period for OS disk
- name: os_disk_write_bytes_per_sec.avg
type: float
metric_type: gauge
description: Bytes/Sec written to a single disk during monitoring period for OS disk
- name: os_disk_read_bytes_per_sec.avg
type: float
metric_type: gauge
description: Bytes/Sec read from a single disk during monitoring period for OS disk
- name: memory_commit_limit.avg
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FYI: I couldn't get this metric
available in UI list:
Screenshot 2023-07-28 at 12 21 52

unit: byte
type: float
metric_type: gauge
description: Memory commit limit
- name: memory_committed_bytes.avg
unit: byte
type: float
metric_type: gauge
description: Committed Bytes is the amount of committed virtual memory, in bytes. Committed memory is the physical memory which has space reserved on the disk paging file(s). There can be one or more paging files on each physical drive. This counter displays the last observed value only.
- name: memory_pct_committed_bytes_in_use.avg
type: float
unit: percent
metric_type: gauge
description: Committed Bytes In Use is the ratio of Memory \ Committed Bytes to the Memory \ Commit Limit. Committed memory is the physical memory in use for which space has been reserved in the paging file should it need to be written to disk. The commit limit is determined by the size of the paging file. If the paging file is enlarged, the commit limit increases, and the ratio is reduced). This value displays the current percentage value only.
- name: memory_available_bytes.avg
unit: byte
type: float
metric_type: gauge
description: Available Bytes is the amount of physical memory, in bytes, immediately available for allocation to a process or for system use. It is equal to the sum of memory assigned to the standby (cached), free and zero page lists.
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,7 @@
description: ""
fields:
- name: timegrain
dimension: true
type: keyword
description: >
The Azure metric timegrain
Expand All @@ -25,6 +26,7 @@

- name: id
type: keyword
dimension: true
description: >
The id of the resource

Expand Down Expand Up @@ -55,17 +57,18 @@
description: >
The application ID

- name: dimensions.*
type: object
object_type: keyword
object_type_mapping_type: "*"
description: >
Azure metric dimensions.

- name: metrics.*.*
type: object
object_type: float
object_type_mapping_type: "*"
description: >
Metrics returned.

- name: dimensions
type: group
fields:
- name: "vmname"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there is no such field exposed, list of dimensions is defined in configuration - https://github.com/elastic/integrations/blob/main/packages/azure_metrics/data_stream/compute_vm_scaleset/agent/stream/stream.yml.hbs#L71-L73

from my understanding - in this case metric should be grouped by vmname only, if only this dimension is defined

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've added lun azure dimension in this PR - #7314

coult you please have another look on this PR?

type: keyword
dimension: true
description: The VM name
- name: "virtual_machine"
type: keyword
dimension: true
description: The VM name
- name: "lun"
type: keyword
dimension: true
description: Logical Unit Number is a number that is used to identify a specific storage device
Loading