[oracle] Enhancement to capture system statistics metrics, pga metrics, sga metrics #3967
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -14,4 +14,12 @@ sql_queries: | |
| - query: SELECT total_cursors, current_cursors, sess_cur_cache_hits, parse_count_total, sess_cur_cache_hits / total_cursors as cachehits_totalcursors_ratio , sess_cur_cache_hits - parse_count_total as real_parses FROM ( SELECT sum ( decode ( name, 'opened cursors cumulative', value, 0)) total_cursors, sum ( decode ( name, 'opened cursors current',value,0)) current_cursors, sum ( decode ( name, 'session cursor cache hits',value,0)) sess_cur_cache_hits, sum ( decode ( name, 'parse count (total)',value,0)) parse_count_total FROM v$sysstat WHERE name IN ( 'opened cursors cumulative','opened cursors current','session cursor cache hits', 'parse count (total)' )) | ||
| response_format: table | ||
| - query: SELECT 'lock_requests' "Ratio" , AVG(gethitratio) FROM V$LIBRARYCACHE UNION SELECT 'pin_requests' "Ratio", AVG(pinhitratio) FROM V$LIBRARYCACHE UNION SELECT 'io_reloads' "Ratio", (SUM(reloads) / SUM(pins)) FROM V$LIBRARYCACHE | ||
| response_format: variables | ||
| - query: SELECT COUNT(*) as "failed_db_jobs" FROM dba_jobs WHERE NVL(failures, 0) < > 0 | ||
| response_format: table | ||
| - query: select 'active_session_count' as name, count(s.status) as value from gv$session s, v$process p where p.addr=s.paddr and s.status='ACTIVE' union select 'inactive_session_count' as name, count(s.status) as value from gv$session s, v$process p where p.addr=s.paddr and s.status='INACTIVE' union select 'inactive_morethan_onehr' as name, count(s.status) as value from gv$session s, v$process p where p.addr=s.paddr and s.last_call_et > 3600 and s.status='INACTIVE' | ||
| response_format: variables | ||
| - query: select WAIT_CLASS, TOTAL_WAITS, round(100 * (TOTAL_WAITS / SUM_WAITS),2) PCT_WAITS, ROUND((TIME_WAITED / 100),2) TIME_WAITED_SECS, round(100 * (TIME_WAITED / SUM_TIME),2) PCT_TIME from (select WAIT_CLASS, TOTAL_WAITS, TIME_WAITED from V$SYSTEM_WAIT_CLASS where WAIT_CLASS != 'Idle'), (select sum(TOTAL_WAITS) SUM_WAITS, sum(TIME_WAITED) SUM_TIME from V$SYSTEM_WAIT_CLASS where WAIT_CLASS != 'Idle') order by 5 desc | ||
| response_format: table | ||
|
|
||
|
|
||
|
Contributor
There was a problem hiding this comment. How many documents are created by these queries? Should we add request_merge flag? This question applies to all the oracle data streams.
Contributor
Author
There was a problem hiding this comment. pga_sga : 2 There is a scope of improvement in performance datastream (part of 8.4) which has 7 queries.
Contributor
Author
There was a problem hiding this comment. As per the discussion, a separate PR will be created for this as 8.4.0 features are needed, changing min kibana version to 8.4.0 for this integration
agithomas marked this conversation as resolved.
Outdated
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,13 @@ | ||
| metricsets: ["query"] | ||
| period: {{period}} | ||
| hosts: | ||
| {{#each hosts}} | ||
| - {{this}} | ||
| {{/each}} | ||
| raw_data.enabled: true | ||
| driver: "oracle" | ||
| sql_queries: | ||
| - query: select name, value from V$PGASTAT where name in ('aggregate PGA auto target','global memory bound', 'total PGA allocated', 'total PGA used for auto workareas', 'total PGA inuse', 'maximum PGA allocated', 'total freeable PGA memory', 'process count', 'max processes count', 'cache hit percentage', 'aggregate PGA target parameter') | ||
| response_format: variables | ||
| - query: select 'sga free memory' as NAME, sum(decode(name,'free memory',bytes)) as VALUE from v$sgastat where pool = 'shared pool' union select 'sga total memory' as NAME, sum(bytes) as VALUE from v$sgastat where pool = 'shared pool' | ||
| response_format: variables |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,36 @@ | ||
| --- | ||
| description: Pipeline for processing Oracle Program Global Area and System Global Area metrics | ||
| processors: | ||
| - remove: | ||
| field: sql.driver | ||
| ignore_missing: true | ||
| ignore_failure: true | ||
| - remove: | ||
| field: sql.query | ||
| ignore_missing: true | ||
| ignore_failure: true | ||
| - rename: | ||
| field: sql | ||
| target_field: oracle | ||
| ignore_missing: true | ||
| ignore_failure: true | ||
| - rename: | ||
| field: oracle.metrics | ||
| target_field: oracle.pga_sga | ||
| ignore_missing: true | ||
| - foreach: | ||
| field: oracle.pga_sga | ||
| ignore_missing: true | ||
| processor: | ||
| gsub: | ||
| field: "_ingest._key" | ||
| pattern: " " | ||
| replacement: "_" | ||
| - rename: | ||
| field: oracle.pga_sga.cache_hit_percentage | ||
| target_field: oracle.pga_sga.cache_hit_pct | ||
| ignore_missing: true | ||
| on_failure: | ||
| - set: | ||
| field: error.message | ||
| value: "{{ _ingest.on_failure_message }}" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,20 @@ | ||
| - name: data_stream.type | ||
| type: constant_keyword | ||
| description: Data stream type. | ||
| - name: data_stream.dataset | ||
| type: constant_keyword | ||
| description: Data stream dataset. | ||
| - name: data_stream.namespace | ||
| type: constant_keyword | ||
| description: Data stream namespace. | ||
| - name: '@timestamp' | ||
| type: date | ||
| description: Event timestamp. | ||
| - name: event.module | ||
| type: constant_keyword | ||
| description: Event module | ||
| value: sql | ||
| - name: event.dataset | ||
| type: constant_keyword | ||
| description: Event module | ||
| value: oracle.pga_sga |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,8 @@ | ||
| - external: ecs | ||
| name: host.ip | ||
| - external: ecs | ||
| name: ecs.version | ||
| - external: ecs | ||
| name: service.address | ||
| - external: ecs | ||
| name: service.type |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,67 @@ | ||
| - name: oracle.pga_sga | ||
|
agithomas marked this conversation as resolved.
Outdated
|
||
| type: group | ||
| release: beta | ||
| fields: | ||
| - name: total_freeable_pga_memory | ||
| type: double | ||
| description: Number of bytes of PGA memory in all processes that could be freed back to the operating system. | ||
| unit: byte | ||
| metric_type: gauge | ||
| - name: cache_hit_percentage | ||
|
agithomas marked this conversation as resolved.
Outdated
|
||
| type: double | ||
| description: A metric computed by the Oracle Database to reflect the performance of the PGA memory component, cumulative since instance startup. | ||
| unit: percent | ||
| metric_type: gauge | ||
| - name: maximum_pga_allocated | ||
| type: double | ||
| description: Maximum number of bytes of PGA memory allocated at one time since instance startup. | ||
| unit: byte | ||
| metric_type: gauge | ||
| - name: process_count | ||
| type: double | ||
| description: Number of processes active within up to the last 3 seconds. | ||
| metric_type: gauge | ||
| - name: total_pga_inuse | ||
| type: double | ||
| unit: byte | ||
| description: Indicates how much PGA memory is currently consumed by work areas. This number can be used to determine how much memory is consumed by other consumers of the PGA memory (for example, PL/SQL or Java). | ||
| metric_type: gauge | ||
| - name: global_memory_bound | ||
| type: double | ||
| unit: byte | ||
| description: Maximum size of a work area executed in automatic mode. | ||
| metric_type: gauge | ||
| - name: aggregate_pga_auto_target | ||
| type: double | ||
| unit: byte | ||
| description: Amount of PGA memory the Oracle Database can use for work areas running in automatic mode. | ||
| metric_type: gauge | ||
| - name: total_pga_allocated | ||
| type: double | ||
| unit: byte | ||
| description: Current amount of PGA memory allocated by the instance. | ||
| metric_type: gauge | ||
| - name: total_pga_used_for_auto_workareas | ||
|
agithomas marked this conversation as resolved.
Outdated
|
||
| type: double | ||
| unit: byte | ||
| description: Indicates how much PGA memory is currently consumed by work areas running under the automatic memory management mode. This number can be used to determine how much memory is consumed by other consumers of the PGA memory (for example, PL/SQL or Java). | ||
| metric_type: gauge | ||
| - name: max_processes_count | ||
| type: double | ||
| description: Maximum number of processes active at any one time since instance startup. | ||
| metric_type: gauge | ||
| - name: aggregate_pga_target_parameter | ||
| type: double | ||
| unit: byte | ||
| metric_type: gauge | ||
| description: Current value of the PGA_AGGREGATE_TARGET initialization parameter. If this parameter is not set, then its value is 0 and automatic management of PGA memory is disabled. | ||
| - name: sga_free_memory | ||
| type: double | ||
| unit: byte | ||
| description: Amount of free memory in the Shared pool. | ||
| metric_type: gauge | ||
| - name: sga_total_memory | ||
| type: double | ||
| unit: byte | ||
| description: Amount of total memory in the Shared pool. | ||
| metric_type: gauge | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,23 @@ | ||
| title: "Program Global Area and System Global Area metrics" | ||
| type: metrics | ||
| release: beta | ||
| streams: | ||
| - input: sql/metrics | ||
| enabled: false | ||
| title: Oracle Program Global Area and System Global Area metrics | ||
| description: Collect Oracle Program Global Area and System Global Area metrics | ||
| vars: | ||
| - name: period | ||
| type: text | ||
| title: Period | ||
| default: 60s | ||
| multi: false | ||
| show_user: true | ||
| - name: tags | ||
| type: text | ||
| title: Tags | ||
| multi: true | ||
| required: true | ||
| show_user: false | ||
| default: | ||
| - oracle_pga_sga_metrics |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,38 @@ | ||
| { | ||
| "@timestamp": "2022-08-07T04:32:07.853Z", | ||
| "oracle": { | ||
| "pga_sga": { | ||
| "aggregate_pga_auto_target": 577658880, | ||
| "aggregate_pga_target_parameter": 805306368, | ||
| "max_processes_count": 95, | ||
| "total_pga_allocated": 207594496, | ||
| "total_pga_used_for_auto_workareas": 0, | ||
| "process_count": 85, | ||
| "global_memory_bound": 104857600, | ||
| "total_pga_inuse": 167798784, | ||
| "total_freeable_pga_memory": 14221312, | ||
| "cache_hit_percentage": 100, | ||
| "maximum_pga_allocated": 599693312 | ||
| } | ||
| }, | ||
| "service": { | ||
| "address": "0.0.0.0:1521", | ||
| "type": "sql" | ||
| }, | ||
| "data_stream": { | ||
| "namespace": "default", | ||
| "type": "metrics", | ||
| "dataset": "oracle.pga_sga" | ||
| }, | ||
| "metricset": { | ||
| "period": 60000, | ||
| "name": "query" | ||
| }, | ||
| "event": { | ||
| "duration": 53225246, | ||
| "agent_id_status": "verified", | ||
| "ingested": "2022-08-07T04:32:07Z", | ||
| "module": "sql", | ||
| "dataset": "oracle.pga_sga" | ||
| } | ||
| } |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.