Skip to content

[Obs AI] Enhance get_log_groups (formerly get_log_categories) with exceptions #250331

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
sorenlouv merged 37 commits into from
Feb 3, 2026
Merged

[Obs AI] Enhance get_log_groups (formerly get_log_categories) with exceptions #250331

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
a2e3f64
WIP
Jan 23, 2026
d0b2bd8
Add stacktrace to synthtrace
Jan 23, 2026
3a627a9
Add OTel log exceptions
Jan 25, 2026
edc4006
Merge branch 'main' of github.com:elastic/kibana into add-get-excepti…
Jan 25, 2026
44faee6
Rename to `get_exceptions`
Jan 25, 2026
9c6e00a
Changes from node scripts/lint_ts_projects --fix
kibanamachine Jan 25, 2026
7188671
Changes from node scripts/regenerate_moon_projects.js --update
kibanamachine Jan 25, 2026
a40ea57
Own review feedback
Jan 26, 2026
922d5f0
Merge branch 'add-get-exception-tool' of github.com:sorenlouv/kibana …
Jan 26, 2026
297748a
Fix lint
Jan 26, 2026
c0acec1
Improve comments
Jan 26, 2026
ee37e59
Remove extra fields
Jan 27, 2026
907d29a
Fix lint
Jan 27, 2026
ac5674d
Remove groupBy
Jan 27, 2026
8f1aeae
Simplify
Jan 27, 2026
6131311
Rename `get_log_categories` to `get_log_groups` and include exceptions
Jan 28, 2026
45aa017
Merge branch 'main' into add-get-exception-tool
Jan 28, 2026
ea3eeef
Simplify readme
Jan 28, 2026
7f8b6be
Merge branch 'add-get-exception-tool' of github.com:sorenlouv/kibana …
Jan 28, 2026
48f1ccb
Fix APi tests
Jan 30, 2026
c29e772
Update agents.md
Jan 30, 2026
3997fef
Fix tests
Jan 30, 2026
3635ef1
Remove get_exceptions test
Jan 30, 2026
5fd9f82
Merge branch 'main' of github.com:elastic/kibana into add-get-excepti…
Jan 30, 2026
d728655
Rename `applicationExceptionGroups` to `spanExceptionGroups`
Jan 30, 2026
b468604
Improve AGENTS.md files
Feb 2, 2026
03f38de
Add `fields` and `type`
Feb 2, 2026
0ac3d3c
Add @timestamp
Feb 2, 2026
dfc7768
Cleanup `fields` to ensure all samples are uniform
Feb 2, 2026
8ca57ea
refactor downstream dependencies lookup
Feb 2, 2026
92a080e
Remove downstream deps
Feb 2, 2026
c4f333d
Improved readme and description
Feb 2, 2026
485d397
Merge branch 'main' of github.com:elastic/kibana into add-get-excepti…
Feb 2, 2026
5338af0
Fix API tests
Feb 2, 2026
d437d20
Fix lint issue
Feb 3, 2026
936e01e
Merge branch 'main' of github.com:elastic/kibana into add-get-excepti…
Feb 3, 2026
eaec899
Replace apmErrors with `get_log_groups`
Feb 3, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion src/platform/packages/shared/kbn-synthtrace-client/index.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@
export { observer } from './src/lib/agent_config';
export type { AgentConfigFields } from './src/lib/agent_config/agent_config_fields';
export { apm, apmOtel } from './src/lib/apm';
export type { ApmFields } from './src/lib/apm/apm_fields';
export type { ApmFields, APMStacktrace } from './src/lib/apm/apm_fields';
export type {
ApmOtelFields,
ApmOtelAttributes,
Expand Down
3 changes: 3 additions & 0 deletions src/platform/packages/shared/kbn-synthtrace-client/src/lib/apm/apm_fields.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,8 @@ export type ApmUserAgentFields = Partial<{

export interface ApmException {
message: string;
type?: string;
stacktrace?: APMStacktrace[];
}

export interface Observer {
Expand Down Expand Up @@ -125,6 +127,7 @@ export type ApmFields = Fields<{
'error.id': string;
'error.type': string;
'error.culprit': string;
'error.stack_trace': string;
'event.ingested': string;
'event.name': string;
'event.action': string;
Expand Down
4 changes: 2 additions & 2 deletions src/platform/packages/shared/kbn-synthtrace-client/src/lib/apm/index.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ import { browser } from './browser';
import { serverlessFunction } from './serverless_function';
import { getChromeUserAgentDefaults } from './defaults/get_chrome_user_agent_defaults';

import type { ApmException } from './apm_fields';
import type { ApmException, APMStacktrace } from './apm_fields';

export const apm = {
service,
Expand All @@ -29,4 +29,4 @@ export const apmOtel = {
service: otelService,
};

export type { ApmException };
export type { ApmException, APMStacktrace };
17 changes: 15 additions & 2 deletions src/platform/packages/shared/kbn-synthtrace-client/src/lib/apm/instance.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,12 @@ import { Entity } from '../entity';
import { Metricset } from './metricset';
import { Span } from './span';
import { Transaction } from './transaction';
import type { ApmApplicationMetricFields, ApmFields, SpanParams } from './apm_fields';
import type {
ApmApplicationMetricFields,
ApmFields,
APMStacktrace,
SpanParams,
} from './apm_fields';

export class Instance extends Entity<ApmFields> {
transaction(
Expand Down Expand Up @@ -76,19 +81,27 @@ export class Instance extends Entity<ApmFields> {
type,
culprit,
groupingKey,
stacktrace,
withoutErrorId = false,
}: {
message: string;
type?: string;
culprit?: string;
groupingKey?: string;
stacktrace?: APMStacktrace[];
withoutErrorId?: boolean;
}) {
return new ApmError(
{
...this.fields,
...(groupingKey ? { 'error.grouping_key': groupingKey } : {}),
'error.exception': [{ message, ...(type ? { type } : {}) }],
'error.exception': [
{
message,
...(type ? { type } : {}),
...(stacktrace ? { stacktrace } : {}),
},
],
'error.culprit': culprit,
},
{ withoutErrorId }
Expand Down
7 changes: 7 additions & 0 deletions src/platform/packages/shared/kbn-synthtrace-client/src/lib/logs/index.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -61,6 +61,11 @@ export type LogDocument = Fields &
'client.ip'?: string;
'error.stack_trace'?: string;
'error.exception'?: unknown;

// OTel log exception fields https://opentelemetry.io/docs/specs/semconv/exceptions/exceptions-logs/
'error.exception.type'?: string;
'error.exception.message'?: string;

'error.log'?: unknown;
'log.custom': Record<string, unknown>;
'host.geo.location': number[];
Expand All @@ -81,8 +86,10 @@ export type LogDocument = Fields &
'event.outcome'?: string;
'event.action'?: string;
'event.sequence'?: number;
'event.name'?: string;
'source.ip'?: string;
'rule.name'?: string;

labels?: Record<string, string>;
test_field: string | string[];
date: Date;
Expand Down
6 changes: 2 additions & 4 deletions src/platform/packages/shared/kbn-synthtrace/src/scenarios/agent_builder/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,8 +22,7 @@ To generate synthetic data using Synthtrace:
node scripts/synthtrace src/platform/packages/shared/kbn-synthtrace/src/scenarios/agent_builder/tools/<tool_name>/<scenario> \
--from "now-1h" \
--to "now" \
--clean \
--workers=1
--clean
```

### 2. Running the Tool via API
Expand Down Expand Up @@ -54,8 +53,7 @@ To generate synthetic data using Synthtrace:
node scripts/synthtrace src/platform/packages/shared/kbn-synthtrace/src/scenarios/agent_builder/ai_insights/<scenario> \
--from "now-1h" \
--to "now" \
--clean \
--workers=1
--clean
```

### 2. Call the AI Insight
Expand Down
2 changes: 1 addition & 1 deletion src/platform/packages/shared/kbn-synthtrace/src/scenarios/agent_builder/index.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@

export * from './tools/get_hosts/hosts';
export * from './tools/get_services/services';
export * from './tools/get_log_categories/log_categories';
export * from './tools/get_log_groups/log_groups';
export * from './tools/get_correlated_logs/correlated_logs';
export * from './tools/get_downstream_dependencies/dependencies';
export * from './tools/get_alerts/alerts';
Expand Down
152 changes: 0 additions & 152 deletions ...red/kbn-synthtrace/src/scenarios/agent_builder/tools/get_log_categories/log_categories.ts
View file
Open in desktop

This file was deleted.

Loading
Loading