Skip to content

[8.x] [APM][Otel] Add Otel client based on PoC data (#192293)#211541

Merged
rmyz merged 1 commit intoelastic:8.xfrom
rmyz:backport/8.x/pr-192293
Feb 18, 2025
Merged

[8.x] [APM][Otel] Add Otel client based on PoC data (#192293)#211541
rmyz merged 1 commit intoelastic:8.xfrom
rmyz:backport/8.x/pr-192293

Conversation

@rmyz
Copy link
Copy Markdown
Contributor

@rmyz rmyz commented Feb 18, 2025

Backport

This will backport the following commits from main to 8.x:

Questions ?

Please refer to the Backport tool documentation

Closes [elastic#192115](elastic#192115)
Closes [elastic#192465](elastic#192465)

## Summary

This PR adds synthrace client for Otel native data and a simple
scenario. This is the first step of adding it and in the future it will
include more metrics and use cases.

>[!NOTE]
> To run ES the command needs "xpack.otel_data.registry.enabled=true"
flag
> `yarn es snapshot --license trial --E
"xpack.otel_data.registry.enabled=true"`

## Next steps
- We currently have only `service_destination` in the metrics indices we
can include the other types in the future
- After we have all the UI changes we can add more scenarios (also using
the opentelemetry demo data and not only the e2e PoC example)

## Testing
- Run ES:
```bash
yarn es snapshot --license trial --E "xpack.otel_data.registry.enabled=true"
```
- Run Kibana:
```bash
yarn start
```

>[!WARNING]
If the e2e PoC is used the first 2 steps should be skipped

- Run syntrace:
```bash
node scripts/synthtrace otel_simple_trace.ts --clean
```
- Check indices in DevTools for the generated data:
```bash
GET *metrics-generic.otel*/_search

GET *traces-generic.otel*/_search

GET *logs-generic.otel*/_search
```
- Check in the APM UI (all the tabs)
>[!WARNING]
Currently the UI changes done in APM are not merged so some errors are
expected)

https://github.com/user-attachments/assets/92f63610-82da-40f3-89bb-00be83c55377

---------

Co-authored-by: miriam.aparicio <miriam.aparicio@gmail.com>
(cherry picked from commit 5067f15)

# Conflicts:
#	packages/kbn-apm-synthtrace-client/index.ts
#	packages/kbn-apm-synthtrace/src/cli/scenario.ts
#	packages/kbn-apm-synthtrace/src/cli/utils/bootstrap.ts
#	packages/kbn-apm-synthtrace/src/cli/utils/start_live_data_upload.ts
#	packages/kbn-apm-synthtrace/src/cli/utils/synthtrace_worker.ts
@rmyz rmyz requested a review from kibanamachine as a code owner February 18, 2025 10:05
@rmyz rmyz added the backport This PR is a backport of another PR label Feb 18, 2025
@rmyz rmyz enabled auto-merge (squash) February 18, 2025 10:05
@botelastic botelastic bot added ci:project-deploy-observability Create an Observability project Team:obs-ux-infra_services - DEPRECATED DEPRECATED - Use Team:obs-presentation. labels Feb 18, 2025
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/obs-ux-infra_services-team (Team:obs-ux-infra_services)

@github-actions
Copy link
Copy Markdown
Contributor

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

  • /oblt-deploy : Deploy a Kibana instance using the Observability test environments.
  • run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Feb 18, 2025

💚 Build Succeeded

  • Buildkite Build
  • Commit: 91cb1d4
  • Kibana Serverless Image: docker.elastic.co/kibana-ci/kibana-serverless:pr-211541-91cb1d4a9f6c

Metrics [docs]

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id before after diff
@kbn/apm-synthtrace 91 94 +3
@kbn/apm-synthtrace-client 255 272 +17
total +20

Public APIs missing exports

Total count of every type that is part of your API that should be exported but is not. This will cause broken links in the API documentation system. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats exports for more detailed information.

id before after diff
@kbn/apm-synthtrace 10 11 +1
Unknown metric groups

API count

id before after diff
@kbn/apm-synthtrace 91 94 +3
@kbn/apm-synthtrace-client 255 272 +17
total +20

History

@rmyz rmyz merged commit 398c1bf into elastic:8.x Feb 18, 2025
@rmyz rmyz deleted the backport/8.x/pr-192293 branch February 18, 2025 12:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport This PR is a backport of another PR ci:project-deploy-observability Create an Observability project Team:obs-ux-infra_services - DEPRECATED DEPRECATED - Use Team:obs-presentation.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants