Skip to content

[Security Assistant] Starter prompt telemetry!#226063

Merged
stephmilovic merged 2 commits intoelastic:mainfrom
stephmilovic:starter_prompt_telemetry
Jul 2, 2025
Merged

[Security Assistant] Starter prompt telemetry!#226063
stephmilovic merged 2 commits intoelastic:mainfrom
stephmilovic:starter_prompt_telemetry

Conversation

@stephmilovic
Copy link
Contributor

@stephmilovic stephmilovic commented Jul 1, 2025 •
edited by kibanamachine
Loading

Summary

Adds a new ebt-kibana-browser event type of Assistant Starter Prompt that reuses the same promptTitle parameter as the Assistant Quick Prompt. Since the starter prompts are always defined by us, there is no user data to mask and no need for "Custom" entries like we have for quick prompts.

We're tracking when the starter prompts are clicked, not when they are sent.

To test

  1. have the feature flag enabled: feature_flags.overrides.elasticAssistant.starterPromptsEnabled: true
  2. Do some clicking of the starter prompts. Keep track of how many times you click each prompt.
  3. Wait ~1 hour (or more) for your events to show on the telemetry instance
  4. Check this dashboard for your events: https://telemetry-v2-staging.elastic.dev/s/securitysolution/app/r/s/eLwM5. Ensure the counts match up with what you tracked.
Screenshot 2025-07-02 at 8 16 18 AM

@stephmilovic stephmilovic requested a review from a team as a code owner July 1, 2025 18:06
@stephmilovic stephmilovic added release_note:skip Skip the PR/issue when compiling release notes Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Team:Security Generative AI Security Generative AI backport:version Backport to applied version labels v9.1.0 v8.19.0 v9.2.0 labels Jul 1, 2025
@elasticmachine
Copy link
Contributor

elasticmachine commented Jul 1, 2025

Pinging @elastic/security-solution (Team: SecuritySolution)

@stephmilovic
Copy link
Contributor Author

stephmilovic commented Jul 1, 2025

@elasticmachine merge upstream

@elasticmachine
Copy link
Contributor

elasticmachine commented Jul 1, 2025

💚 Build Succeeded

Metrics [docs]

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id before after diff
@kbn/elastic-assistant 172 175 +3

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id before after diff
elasticAssistant 261.2KB 261.4KB +257.0B
Unknown metric groups

API count

id before after diff
@kbn/elastic-assistant 205 208 +3

History

e40pud
e40pud approved these changes Jul 2, 2025
View reviewed changes
Copy link
Contributor

@e40pud e40pud left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changes LGTM!

I tested locally, but after an hour still don't see events in the stage env. I can see events from (I guess yours) previous runs

Screenshot 2025-07-02 at 13 27 34

Approving and will be monitoring the stage env to see if my events will appear eventually.

@stephmilovic stephmilovic merged commit 5c4c7d9 into elastic:main Jul 2, 2025
10 checks passed
@kibanamachine
Copy link
Contributor

kibanamachine commented Jul 2, 2025

Starting backport for target branches: 8.19, 9.1

https://github.com/elastic/kibana/actions/runs/16027646303

kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Jul 2, 2025
@stephmilovic
[Security Assistant] Starter prompt telemetry! (elastic#226063)
2a76211 
(cherry picked from commit 5c4c7d9)
@kibanamachine kibanamachine mentioned this pull request Jul 2, 2025
Merged
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Jul 2, 2025
@stephmilovic
[Security Assistant] Starter prompt telemetry! (elastic#226063)
2882de0 
(cherry picked from commit 5c4c7d9)
@kibanamachine kibanamachine mentioned this pull request Jul 2, 2025
Merged
@kibanamachine
Copy link
Contributor

kibanamachine commented Jul 2, 2025

💚 All backports created successfully

Status Branch Result
✅ 8.19
✅ 9.1

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

kibanamachine added a commit that referenced this pull request Jul 2, 2025
@kibanamachine @stephmilovic
[8.19] [Security Assistant] Starter prompt telemetry! (#226063) (#226231
1da91bc 
)

# Backport

This will backport the following commits from `main` to `8.19`:
- [[Security Assistant] Starter prompt telemetry!
(#226063)](#226063)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Steph
Milovic","email":"stephanie.milovic@elastic.co"},"sourceCommit":{"committedDate":"2025-07-02T14:17:03Z","message":"[Security
Assistant] Starter prompt telemetry!
(#226063)","sha":"5c4c7d9a3e3cbc7406686adaa1efa9832de71ff5","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","Team:
SecuritySolution","Team:Security Generative
AI","backport:version","v9.1.0","v8.19.0","v9.2.0"],"title":"[Security
Assistant] Starter prompt
telemetry!","number":226063,"url":"https://github.com/elastic/kibana/pull/226063","mergeCommit":{"message":"[Security
Assistant] Starter prompt telemetry!
(#226063)","sha":"5c4c7d9a3e3cbc7406686adaa1efa9832de71ff5"}},"sourceBranch":"main","suggestedTargetBranches":["9.1","8.19"],"targetPullRequestStates":[{"branch":"9.1","label":"v9.1.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/226063","number":226063,"mergeCommit":{"message":"[Security
Assistant] Starter prompt telemetry!
(#226063)","sha":"5c4c7d9a3e3cbc7406686adaa1efa9832de71ff5"}}]}]
BACKPORT-->

Co-authored-by: Steph Milovic <stephanie.milovic@elastic.co>
kibanamachine added a commit that referenced this pull request Jul 2, 2025
@kibanamachine @stephmilovic
[9.1] [Security Assistant] Starter prompt telemetry! (#226063) (#226232)
84ecccb 
# Backport

This will backport the following commits from `main` to `9.1`:
- [[Security Assistant] Starter prompt telemetry!
(#226063)](#226063)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Steph
Milovic","email":"stephanie.milovic@elastic.co"},"sourceCommit":{"committedDate":"2025-07-02T14:17:03Z","message":"[Security
Assistant] Starter prompt telemetry!
(#226063)","sha":"5c4c7d9a3e3cbc7406686adaa1efa9832de71ff5","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","Team:
SecuritySolution","Team:Security Generative
AI","backport:version","v9.1.0","v8.19.0","v9.2.0"],"title":"[Security
Assistant] Starter prompt
telemetry!","number":226063,"url":"https://github.com/elastic/kibana/pull/226063","mergeCommit":{"message":"[Security
Assistant] Starter prompt telemetry!
(#226063)","sha":"5c4c7d9a3e3cbc7406686adaa1efa9832de71ff5"}},"sourceBranch":"main","suggestedTargetBranches":["9.1","8.19"],"targetPullRequestStates":[{"branch":"9.1","label":"v9.1.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/226063","number":226063,"mergeCommit":{"message":"[Security
Assistant] Starter prompt telemetry!
(#226063)","sha":"5c4c7d9a3e3cbc7406686adaa1efa9832de71ff5"}}]}]
BACKPORT-->

Co-authored-by: Steph Milovic <stephanie.milovic@elastic.co>
kertal pushed a commit to kertal/kibana that referenced this pull request Jul 25, 2025
@stephmilovic @kertal
[Security Assistant] Starter prompt telemetry! (elastic#226063)
1016efd
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@e40pud e40pud e40pud approved these changes

Assignees

No one assigned

Labels

backport:version Backport to applied version labels release_note:skip Skip the PR/issue when compiling release notes Team:Security Generative AI Security Generative AI Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. v8.19.0 v9.1.0 v9.2.0

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@stephmilovic @elasticmachine @kibanamachine @e40pud