Skip to content

[9.1] [Obs AI Assistant] Disallow destructive actions via the Elasticsearch tool (#229497)#229811

Merged
viduni94 merged 1 commit intoelastic:9.1from
kibanamachine:backport/9.1/pr-229497
Jul 29, 2025
Merged

[9.1] [Obs AI Assistant] Disallow destructive actions via the Elasticsearch tool (#229497)#229811
viduni94 merged 1 commit intoelastic:9.1from
kibanamachine:backport/9.1/pr-229497

Conversation

@kibanamachine
Copy link
Copy Markdown
Contributor

Backport

This will backport the following commits from main to 9.1:

Questions ?

Please refer to the Backport tool documentation

… tool (elastic#229497)

Closes elastic#229501

## Summary

### Problem
There have been several reports that the AI Assistant goes rogue and
performs destructive actions.

### Solution
- Instruct the LLM to not perform destructive actions and to mention to
the user that these actions can't be performed
- Only allow `GET` requests and `GET`/`POST` requests to the `/_search`
endpoint when executing the Elasticsearch tool
- If the LLM attempts to call disallowed methods, throw an error

The evaluation framework scenarios which expected deletion of an index
was updated to conform to the above changes as well.

### What's not included
- Guardrails for the `query` tool and `kibana` tool
- Allowing destructive actions via a button click to "Confirm"

### Checklist

- [x] The PR description includes the appropriate Release Notes section,
and the correct `release_note:*` label is applied per the
[guidelines](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)
- [x] Review the [backport
guidelines](https://docs.google.com/document/d/1VyN5k91e5OVumlc0Gb9RPa3h1ewuPE705nRtioPiTvY/edit?usp=sharing)
and apply applicable `backport:*` labels.

(cherry picked from commit 808bac6)
@kibanamachine kibanamachine added the backport This PR is a backport of another PR label Jul 29, 2025
@kibanamachine kibanamachine enabled auto-merge (squash) July 29, 2025 13:37
@botelastic botelastic bot added ci:project-deploy-observability Create an Observability project Team:Obs AI Assistant Observability AI Assistant labels Jul 29, 2025
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/obs-ai-assistant (Team:Obs AI Assistant)

@github-actions
Copy link
Copy Markdown
Contributor

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

  • /oblt-deploy : Deploy a Kibana instance using the Observability test environments.
  • run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

@viduni94 viduni94 disabled auto-merge July 29, 2025 13:46
@viduni94 viduni94 enabled auto-merge (squash) July 29, 2025 13:46
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Jul 29, 2025

💚 Build Succeeded

  • Buildkite Build
  • Commit: 7b0031d
  • Kibana Serverless Image: docker.elastic.co/kibana-ci/kibana-serverless:pr-229811-7b0031da51ec

Metrics [docs]

✅ unchanged

History

cc @viduni94

@viduni94 viduni94 merged commit f1e4dbd into elastic:9.1 Jul 29, 2025
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport This PR is a backport of another PR ci:project-deploy-observability Create an Observability project Team:Obs AI Assistant Observability AI Assistant

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants