Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Observability AI Assistant] Better title for Conversations generated by the Rule Connector #185022

Open
emma-raffenne opened this issue Jun 7, 2024 · 5 comments
Labels
bug Fixes for quality problems that affect the customer experience Team:Obs AI Assistant

Comments

@emma-raffenne
Copy link
Contributor

emma-raffenne commented Jun 7, 2024

Context

An Observability AI Assistant connector is available to be set as action for Observability rules. When an alert is triggered, a conversation with the AI assistant will be created sending the initial prompt set by the user in the rule action. The conversation is then stored and can be retrieved from the AI Assistant interface.

Problem

The evaluation conducted on the AI Assistant connector revealed that conversations created from the connector are saved always with the same title, i.e. "Understanding and Responding to Alert Triggers". Since more than one conversation can have been created in the same way, and there is no indication of the creation date or of the creator of the conversation in the interface, it is impossible to recognise them.

Image

Suggested improvement

For conversations created from an alert rule connector, the following pattern could be used: {rule title} - {timestamp}

@botelastic botelastic bot added needs-team Issues missing a team label and removed needs-team Issues missing a team label labels Jun 7, 2024
@emma-raffenne
Copy link
Contributor Author

cc @boriskirov

@emma-raffenne emma-raffenne added the bug Fixes for quality problems that affect the customer experience label Jul 4, 2024
@viduni94 viduni94 self-assigned this Oct 31, 2024
viduni94 added a commit to viduni94/kibana that referenced this issue Nov 4, 2024
viduni94 added a commit to viduni94/kibana that referenced this issue Nov 4, 2024
viduni94 added a commit to viduni94/kibana that referenced this issue Nov 4, 2024
viduni94 added a commit to viduni94/kibana that referenced this issue Nov 4, 2024
viduni94 added a commit to viduni94/kibana that referenced this issue Nov 4, 2024
viduni94 added a commit to viduni94/kibana that referenced this issue Nov 5, 2024
viduni94 added a commit to viduni94/kibana that referenced this issue Nov 5, 2024
viduni94 added a commit to viduni94/kibana that referenced this issue Nov 5, 2024
@viduni94
Copy link
Contributor

viduni94 commented Nov 7, 2024

Won't fix at the moment due to this reason:
#198791 (comment)

@viduni94 viduni94 closed this as completed Nov 7, 2024
@emma-raffenne
Copy link
Contributor Author

Reopening as titles may still appear duplicated. Pending UX design input to be addressed.

@boriskirov
Copy link
Contributor

Can we either use:
-а randomly generated key with a dash to differentiate if we don't have any metadata to use: {name}-{random-key}

  • or request from the LLM to always generate a different name, if there is already existing one

@viduni94

@viduni94
Copy link
Contributor

viduni94 commented Nov 13, 2024

Can we either use: -а randomly generated key with a dash to differentiate if we don't have any metadata to use: {name}-{random-key}

  • or request from the LLM to always generate a different name, if there is already existing one

@viduni94

Hi @boriskirov

I don't think I understood what you meant by if we don't have any metadata to use. (We would always have a timestamp, when the conversation is initiated)

For the 2 options you mentioned:

  • {name}-{random-key} - We could use this. However, the problem we were discussing about the timestamp was similar to this. If we have a long title, it wouldn't translate to the unified UX (when we implement it), because long titles are truncated in the unified UX design: More context here
  • request from the LLM to always generate a different name - I tried this, however the different names generated by the LLM are not very different and doesn't help much to uniquely identify the conversation (More context here)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Fixes for quality problems that affect the customer experience Team:Obs AI Assistant
Projects
None yet
4 participants