Making the name resolution part in the system prompt more strict.#259
Conversation
Also with the current changes the name resolution part covers more cases. Previously they were thought to be "common sense". The background of the issue is that the evaluation test cluster_info_conv/cluster_info_tool_call failed sometimes either because it thought that the name is the uuid, or it did not echoed the name of the cluster when it was not able to find it. I think echoing the name of the cluster back when not able to find it helps the user identify typos.
WalkthroughThe template modifies the cluster name resolution logic to first list all known clusters and perform exact-name matching before requesting a Cluster ID. Additionally, the apiVersion declaration is removed from the llama-stack ConfigMap resource declaration. Changes
Sequence Diagram(s)sequenceDiagram
actor User
participant System
participant ClusterAPI
User->>System: Provide cluster name (non-UUID)
rect rgb(200, 220, 255)
Note over System,ClusterAPI: New: List all clusters
System->>ClusterAPI: List all known clusters
ClusterAPI-->>System: Cluster list with names & IDs
end
System->>System: Perform exact-name match
alt Exactly one match found
System-->>User: Map name to Cluster ID
User->>System: Proceed with operation
else Multiple matches found
System-->>User: Request clarification on which Cluster ID
User->>System: Provide Cluster ID
else No matches found
rect rgb(255, 220, 200)
Note over System,User: New: Explicit messaging
System-->>User: Cluster name does not exist
end
System-->>User: Prompt for Cluster ID
User->>System: Provide Cluster ID
end
System->>ClusterAPI: Perform operation with Cluster ID
Estimated code review effort🎯 2 (Simple) | ⏱️ ~10 minutes
Possibly related PRs
Suggested labels
Suggested reviewers
Pre-merge checks and finishing touches❌ Failed checks (1 inconclusive)
✅ Passed checks (2 passed)
✨ Finishing touches🧪 Generate unit tests (beta)
📜 Recent review detailsConfiguration used: CodeRabbit UI Review profile: CHILL Plan: Pro 📒 Files selected for processing (1)
🔇 Additional comments (2)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: andrej1991, carbonin The full list of commands accepted by this bot can be found here. The pull request process is described here DetailsNeeds approval from an approver in each of these files:
Approvers can indicate their approval by writing |
e0b6086
into
rh-ecosystem-edge:main
Also with the current changes the name resolution part covers more cases. Previously they were thought to be "common sense". The background of the issue is that the evaluation test cluster_info_conv/cluster_info_tool_call failed sometimes either because it thought that the name is the uuid, or it did not echoed the name of the cluster when it was not able to find it.
I think echoing the name of the cluster back when not able to find it helps the user identify typos.
Summary by CodeRabbit
Release Notes
✏️ Tip: You can customize this high-level summary in your review settings.