Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ENHANCEMENT] Get and Visualize Embeddings by span name #5268

Open
mbegue-cr opened this issue Nov 4, 2024 · 1 comment
Open

[ENHANCEMENT] Get and Visualize Embeddings by span name #5268

mbegue-cr opened this issue Nov 4, 2024 · 1 comment
Labels
backlog c/ui enhancement New feature or request

Comments

@mbegue-cr
Copy link

Is your feature request related to a problem? Please describe.
I'd like to get quick access to use Phoenix's awesome UMAP embedding visualization for embedding vectors from a specific span name. For example, I have a RAG application that is misbehaving. I peek at embedding vectors with span name "user-input" for a quick spot-check for outliers or mode collapse. If that passes the smell test, I could do the same with "retrieved-documents". etc. etc.

Describe the solution you'd like
Not sure the best UI/UX implementation here, but it would be nice to say, filter by a span name, and then one-click visualize all embeddings in that name space.

Describe alternatives you've considered
The only way to achieve this access and visualization currently is to query the spans to a DataFrame and then import the DataFrame as a dataset with a schema.

Additional context
This is a nice-to-have. but I think it would round out Phoenix's power in terms of complete agent observability.

@mbegue-cr mbegue-cr added enhancement New feature or request triage issues that need triage labels Nov 4, 2024
@github-project-automation github-project-automation bot moved this to 📘 Todo in phoenix Nov 4, 2024
@dosubot dosubot bot added the c/ui label Nov 4, 2024
@axiomofjoy
Copy link
Contributor

Thanks for the note @mbegue-cr! Integrating an embeddings view is not currently on our roadmap, but it is available in the Arize SaaS platform.

@RogerHYang RogerHYang added backlog and removed triage issues that need triage labels Nov 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backlog c/ui enhancement New feature or request
Projects
Status: 📘 Todo
Development

No branches or pull requests

3 participants