Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Search message contents in log viewer #1377

Open
tadamcz opened this issue Feb 24, 2025 · 0 comments
Open

Search message contents in log viewer #1377

tadamcz opened this issue Feb 24, 2025 · 0 comments

Comments

@tadamcz
Copy link
Contributor

tadamcz commented Feb 24, 2025

Current behaviour

The log viewer offers some filtering, including on the contents of the input and target fields:

Image

Feature suggestion

Enable filtering on message contents, e.g. via an option named message_contains.

Perhaps one would want to filter on the role or other attributes of the message as well, e.g. find samples where a particular string appears in Assistant messages.

Challenges

I realise this may be non-trivial, since the text to search through may be large. In addition, when using the .eval format, the text to search through will be in the sample-level files, not in the header or summary files.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant