Skip to content

Evals #69

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
JReinhold merged 52 commits into from
Nov 17, 2025
Merged

Evals #69

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
52 commits
Select commit Hold shift + click to select a range
1268311
add initial eval setup
JReinhold Nov 3, 2025
163211d
well, a lot happened here...
JReinhold Nov 4, 2025
774a712
add clack
JReinhold Nov 4, 2025
b76cd50
Add interactive prompts and styled output to eval CLI (#65)
Copilot Nov 4, 2025
a2523e0
improve terminal experience
JReinhold Nov 4, 2025
202f182
save environment
JReinhold Nov 4, 2025
d43d94f
improve terminal experience
JReinhold Nov 5, 2025
ccba229
only allow one eval at a time
JReinhold Nov 5, 2025
5862e12
add support for custom context
JReinhold Nov 5, 2025
323fb19
format
JReinhold Nov 5, 2025
dec462b
add support for eval hooks, add log about how to rerun experiments
JReinhold Nov 6, 2025
67e384c
prompt to start storybook at the end of the evaluation
JReinhold Nov 6, 2025
de4f0d7
add message about getting into the experiment
JReinhold Nov 6, 2025
2e6a7b2
improve experiment dir name
JReinhold Nov 6, 2025
39426bf
take screenshots of failed stories too
JReinhold Nov 6, 2025
f1dc661
cleanup
JReinhold Nov 6, 2025
8dddf18
improve reshaped stories, improve test+a11y summary, improve mcp serv…
JReinhold Nov 7, 2025
6b8d294
support --[no-]storybook flag
JReinhold Nov 8, 2025
947834f
collect experiment description and branch name
JReinhold Nov 8, 2025
61bb9d2
save result summary to google sheets
JReinhold Nov 8, 2025
821f609
improve plain prompt
JReinhold Nov 10, 2025
72e8470
prompt for google sheets upload
JReinhold Nov 10, 2025
ba29af6
fix google sheets upload
JReinhold Nov 10, 2025
a351cda
support "Storybook MCP" context, which starts up the docs-only @story…
JReinhold Nov 10, 2025
3f1760e
Add basic Radix eval (#66)
shilman Nov 10, 2025
a9d6075
format
JReinhold Nov 10, 2025
387a6b1
fix typechecking
JReinhold Nov 11, 2025
cb14fc7
add reshaped component manifest
JReinhold Nov 11, 2025
8c0fbd8
add conversation-viewer.html with approximate token count
JReinhold Nov 11, 2025
447c2d1
Merge branch 'next' of https://github.com/storybookjs/mcp into evals-…
JReinhold Nov 11, 2025
afa48d2
cleanup
JReinhold Nov 11, 2025
8867cdc
add documentation, fixups
JReinhold Nov 11, 2025
25d4f4c
format
JReinhold Nov 12, 2025
6a1e10b
fix stories not having imports anymore
JReinhold Nov 12, 2025
4da786c
fix plain and radix experiments
JReinhold Nov 12, 2025
ad8af1d
experiments will have unique package names
JReinhold Nov 12, 2025
2598604
more eval test fixing
JReinhold Nov 12, 2025
ce2a5d9
more story fixes
JReinhold Nov 12, 2025
30676d4
fix typecheck and lint summary
JReinhold Nov 12, 2025
5ffd5ff
improve conversation viewer
JReinhold Nov 12, 2025
55f15a2
simplify viewer content
JReinhold Nov 13, 2025
b904483
simplify viewer content
JReinhold Nov 13, 2025
98b6016
Merge branch 'evals-v0.1' of https://github.com/storybookjs/mcp into …
JReinhold Nov 13, 2025
b0a3941
result visualisations is via storybook
JReinhold Nov 13, 2025
6b54740
upload to chromatic
JReinhold Nov 14, 2025
c320304
update google sheet row order
JReinhold Nov 14, 2025
5b35477
add Chromatic link to CLI log
JReinhold Nov 14, 2025
ff552cc
add note about public results
JReinhold Nov 14, 2025
b80922d
Merge branch 'next' of https://github.com/storybookjs/mcp into evals-…
JReinhold Nov 17, 2025
314af88
remove description arg from evals
JReinhold Nov 17, 2025
593dcdd
Evals: Add Radix UI website prompt (#74)
shilman Nov 17, 2025
05437c1
Merge branch 'next' into evals-v0.1
JReinhold Nov 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/copilot-instructions.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -288,6 +288,7 @@ For detailed package-specific guidance, see:

- `packages/addon-mcp/**` → `.github/instructions/addon-mcp.instructions.md`
- `packages/mcp/**` → `.github/instructions/mcp.instructions.md`
- `eval/**` → `.github/instructions/eval.instructions.md`

## Documentation resources

Expand Down
Loading
Loading