Skip to content

Issues: MadcowD/ell

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

159 Open 126 Closed
159 Open 126 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

ToolCall should be serializable
#412 opened Dec 30, 2024 by fightingmonk
2
No client found for model (Anthropic)
#408 opened Dec 17, 2024 by britannio
2
Have no response when using the custom model client
#407 opened Dec 17, 2024 by YuhaoCheng
Prompt not properly versioned when in a class
#404 opened Dec 13, 2024 by brenorb
3
eval error
#399 opened Dec 7, 2024 by MadcowD
Evaluation - ValueError: Invalid input type: <class 'str'> - Correction Found
#398 opened Dec 5, 2024 by brenorb
2
Evaluation example is wrong.
#397 opened Dec 5, 2024 by brenorb
LMPs return a 3-tuple when exempt_from_tracking=True
#394 opened Nov 28, 2024 by jwang-paradise
1
Export dataset functionality in ell-studio
#393 opened Nov 27, 2024 by lingster
Stream api
#392 opened Nov 26, 2024 by alex-dixon
2
api design: parsed.model_dump()
#391 opened Nov 24, 2024 by pearli-pearli
1
Cache completions
#389 opened Nov 22, 2024 by abrichr
2
Tool call renders inconsistently in studio
#387 opened Nov 19, 2024 by alex-dixon
Tool call missing params in studio
#386 opened Nov 19, 2024 by alex-dixon
Dataset construction needs to be easy and there should be libraries around this, also matching parity with OpenAI evals
#382 opened Nov 13, 2024 by MadcowD
Easily be able to isolate datapoints below. a certain score etx
#381 opened Nov 13, 2024 by MadcowD
# Be able to see the outputs of the criterion function as it used in the eval.
#380 opened Nov 13, 2024 by MadcowD
Working verbose mode for @function
#379 opened Nov 13, 2024 by MadcowD
Easy comparison across many models
#378 opened Nov 13, 2024 by MadcowD
Run summaries should work with annotations and no metrics or no metrics at all
#377 opened Nov 13, 2024 by MadcowD
Build a UX which is compatible with no metrics & prompt engineering by vibes.
#376 opened Nov 13, 2024 by MadcowD
Summaries for other type of data like annotations or criterion
#374 opened Nov 13, 2024 by MadcowD
Implement a bunch of standard criteria
#373 opened Nov 13, 2024 by MadcowD
UX for showing the model is different
#372 opened Nov 13, 2024 by MadcowD
UX for api params
#371 opened Nov 13, 2024 by MadcowD
ProTip! What’s not been updated in a month: updated:<2024-12-02.