You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
For models, especially open source ones with logprob available, we can potentially force model to select from a set of options such as select(["apple", "orange"). this is very helpful for using genai to do classification tasks.
This can be a parser_completion function in the model_client where user can customize.
liyin2015
changed the title
[logprob] something similar to guidance select
[logprob] to force llm to select from a list of options as output.
Jul 22, 2024
For models, especially open source ones with logprob available, we can potentially force model to select from a set of options such as
select(["apple", "orange")
. this is very helpful for using genai to do classification tasks.This can be a parser_completion function in the model_client where user can customize.
Guidance: https://github.com/guidance-ai/guidance/
The text was updated successfully, but these errors were encountered: