Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add compatibility with Ollama #2

Open
carolinebridge opened this issue Oct 30, 2024 · 0 comments
Open

Add compatibility with Ollama #2

carolinebridge opened this issue Oct 30, 2024 · 0 comments

Comments

@carolinebridge
Copy link
Collaborator

Adding compatibility with Ollama gives users flexibility with the LLM they'd like to interface with about JBrowse 2 and their config files -- this comes with some caveats:

  1. We may need to write 3 different prompts, one for each language model, that works best with the language model of choice. Presently the sys prompt is written to work best with OpenAI
  2. We will need to add another "switch case" for Ollama if the user specifies they want to use it
  3. We need to be transparent that the effectiveness of the bot is intrinsic to the model they are using -- they may get worse responses from other language models (perhaps this is something we could add to the system prompts -- make the models provide some kind of citation or referral for every response they make so the user can have a higher degree of certainty about the response they get)

https://python.langchain.com/docs/integrations/providers/ollama/
https://github.com/ollama/ollama

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant