-
Notifications
You must be signed in to change notification settings - Fork 2.6k
no streaming for ollama and re-arrange cards #4335
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
is Ollama only there because it's detected on your system? Hoping it's not shown by default, since most people wont have the hardware to support a local model that performs well with agents |
|
Thanks! I think the team prefers that Ollama is not shown at all, and it's within the Other Providers section. How does it determined detected? is it checking that someone has ollama installed on their device? |
|
@blackgirlbytes yeah it looks on device for it being installed |
|
@angiejones at the moment it detects but I don't think it shows/hides as it can offer to link to download (idea was to detect machine capacity, but perhaps that is too ambitious), if it is trapping people (who have very small ram) can make it hidden easily? |
Signed-off-by: Alex Rosenzweig <arosenzweig@squareup.com>
Signed-off-by: Dorien Koelemeijer <dkoelemeijer@squareup.com>
fixes: #4329
fixes: #4334
ollama now will advertise streaming, the goose provider incorrectly said it would support it, which would break it as of latest goose and ollama, this fixes that.
as requested, ollama below the fold (with a note that is for advanced users):
