Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] using Gemini LLM doesn't work in main branch #822

Open
mottolini opened this issue May 16, 2024 · 4 comments
Open

[BUG] using Gemini LLM doesn't work in main branch #822

mottolini opened this issue May 16, 2024 · 4 comments
Labels
bug Something isn't working

Comments

@mottolini
Copy link

Describe the bug
After you insert your key in the configuration of both the LLM and the Embedder, whenever you try to get a response you receive the error:

Invalid argument provided to Gemini: 400 * GenerateContentRequest.generation_config.stop_sequences: the number of stop_sequences must not exceed 5.

To Reproduce
This happens on branch main, commit c79272b.
It appears to be already fixed on branch develop, commit 3860a48

@pieroit
Copy link
Member

pieroit commented May 24, 2024

@mottolini can you confirm it works with VPN in develop?
Gave more info in #827

@pieroit
Copy link
Member

pieroit commented Jun 3, 2024

@mottolini can you check if the proble is still there in Cat 1.6.2?

@Kleomen
Copy link

Kleomen commented Jul 1, 2024

@mottolini can you check if the proble is still there in Cat 1.6.2?

It is even worse because currently you cannot set a Gemini API key on v 1.6.2

INFO:     172.17.0.1:46620 - "PUT /llm/settings/LLMOpenAIConfig HTTP/1.1" 400 Bad Request
INFO:     172.17.0.1:46814 - "GET /admin/favicon.ico HTTP/1.1" 200 OK
INFO:     172.17.0.1:46814 - "GET /admin/favicon.ico HTTP/1.1" 200 OK
INFO:     172.17.0.1:46814 - "GET /llm/settings HTTP/1.1" 200 OK
[2024-07-01 08:07:27.264] ERROR  cat.routes.llm..upsert_llm_setting::130
GoogleGenerativeAIError('Error embedding content: 504 Deadline Exceeded')

@chemickypes
Copy link

I got the same error

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants