-
Notifications
You must be signed in to change notification settings - Fork 70
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Document relationship with cloud SDK genai client #219
Comments
Thanks for the note. We're thinking about the topic of documentation more holistically now across the different SDKs and languages; I will keep this issue open for now |
To elaborate on some of your observations:
|
Thanks @jba - I hadn't realized there's actually two APIs with similar surfaces, which is clarifying. BTW, I didn't mean to indicate the APIs aren't idiomatic, I found them easy enough to use, I was just surprised to see the match against the GCP SDK's client, which I'm used to not having such usability in other services ;) I suspect just a line such as this at the top of the docs would help a lot. "Generative AI" is a general term so I think it's easy to expect this repo to apply to vertex AI as well and cause confusion.
|
We recommend switching to the new client, google.golang.org/genai. It exposes the same API for both the Google AI and Vertex services. You can file bugs on its issue tracker. |
Description of the feature request:
I found this library when searching for connecting to Gemini from Go. I was familiar with cloud.google.com/go/vertexai/genai and hadn't seen this yet, without thinking too much I thought perhaps it's a more idiomatic entry point to genai than the cloud SDK which are often close to auto-generated stubs (though I'm not sure this is the case for
vertexai/genai
specifically). But when trying to use the client with application default credentials like normal, usingoption.WithTokenSource
, I couldn't get it to authenticate, even when trying scopes likehttps://www.googleapis.com/auth/generative-language
. Eventually, I switched tovertexai/genai
and had no problem. To my surprise, this was almost just replacing import statements, and one tweak to client initialization logic, which made me realize my hypothesis about the API being possibly more idiomatic wasn't correct.I notice the docs for this project mention using an API key and don't mention application default credentials (yes I did try knowing the doc said "requires an API key" hoping it was a typo), other than that I'm not clear what the difference / use case for this project is. I guess my new hypothesis is it's meant to be for non-GCP users, while I've never thought to try it I guess "Google AI" is trying to be a purely AI product with decoupling from GCP. For GCP users, it's best to stick to the cloud SDK.
It would be nice to add documentation something like that, or otherwise whatever the case may be, to help prevent confusion for users that happen to find this while trying to use within GCP.
What problem are you trying to solve with this feature?
No response
Any other information you'd like to share?
No response
The text was updated successfully, but these errors were encountered: