-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(vertexai): explicit caching #10363
Conversation
Implement explicit caching. - The CachedContent type. - Client methods to create, update, list and delete CachedContents. The update method follows the same pattern in some other cloud clients, where a separate type carries the fields to be updated. - Two ways to set the CachedContent in a model: 1. The GenerativeModel.CachedContentName field, which corresponds to the actual proto. 2. The GenerativeModelFromCachedContent method, which requires a properly initialized CachedContent but guarantees that the model names of the CachedContent and GenerativeModel are the same.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Approved, assuming it's a copy.
Let me know of any code changes.
It's a copy, see https://github.com/googleapis/google-cloud-go/pull/10363/commits |
🤖 I have created a release *beep* *boop* --- ## [0.11.0](https://github.com/googleapis/google-cloud-go/compare/vertexai/v0.10.0...vertexai/v0.11.0) (2024-06-11) ### Features * **vertexai:** Explicit caching ([#10363](https://github.com/googleapis/google-cloud-go/issues/10363)) ([d9754c7](https://github.com/googleapis/google-cloud-go/commit/d9754c7c07656b2f68cb63f24f1da4ddcc697f8f)) ### Bug Fixes * **vertexai:** Don't add empty Text parts to session history ([#10362](https://github.com/googleapis/google-cloud-go/issues/10362)) ([088b6c3](https://github.com/googleapis/google-cloud-go/commit/088b6c3afd85d75ce3b30af0620529ec04d4ce1c)), refs [#10309](https://github.com/googleapis/google-cloud-go/issues/10309) --- This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
This PR takes over from #10310 and adds the dependency bump for
cloud.google.com/go/aiplatform v1.68.0
following the landing of #9772