Skip to content

feat: Add Grounding with Gemini Notebook #420

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
holtskinner merged 12 commits into from
Feb 27, 2024
Merged

feat: Add Grounding with Gemini Notebook #420

Show file tree
Hide file tree
Changes from 10 commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
22052f5
feat: Add Grounding with Gemini Notebook
holtskinner Feb 22, 2024
a81f57c
Update gemini readme for Grounding and reorder
holtskinner Feb 22, 2024
036474e
Merge branch 'main' into grounding
holtskinner Feb 22, 2024
94325a5
Rename to intro-grounding-gemini
holtskinner Feb 22, 2024
73ec625
Add markdown display and include cell outputs for grounding with Goog…
holtskinner Feb 22, 2024
43bcbe2
Merge branch 'main' into grounding
holtskinner Feb 23, 2024
ce78141
Merge branch 'main' into grounding
holtskinner Feb 26, 2024
068975a
Merge branch 'main' into grounding
holtskinner Feb 26, 2024
ee42b7a
Update CODEOWNERS
holtskinner Feb 27, 2024
ecba7f8
Minor changes
holtskinner Feb 27, 2024
344a805
Addressed Review comments
holtskinner Feb 27, 2024
299f686
Removed bullet about async
holtskinner Feb 27, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 4 additions & 3 deletions .github/CODEOWNERS
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,13 +11,14 @@
/generative-ai/embeddings @kazunori279 @GoogleCloudPlatform/generative-ai-devrel
/generative-ai/embeddings/use-cases/outlier-detection @rarsan @GoogleCloudPlatform/generative-ai-devrel
/generative-ai/gemini @polong-lin @GoogleCloudPlatform/generative-ai-devrel
/generative-ai/gemini/evaluation @inardini @GoogleCloudPlatform/generative-ai-devrel
/generative-ai/gemini/function-calling @koverholt @GoogleCloudPlatform/generative-ai-devrel
/generative-ai/gemini/getting-started @gericdong @polong-lin @GoogleCloudPlatform/generative-ai-devrel
/generative-ai/gemini/grounding @holtskinner @GoogleCloudPlatform/generative-ai-devrel
/generative-ai/gemini/responsible-ai @iamthuya @GoogleCloudPlatform/generative-ai-devrel
/generative-ai/gemini/use-cases/education @PicardParis @GoogleCloudPlatform/generative-ai-devrel
/generative-ai/gemini/use-cases/retail @iamthuya @GoogleCloudPlatform/generative-ai-devrel
/generative-ai/gemini/use-cases/applying-llms-to-data/using-gemini-with-bigquery-remote-functions @shanecglass @GoogleCloudPlatform/generative-ai-devrel
/generative-ai/gemini/getting-started @gericdong @polong-lin @GoogleCloudPlatform/generative-ai-devrel
/generative-ai/gemini/evaluation @inardini @GoogleCloudPlatform/generative-ai-devrel
/generative-ai/gemini/responsible-ai @iamthuya @GoogleCloudPlatform/generative-ai-devrel
/generative-ai/language @polong-lin @GoogleCloudPlatform/generative-ai-devrel
/generative-ai/language/getting-started @polong-lin @GoogleCloudPlatform/generative-ai-devrel
/generative-ai/language/grounding @koverholt @holtskinner @GoogleCloudPlatform/generative-ai-devrel
Expand Down
54 changes: 34 additions & 20 deletions gemini/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,15 +4,17 @@ Welcome to the Google Cloud [Generative AI](https://cloud.google.com/ai/generati

## Gemini

<img src="https://lh3.googleusercontent.com/eDr6pYKs1tT0iK0nt3pPhvVlP2Wn96fbGqbWgBAARRZ7isej037g_tWobjV8zQkxOsWzJuEH8p-fksczXUOeqxGZZIo_HUCdkn8q-a4fuwATD7Q9Xrs=w2456-l100-sg-rj-c0xffffff" style="width:35em">
<!-- markdownlint-disable MD033 -->
<img src="https://lh3.googleusercontent.com/eDr6pYKs1tT0iK0nt3pPhvVlP2Wn96fbGqbWgBAARRZ7isej037g_tWobjV8zQkxOsWzJuEH8p-fksczXUOeqxGZZIo_HUCdkn8q-a4fuwATD7Q9Xrs=w2456-l100-sg-rj-c0xffffff" style="width:35em" alt="Welcome to the Gemini era">
<!-- markdownlint-enable MD033 -->

Gemini is a family of generative AI models developed by Google DeepMind that is designed for multimodal use cases. The Gemini API gives you access to the Gemini Pro Vision and Gemini Pro models.

### Vertex AI Gemini API

On Google Cloud, the Vertex AI Gemini API provides a unified interface for interacting with Gemini models. There are currently two models available in the Gemini API:

- **Gemini Pro model** (`gemini-pro`): Designed to handle natural language tasks, multiturn text and code chat, and code generation.
- **Gemini Pro model** (`gemini-pro`): Designed to handle natural language tasks, multi-turn text and code chat, and code generation.
- **Gemini Pro Vision model** (`gemini-pro-vision`): Supports multimodal prompts. You can include text, images, and video in your prompt requests and get text or code responses.

The notebooks and samples in this folder focus on using the **Vertex AI SDK for Python** to call the Vertex AI Gemini API.
Expand All @@ -28,21 +30,21 @@ The notebooks and samples in this folder focus on using the **Vertex AI SDK for
</tr>
<tr>
<td>
<img src="https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/flag/default/40px.svg">
<img src="https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/flag/default/40px.svg" alt="flag">
<br>
<a href="getting-started/"><code>getting-started/</code></a>
</td>
<td>Get started with the Vertex AI Gemini API:
<ul>
<li><code>gemini-pro</code> model</li>
<li><code>gemini-pro-vision</code> model</li>
</ul>
</td>
</ul>
</td>
<td><a href="getting-started/">Starter notebooks</a></td>
</tr>
<tr>
<td>
<img src="https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/deployed_code/default/40px.svg">
<img src="https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/deployed_code/default/40px.svg" alt="deployed_code">
<br>
<a href="sample-apps/"><code>sample-apps/</code></a>
</td>
Expand All @@ -51,7 +53,7 @@ The notebooks and samples in this folder focus on using the **Vertex AI SDK for
</tr>
<tr>
<td>
<img src="https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/manufacturing/default/40px.svg">
<img src="https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/manufacturing/default/40px.svg" alt="manufacturing">
<br>
<a href="use-cases/"><code>use-cases/</code></a>
</td>
Expand All @@ -62,7 +64,16 @@ The notebooks and samples in this folder focus on using the **Vertex AI SDK for
</tr>
<tr>
<td>
<img src="https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/terminal/default/40px.svg">
<img src="https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/radar/default/40px.svg" alt="radar">
<br>
<a href="evaluation/"><code>evaluation/</code></a>
</td>
<td>Learn how to evaluate Gemini with Vertex AI Model Evaluation for GenAI</td>
<td><a href="evaluation/">Sample notebooks</a></td>
</tr>
<tr>
<td>
<img src="https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/terminal/default/40px.svg" alt="terminal">
<br>
<a href="function-calling/"><code>function-calling/</code></a>
</td>
Expand All @@ -73,7 +84,18 @@ The notebooks and samples in this folder focus on using the **Vertex AI SDK for
</tr>
<tr>
<td>
<img src="https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/health_and_safety/default/40px.svg">
<img src="https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/grass/default/40px.svg" alt="grass">
<br>
<a href="grounding/"><code>grounding/</code></a>
</td>
<td>
Learn how to use the <a href="https://cloud.google.com/vertex-ai/docs/generative-ai/grounding/ground-language-models">grounding</a> feature of Gemini
</td>
<td><a href="grounding/">Sample notebooks</a></td>
</tr>
<tr>
<td>
<img src="https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/health_and_safety/default/40px.svg" alt="health_and_safety">
<br>
<a href="responsible-ai/"><code>responsible-ai/</code></a>
</td>
Expand All @@ -82,7 +104,7 @@ The notebooks and samples in this folder focus on using the **Vertex AI SDK for
</tr>
<tr>
<td>
<img src="https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/build/default/40px.svg">
<img src="https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/build/default/40px.svg" alt="build">
<br>
<a href="../setup-env/"><code>setup-env/</code></a>
</td>
Expand All @@ -91,21 +113,13 @@ The notebooks and samples in this folder focus on using the **Vertex AI SDK for
</tr>
<tr>
<td>
<img src="https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/media_link/default/40px.svg">
<img src="https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/media_link/default/40px.svg" alt="media_link">
<br>
<a href="../RESOURCES.md"><code>RESOURCES.md</code></a>
</td>
<td>Learning resources (e.g. blogs, Youtube playlists) about Generative AI on Google Cloud</td>
<td><a href="../RESOURCES.md">Resources (e.g. videos, blogposts, learning paths)</a></td>
</tr>
<tr>
<td>
<img src="">
<br>
<a href="evaluation/"><code>RESOURCES.md</code></a>
</td>
<td>Learn how to evaluate Gemini with Vertex AI Model Evaluation for GenAI</td>
<td><a href="evaluation/">Sample notebooks</a></td>
</tr>

</table>
<!-- markdownlint-enable MD033 -->
Loading