Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
27 changes: 27 additions & 0 deletions LLM Model Serving/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
# Model Serving in Snowpark Container Services

[Snowflake Documentation](https://docs.snowflake.com/en/developer-guide/snowflake-ml/model-registry/container)
See the [Examples](#examples) section to find end-to-end examples of using Model Serving in SPCS.

## Setup

Ensure you have the latest available `snowflake-ml-python` SDK.

```bash
pip install snowflake-ml-python
```

## Getting Started

### Prerequisites

1. [Create a Compute Pool](https://docs.snowflake.com/en/developer-guide/snowflake-ml/model-registry/container#create-a-compute-pool)
2. [Create an Image Repository](https://docs.snowflake.com/en/developer-guide/snowflake-ml/model-registry/container#create-an-image-repository)

## Examples

### Jupyter Notebooks

Examples showcasing how Model Serving can be used from a notebook environment like Jupyter or Snowflake Notebook.

- [Med Gemma Quickstart Notebook](./med_gemma.ipynb) - log a MedGemma model and serve using SPCS.
Loading