Vertex Model garden models

[pedroallenrevez]

Is it possible to use other models in the vertex model garden, or is it just gemini models through vertex?

[Kludex]

Do you have a reference to which models are you referring to?

[pedroallenrevez]

LIke mistral and anthropic models through vertex

[pedroallenrevez]

Ok @Kludex, basically you can use the already existing models, but with the vertex counterpart clients of the mistral and anthropic packages.

Feels really silly that there is no docs for this.
There are typing errors, but (mostly) it works.

            if "mistral" in model.identity.id:
                import sys
                from mistralai_gcp.models.usermessage import UserMessage as MistralUserMessage
                sys.modules['pydantic_ai.models.mistral'].MistralUserMessage = MistralUserMessage

                from mistralai_gcp import MistralGoogleCloud
                self._pydantic_model = MistralModel(
                    model.extra['pydantic_ai_alias'],
                    client=MistralGoogleCloud(
                        project_id=provider.project_id, 
                        region=provider.locations[0]
                    ),
                )
            elif "claude" in model.identity.id:
                from anthropic import AsyncAnthropicVertex
                self._pydantic_model = AnthropicModel(
                    model.extra["pydantic_ai_alias"],
                    anthropic_client=AsyncAnthropicVertex(
                        project_id=provider.project_id,
                        region=provider.locations[0]
                    )
                )