From 24c8fb5232b8c56ca11873eafa6635553af8361e Mon Sep 17 00:00:00 2001 From: z1ying Date: Sat, 11 Apr 2026 21:28:28 -0700 Subject: [PATCH 1/2] docs: add Gemma 4 support to supported_models.md file Signed-off-by: z1ying --- docs/models/supported_models.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/models/supported_models.md b/docs/models/supported_models.md index ef1f5901ed03..f13d2e6c8bed 100644 --- a/docs/models/supported_models.md +++ b/docs/models/supported_models.md @@ -400,6 +400,7 @@ th { | `Gemma2ForCausalLM` | Gemma 2 | `google/gemma-2-9b`, `google/gemma-2-27b`, etc. | ✅︎ | ✅︎ | | `Gemma3ForCausalLM` | Gemma 3 | `google/gemma-3-1b-it`, etc. | ✅︎ | ✅︎ | | `Gemma3nForCausalLM` | Gemma 3n | `google/gemma-3n-E2B-it`, `google/gemma-3n-E4B-it`, etc. | | | +| `Gemma4ForCausalLM` | Gemma 4 | `google/gemma-4-E2B-it`, etc. | ✅︎ | ✅︎ | | `GlmForCausalLM` | GLM-4 | `zai-org/glm-4-9b-chat-hf`, etc. | ✅︎ | ✅︎ | | `Glm4ForCausalLM` | GLM-4-0414 | `zai-org/GLM-4-32B-0414`, etc. | ✅︎ | ✅︎ | | `Glm4MoeForCausalLM` | GLM-4.5, GLM-4.6, GLM-4.7 | `zai-org/GLM-4.5`, etc. | ✅︎ | ✅︎ | @@ -554,6 +555,7 @@ These models primarily accept the [`LLM.generate`](./generative_models.md#llmgen | `FuyuForCausalLM` | Fuyu | T + I | `adept/fuyu-8b`, etc. | | ✅︎ | | `Gemma3ForConditionalGeneration` | Gemma 3 | T + IE+ | `google/gemma-3-4b-it`, `google/gemma-3-27b-it`, etc. | ✅︎ | ✅︎ | | `Gemma3nForConditionalGeneration` | Gemma 3n | T + I + A | `google/gemma-3n-E2B-it`, `google/gemma-3n-E4B-it`, etc. | | | +| `Gemma4ForConditionalGeneration` | Gemma 4 | T + I+ + V + A | `google/gemma-4-E2B-it`, etc. | | ✅︎ | | `GLM4VForCausalLM`^ | GLM-4V | T + I | `zai-org/glm-4v-9b`, `zai-org/cogagent-9b-20241220`, etc. | ✅︎ | ✅︎ | | `Glm4vForConditionalGeneration` | GLM-4.1V-Thinking | T + IE+ + VE+ | `zai-org/GLM-4.1V-9B-Thinking`, etc. | ✅︎ | ✅︎ | | `Glm4vMoeForConditionalGeneration` | GLM-4.5V | T + IE+ + VE+ | `zai-org/GLM-4.5V`, etc. | ✅︎ | ✅︎ | From 1820810015a311d1ec46dde5f92a5be794386d71 Mon Sep 17 00:00:00 2001 From: z1ying Date: Sun, 12 Apr 2026 09:55:58 -0700 Subject: [PATCH 2/2] [Doc] Clarify Gemma 4 modality support Address review feedback: remove video from native modalities, mark audio as variant-specific since only E2B/E4B include an audio tower, and add a note explaining these constraints. Signed-off-by: z1ying --- docs/models/supported_models.md | 8 +++++++- 1 file changed, 7 insertions(+), 1 deletion(-) diff --git a/docs/models/supported_models.md b/docs/models/supported_models.md index f13d2e6c8bed..6a9bc3dae58f 100644 --- a/docs/models/supported_models.md +++ b/docs/models/supported_models.md @@ -555,7 +555,7 @@ These models primarily accept the [`LLM.generate`](./generative_models.md#llmgen | `FuyuForCausalLM` | Fuyu | T + I | `adept/fuyu-8b`, etc. | | ✅︎ | | `Gemma3ForConditionalGeneration` | Gemma 3 | T + IE+ | `google/gemma-3-4b-it`, `google/gemma-3-27b-it`, etc. | ✅︎ | ✅︎ | | `Gemma3nForConditionalGeneration` | Gemma 3n | T + I + A | `google/gemma-3n-E2B-it`, `google/gemma-3n-E4B-it`, etc. | | | -| `Gemma4ForConditionalGeneration` | Gemma 4 | T + I+ + V + A | `google/gemma-4-E2B-it`, etc. | | ✅︎ | +| `Gemma4ForConditionalGeneration` | Gemma 4 | T + I+ + A* | `google/gemma-4-E2B-it`, etc. | | ✅︎ | | `GLM4VForCausalLM`^ | GLM-4V | T + I | `zai-org/glm-4v-9b`, `zai-org/cogagent-9b-20241220`, etc. | ✅︎ | ✅︎ | | `Glm4vForConditionalGeneration` | GLM-4.1V-Thinking | T + IE+ + VE+ | `zai-org/GLM-4.1V-9B-Thinking`, etc. | ✅︎ | ✅︎ | | `Glm4vMoeForConditionalGeneration` | GLM-4.5V | T + IE+ + VE+ | `zai-org/GLM-4.5V`, etc. | ✅︎ | ✅︎ | @@ -635,6 +635,7 @@ Some models are supported only via the [Transformers modeling backend](#transfor ^ You need to set the architecture name via `--hf-overrides` to match the one in vLLM.
E Pre-computed embeddings can be inputted for this modality.
+ Multiple items can be inputted per text prompt for this modality. +* Only specific variants of the model support this modality (see notes below).
!!! note `Gemma3nForConditionalGeneration` is only supported on V1 due to shared KV caching and it depends on `timm>=1.0.17` to make use of its @@ -645,6 +646,11 @@ Some models are supported only via the [Transformers modeling backend](#transfor - Both audio and vision MM encoders use `transformers.AutoModel` implementation. - There's no PLE caching or out-of-memory swapping support, as described in [Google's blog](https://developers.googleblog.com/en/introducing-gemma-3n/). These features might be too model-specific for vLLM, and swapping in particular may be better suited for constrained setups. +!!! note + For `Gemma4ForConditionalGeneration`: + - audio input is only supported by the `gemma-4-E2B` and `gemma-4-E4B` variants. + - Video is not a native input modality; users can pre-process videos into frames externally. + !!! note For `InternVLChatModel`, only InternVL2.5 with Qwen2.5 text backbone (`OpenGVLab/InternVL2.5-1B` etc.), InternVL3 and InternVL3.5 have video inputs support currently.