chore(deps): bump vllm from 0.18.0 to 0.19.1

[dependabot]

Bumps vllm from 0.18.0 to 0.19.1.

Release notes

Sourced from vllm's releases.

v0.19.1

This is a patch release on top of v0.19.0 with Transformers v5.5.3 upgrade and bug fixes for Gemma4:

• Update to transformers v5 (#30566)
• [Bugfix] Fix invalid JSON in Gemma 4 streaming tool calls by stripping partial delimiters (#38992)
• [Bugfix][Frontend] Fix Gemma4 streaming HTML duplication after tool calls (#38909)
• [Bugfix] Fix Gemma4 streaming tool call corruption for split boolean/number values (#39114)
• [Tool] adjust_request to reasoning parser, and Gemma4 fixes (#39027)
• [Gemma4] Support quantized MoE (#39045)
• Add Gemma4 Eagle3 support (#39450)
• [Gemma4][Bugfix]: Enable Gemma4ForCasualLM to load lora adapters correctly (#38844)
• [Bugfix] Fix Gemma4 tool parser converting bare null to string "null" (#39679)
• [Model] Fix Gemma 4 token repetition by dynamic BOS injection for PT models (#39842)
• fix(kimi_k25): resolve media_placeholder_token_id from tokenizer (#39344)

v0.19.0

vLLM v0.19.0

Highlights

This release features 448 commits from 197 contributors (54 new)!

• Gemma 4 support: Full Google Gemma 4 architecture support including MoE, multimodal, reasoning, and tool-use capabilities (#38826, #38847). Requires transformers>=5.5.0. We recommend using pre-built docker image vllm/vllm-openai:gemma4 for out of box usage.
• Zero-bubble async scheduling + speculative decoding: Async scheduling now supports speculative decoding with zero-bubble overlap, significantly improving throughput (#32951).
• Model Runner V2 maturation: MRV2 gains piecewise CUDA graphs for pipeline parallelism (#35162), spec decode rejection sampler with greedy/logprobs support (#37238, #37237), multi-modal embeddings for spec decode (#36097), streaming inputs (#37028), and EPLB support (#37488).
• ViT Full CUDA Graphs: Vision encoders (ViT) now support full CUDA graph capture for reduced overhead (#35963).
• General CPU KV cache offloading: A simple yet general CPU KV cache offloading mechanism for V1, with pluggable cache policy and block-level preemption handling (#37160, #37874, #34805, #36642, #37853).
• DBO (Dual-Batch Overlap) generalization: The microbatch optimization (DBO) now works with general models, not just specific architectures (#37926).
• NVIDIA B300/GB300 (SM 10.3) support: Allreduce fusion enabled by default with tuned all-reduce communicator (#37755, #37756).
• Transformers v5 compatibility: Broad compatibility fixes across many models for HuggingFace Transformers v5 (#37681, #38127, #38090, #38247, #38410).

Model Support

• New architectures: Gemma 4 (#38826), Cohere ASR (#35809), Cohere Transcribe (#38120), ColQwen3.5 4.5B (#36887), LFM2-ColBERT-350M (#37528), Granite 4.0 1B Speech (#38019), Qwen3-ForcedAligner (#35367).
• Speculative decoding: Eagle3 for Pixtral (#37182), EagleMistralLarge3 fix (#37232).
• LoRA expansion: H2OVL tower/connector LoRA (#31696), --lora-target-modules to restrict LoRA to specific modules (#34984), language_model_only respected (#37375), Mistral3 fix (#36928), Qwen3.5 fix (#36976), out-of-tree ops replacement (#37181).
• Model fixes: NemotronH MTP + Chunked Prefill (#35447), Qwen3-VL video timestamps (#37439), Qwen3.5 GDN quantized models (#37448), Qwen3Next A_log FP32 (#37810), JAIS ALiBi (#37820), RoBERTa CUDA graph position IDs (#37873), AudioFlamingo3/MusicFlamingo (#37643), Music Flamingo loading (#35535), bge-m3 task selection (#37632), Nemotron Parse loading (#37407), GLM OCR patch merger (#37962), PaddleOCR checkpoint compat (#38232), DeepSeek v3.2 params (#33703), MiniMax NVFP4 weight loading (#37214), gated model HF token (#37920), Parakeet OOM on long audio (#36671).
• Features: Temporal compression for Nemotron-3-VL videos (#36808), NemotronH Puzzle + MTP (#37803), torch.compile for InternVL vision encoder (#38049), multiple embedding types in single call (#35829).
• Performance: GLM-4.xv ViT optimization (#37779).

Engine Core

• Zero-bubble async scheduling + speculative decoding (#32951).
• Model Runner V2: PP CUDA graphs (#35162), spec decode rejection sampler greedy (#37238) + logprobs (#37237), multimodal embeddings for spec decode (#36097), streaming inputs (#37028), configurable acceptance rate (#38045), FP32 draft logits (#37526), FP64 Gumbel noise (#37798), warmup with spec decode (#37812).
• ViT Full CUDA Graph capture (#35963).
• General CPU KV cache offloading with pluggable CachePolicy (#37160, #37874), block-level preemption (#34805), multiple KV groups (#36642), hybrid model support (#37853).
• DBO for general models: Microbatch optimization generalized beyond specific architectures (#37926).
• Compilation: Mega AOT artifact for torch 2.12+ (#37198), lazy graph module to defer recompile (#37609), remove model tag requirement for compile cache (#37345), Triton autotuning disk cache enabled by default (#37188), inductor runtime asserts disabled by default (#37485).
• FlexAttention: Custom mask modification support (#37692).
• Attention: Distinguish short extends vs decodes (#37303), allow qk_nope_head_dim=192 in FlashInfer MLA (#37475), skip sliding window attention layers with FP8 KV cache (#33695).
• Scheduling: Schedule requests based on full input sequence length (#37307).
• Spec decode: Per-draft-model MoE backend via --speculative-config (#37880), Eagle3 drafter quant_config propagation (#37280), Eagle3 norm_before_fc propagation (#38111).
• Extensibility: PluggableLayer for CustomQwen2Decoder (#37293), tensor IPC transfer for multimodal data (#32104).

... (truncated)

Commits

• b1388b1 [CI][NIXL] Fix PD CI breakage: pin nixl-cu{12,13} versions (#39851)
• 9d78000 [CI Failure] pin nomic-embed-text-v1 revision (#39292)
• 39602eb [Bugfix] Fix CPU Dockerfile path after cherry-pick
• 7225a69 fix(test): recompute Jina ColBERT rotary inv_freq cleared by transformers v5 ...
• 9a3a31f Don't compile vision encoder for Transformers backend (#30518)
• 7bd3f40 [CI/Build] Fix sentence-transformers version in CPU test (#39557)
• c546038 [Kernel] Porting the TRTLLM minimax_allreduce_rms kernels (#37045)
• 4bbb8fa fix(kimi_k25): resolve media_placeholder_token_id from tokenizer (#39344)
• 459d9b3 Update to transformers v5 (#30566)
• b1568cf [Model] Fix Gemma 4 token repetition by dynamic BOS injection for PT models (...
• Additional commits viewable in compare view

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

[dependabot]

Superseded by #443.