Skip to content

Add /v1/chat/completions/batch endpoint for batched chat completions - #38011

Merged
DarkLight1337 merged 24 commits into
vllm-project:mainfrom
MatejRojec:feature/add-batch-requests-to-chat-completions-api
Mar 26, 2026
Merged

Add /v1/chat/completions/batch endpoint for batched chat completions#38011
DarkLight1337 merged 24 commits into
vllm-project:mainfrom
MatejRojec:feature/add-batch-requests-to-chat-completions-api

Fix EngineInput import in batch_serving.py

cc69644
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Mar 25, 2026 in 0s

There is no internal Diff connected, this can be merged now

View more details on Meta CodeSync