Skip to content

[v1] Guard resumable streaming updates against max_model_len overflow - #42502

Open
KrxGu wants to merge 1 commit into
vllm-project:mainfrom
KrxGu:fix-streaming-update-max-model-len
Open

KrxGu wants to merge 1 commit into
vllm-project:mainfrom
KrxGu:fix-streaming-update-max-model-len

[v1] Reject oversized resumable streaming updates before worker batch…

eadd718
Select commit
Loading
Failed to load commit list.