Skip to content

[ModelRunner V2] Accumulate chunked prompt logprobs on the host - #65049

Draft
njhill wants to merge 1 commit into
vllm-project:mainfrom
njhill:prompt-logprobs-host-agg
Draft

njhill wants to merge 1 commit into
vllm-project:mainfrom
njhill:prompt-logprobs-host-agg

Commits

  1. Commits on Nov 2, 2026