Repository navigation

[ModelRunner V2] Reduce peak memory of chunked prompt logprobs - #64841

Merged

WoosukKwon merged 4 commits into

vllm-project:mainfrom

njhill:prompt-logprobs-peak-memory

Oct 31, 2026

Merged

[ModelRunner V2] Reduce peak memory of chunked prompt logprobs#64841
WoosukKwon merged 4 commits into
vllm-project:mainfrom
njhill:prompt-logprobs-peak-memory

Commits on Oct 31, 2026
- [ModelRunner V2] Reduce peak memory of chunked prompt logprobs
  
  njhill
  and
  claude
  committed
  cdbee80
- Merge branch 'main' into prompt-logprobs-peak-memory
  vllm-agent
  authored
  40de35b
- simplify
  njhill
  committed
  a4bfc35
- Merge branch 'main' into prompt-logprobs-peak-memory
  vllm-agent
  authored
  9ae59d1