Skip to content

[Bugfix][V1] Chunk prompt logprob computation to bound peak VRAM - #2

Closed
mganczarenko wants to merge 1 commit into
mainfrom
fix/xpu-prompt-logprob-oom-chunked
Closed

[Bugfix][V1] Chunk prompt logprob computation to bound peak VRAM#2
mganczarenko wants to merge 1 commit into
mainfrom
fix/xpu-prompt-logprob-oom-chunked

Commits

Commits on Jun 16, 2026