[MRV2] Cap torch.topk rows in chunked prompt logprobs - #64914

[MRV2] Cap torch.topk rows in chunked prompt logprobs#64914

ivanium merged 5 commits into

vllm-project:mainvllm-project/vllm:mainfrom

njhill:prompt-logprobs-topk-splitnjhill/vllm:prompt-logprobs-topk-splitCopy head branch name to clipboard