[https://nvbugs/5577178][fix] Score every prompt token when prompt logprobs hit the KV cache - #20646

[https://nvbugs/5577178][fix] Score every prompt token when prompt logprobs hit the KV cache#20646

tanmayv25 wants to merge 3 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

tanmayv25:fix/prompt-logprobs-kv-cache-reusetanmayv25/TensorRT-LLM:fix/prompt-logprobs-kv-cache-reuseCopy head branch name to clipboard