[TurboQuant] Reduce TurboQuant KV memory loss by deduplicating decode scratch buffers#40706

lesj0610 wants to merge 2 commits intovllm-project:mainvllm-project/vllm:mainfrom

lesj0610:lesj/tq-decode-workspace-deduplesj0610/vllm:lesj/tq-decode-workspace-dedupCopy head branch name to clipboard