[Spec Decode] Utilities and refactor to support qlen>1 decode kernels for spec decode#25183

benchislett wants to merge 4 commits into

vllm-project:mainvllm-project/vllm:mainfrom

CentML:setup-for-spec-decode-kernelsCentML/vllm:setup-for-spec-decode-kernelsCopy head branch name to clipboard