[Model Runner V2][Spec Decode] Add KV cache support for multi-layer MTP - #50062

[Model Runner V2][Spec Decode] Add KV cache support for multi-layer MTP#50062

WoosukKwon merged 3 commits into

vllm-project:mainvllm-project/vllm:mainfrom

TheEpicDolphin:mrv2-multi-module-mtp-kv-cache-supportTheEpicDolphin/vllm:mrv2-multi-module-mtp-kv-cache-supportCopy head branch name to clipboard