Add generic multi-pool KV cache allocation#41495

lesj0610 wants to merge 1 commit into

vllm-project:mainvllm-project/vllm:mainfrom

lesj0610:lesj/gdn-kv-mamba-attn-kv-fix-prlesj0610/vllm:lesj/gdn-kv-mamba-attn-kv-fix-prCopy head branch name to clipboard