[Bugfix] Fix KV cache sizing and allocation for hybrid Mamba/attention models#37429

swtb3 wants to merge 4 commits intovllm-project:mainvllm-project/vllm:mainfrom

swtb3:fix/hybrid-mamba-compact-allocationswtb3/vllm:fix/hybrid-mamba-compact-allocationCopy head branch name to clipboard