[Bugfix][Step5] Size the KV block to the CSA tail ring - #65153

[Bugfix][Step5] Size the KV block to the CSA tail ring#65153

AndreasKaratzas merged 2 commits into

vllm-project:mainvllm-project/vllm:mainfrom

akii96:step5-fp8-tail-ring-block-sizeakii96/vllm:step5-fp8-tail-ring-block-sizeCopy head branch name to clipboard