Fix decode bucket generation for hybrid models with mismatched block sizes#1485

iboiko-habana merged 1 commit into

vllm-project:mainvllm-project/vllm-gaudi:mainfrom

yangulei:fix/decode-bucket-attn-block-sizeyangulei/vllm-gaudi:fix/decode-bucket-attn-block-sizeCopy head branch name to clipboard