[Attn,KV-cache] Use per-head scales in the attention selector#34281

LucasWilkinson merged 5 commits intovllm-project:mainvllm-project/vllm:mainfrom

eldarkurtic:use-perhead-scales-in-attn-selectoreldarkurtic/vllm:use-perhead-scales-in-attn-selectorCopy head branch name to clipboard