[Bugfix] Initialize per-token-head KV scale regions once per storage - #51061

[Bugfix] Initialize per-token-head KV scale regions once per storage#51061

haregali wants to merge 1 commit into

vllm-project:mainvllm-project/vllm:mainfrom

haregali:fix/int8-kv-scale-init-onceharegali/vllm:fix/int8-kv-scale-init-onceCopy head branch name to clipboard