[BugFix][AMD][Quantization] Fix torch.compile issue where wvSplitKQ not being called when it should when using quantized FP8 model#22281

mgoin merged 9 commits intovllm-project:mainvllm-project/vllm:mainfrom

rasmith:ransmith_fix_rocm_per_tensor_w8a8_scaled_mmrasmith/vllm:ransmith_fix_rocm_per_tensor_w8a8_scaled_mmCopy head branch name to clipboard