[ROCm][Misc] Follow-ups for Skinny Gemms on ROCm.#17011

vllm-bot merged 9 commits intovllm-project:mainvllm-project/vllm:mainfrom

ROCm:charlifu/use_skinny_gemm_for_vocabROCm/vllm:charlifu/use_skinny_gemm_for_vocabCopy head branch name to clipboard