[Do not merge] Hacks for the ROCm port#1314

pcmoritz wants to merge 17 commits into

vllm-project:mainvllm-project/vllm:mainfrom

pcmoritz:port-to-rocm-hackspcmoritz/vllm-public:port-to-rocm-hacksCopy head branch name to clipboard