[Bugfix][ROCm][P/D][MoRIIO] Read-mode KV-release + best_of_n fixes#43541

crazyguitar wants to merge 11 commits into

vllm-project:mainvllm-project/vllm:mainfrom

crazyguitar:rocm-xgmi-best-of-n-fixcrazyguitar/vllm:rocm-xgmi-best-of-n-fixCopy head branch name to clipboard