[Bugfix] Fix layer-wise offload incompatibility with HSDP#2021

wtomin merged 5 commits into

vllm-project:mainvllm-project/vllm-omni:mainfrom

RuixiangMa:fixlayeroffloadhsdpRuixiangMa/vllm-omni:fixlayeroffloadhsdpCopy head branch name to clipboard