Fix HPU prompt_token_ids device placement for penalty sampling#1465

iboiko-habana merged 3 commits into

vllm-project:mainvllm-project/vllm-gaudi:mainfrom

yeonsily:dev/presence_penalty_fixyeonsily/vllm-gaudi:dev/presence_penalty_fixCopy head branch name to clipboard