perf: Avoid copying inputs_embeds tensors to GPU unless prompt_embeds is enabled#25739

vllm-bot merged 2 commits into

vllm-project:mainvllm-project/vllm:mainfrom

protopia-ai:only-copy-to-gpu-on-prompt-embedsprotopia-ai/vllm:only-copy-to-gpu-on-prompt-embedsCopy head branch name to clipboard