[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement#38139

noooop merged 5 commits intomainvllm-project/vllm:mainfrom

wentao-remove-redundant-prompt-copyvllm-project/vllm:wentao-remove-redundant-prompt-copyCopy head branch name to clipboard