offload prompt_embeds decode in render_prompts_async to avoid blocking#43792

DarkLight1337 merged 3 commits into

vllm-project:mainvllm-project/vllm:mainfrom

gagandhakrey:perf/render-prompts-async-offloadgagandhakrey/vllm:perf/render-prompts-async-offloadCopy head branch name to clipboard