Add diffusion LoRA request path and worker cache#657

dongbo910220 wants to merge 4 commits into

vllm-project:mainvllm-project/vllm-omni:mainfrom

dongbo910220:lora_supportdongbo910220/vllm-omni:lora_supportCopy head branch name to clipboard