[Bugfix] Transformers backend: tokenize multimodal prompts once - #50899

[Bugfix] Transformers backend: tokenize multimodal prompts once#50899

molbap wants to merge 4 commits into

vllm-project:mainvllm-project/vllm:mainfrom

molbap:fix_vlms_transformersmolbap/vllm:fix_vlms_transformersCopy head branch name to clipboard