[Model] Enable LoRA support for tower and connector in H2OVL#31696

jeejeelee merged 2 commits intovllm-project:mainvllm-project/vllm:mainfrom

shwetha-s-poojary:h2ovl-lora-mm-supportshwetha-s-poojary/vllm:h2ovl-lora-mm-supportCopy head branch name to clipboard