[LoRA] Support dynamically initialize packed_modules_mapping for VLM with arbitrary components#18987
Conversation
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
|
👋 Hi! Thank you for contributing to the vLLM project. 💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels. Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging. To run CI, PR reviewers can either: Add 🚀 |
…M with arbitrary components (vllm-project#18987) Signed-off-by: isotr0py <2037008807@qq.com> Signed-off-by: Isotr0py <2037008807@qq.com> Signed-off-by: amit <amit.man@gmail.com>
…M with arbitrary components (vllm-project#18987) Signed-off-by: isotr0py <2037008807@qq.com> Signed-off-by: Isotr0py <2037008807@qq.com> Signed-off-by: amit <amit.man@gmail.com>
packed_modules_mappingfor LoRA and BNB support.packed_modules_mappingfrom VLM's components dynamically, so we don't need to copy allpacked_modules_mappingfrom each component variant.