New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

For multimodal models like Qwen-VL or Qwen-Audio, how to finetune projector with full parameters and finetune language models with LoRA simultaneously? #2471

Open

jymh opened this issue Nov 18, 2024 · 0 comments

jymh commented Nov 18, 2024 •

edited

Loading

目前框架支持的是full lora 二选一

如何实现同时全参微调projector并lora微调language model的需求？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment