是否有计划支持 lora？

[Haskely]

Same as vllm-project/vllm#182 (comment)

[hiworldwzj]

@shihaobai How do you think about this?

[shihaobai]

@Haskely Adaptations to lora are easier to add if we can follow a more uniform parameter naming convention. We'll add a corresponding adaptation later

[Ying1123]

@hiworldwzj @Haskely @shihaobai
We have developed a high-performance, multi-LoRA serving system utilizing LightLLM (https://github.com/S-LoRA/S-LoRA). We appreciate LightLLM for its lightweight design. If you're interested, we can arrange a time to chat.