[Misc] support model prefix & add deepseek vl2 tiny fused moe config#17763
[Misc] support model prefix & add deepseek vl2 tiny fused moe config#17763ywang96 merged 2 commits intovllm-project:mainfrom
Conversation
Signed-off-by: 唯勤 <xsank.mz@alibaba-inc.com>
|
👋 Hi! Thank you for contributing to the vLLM project. 💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels. Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging. To run CI, PR reviewers can either: Add 🚀 |
Signed-off-by: 唯勤 <xsank.mz@alibaba-inc.com>
ywang96
left a comment
ywang96
left a comment
There was a problem hiding this comment.
LGTM - thanks for the contribution!
|
MoE test failed, PTAL |
strange... let me see see... |
|
@DarkLight1337 @ywang96 it seems my changes have nothing to do with the test error. |
|
Let's wait for next nightly to see whether this test is failing on main as well. |
|
Ok it looks like the test is flaky on main, let me retry it. |
…llm-project#17763) Signed-off-by: 唯勤 <xsank.mz@alibaba-inc.com> Co-authored-by: 唯勤 <xsank.mz@alibaba-inc.com> Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
…llm-project#17763) Signed-off-by: 唯勤 <xsank.mz@alibaba-inc.com> Co-authored-by: 唯勤 <xsank.mz@alibaba-inc.com> Signed-off-by: Mu Huai <tianbowen.tbw@antgroup.com>
…llm-project#17763) Signed-off-by: 唯勤 <xsank.mz@alibaba-inc.com> Co-authored-by: 唯勤 <xsank.mz@alibaba-inc.com>
…llm-project#17763) Signed-off-by: 唯勤 <xsank.mz@alibaba-inc.com> Co-authored-by: 唯勤 <xsank.mz@alibaba-inc.com> Signed-off-by: Yuqi Zhang <yuqizhang@google.com>
3 participants
support model prefix for some models like:https://huggingface.co/deepseek-ai/deepseek-vl2/blob/main/config.json