Skip to content

Qwen3 MoE Preliminary: add intermediate_size argument to MLP modules#2046

Merged
Borda merged 6 commits intoLightning-AI:mainfrom
ysjprojects:preliminary-qwen3_moe
May 28, 2025
Merged

Qwen3 MoE Preliminary: add intermediate_size argument to MLP modules#2046
Borda merged 6 commits intoLightning-AI:mainfrom
ysjprojects:preliminary-qwen3_moe

Commits

Commits on May 17, 2025

Commits on May 22, 2025

Commits on May 23, 2025

Commits on May 27, 2025

Commits on May 28, 2025