Skip to content

Qwen3 MoE Preliminary: add intermediate_size argument to MLP modules#2046

Merged
Borda merged 6 commits into
Lightning-AI:mainfrom
ysjprojects:preliminary-qwen3_moe
May 28, 2025
Merged

Qwen3 MoE Preliminary: add intermediate_size argument to MLP modules#2046
Borda merged 6 commits into
Lightning-AI:mainfrom
ysjprojects:preliminary-qwen3_moe

Merge branch 'main' into preliminary-qwen3_moe

23d821b
Select commit
Loading
Failed to load commit list.
This check has been archived and is scheduled for deletion. Learn more about checks retention
Azure Pipelines / litGPT (testing ordinary) succeeded May 28, 2025 in 4m 59s

testing ordinary succeeded

0 errors / 0 warnings

View more details on Azure Pipelines