Skip to content

[CUDA] Support SwiGlu in MoE and qMoE#25530

Merged
tianleiwu merged 6 commits into
mainfrom
tlwu/moe_swiglu
Jul 28, 2025
Merged

[CUDA] Support SwiGlu in MoE and qMoE#25530
tianleiwu merged 6 commits into
mainfrom
tlwu/moe_swiglu

add test for 4 bits

360f4d0
Select commit
Loading
Failed to load commit list.
Microsoft GitHub Policy Service / license/cla succeeded Jul 28, 2025 in 0s

All CLA requirements met.

This check verifies that the author has agreed to a CLA with Microsoft.