Skip to content

Check if ffn_up and ffn_gate are of the same type before using fmoe#3

Merged
Thireus merged 1 commit intoThireus:mainfrom
ikawrakow:ik/check_up_gate_fmoe
Jun 6, 2025
Merged

Check if ffn_up and ffn_gate are of the same type before using fmoe#3
Thireus merged 1 commit intoThireus:mainfrom
ikawrakow:ik/check_up_gate_fmoe

Commits

Commits on Jun 6, 2025