Check if ffn_up and ffn_gate are of the same type before using fmoe #3

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

Thireus merged 1 commit into Thireus:main from ikawrakow:ik/check_up_gate_fmoe

Jun 6, 2025

Owner

Thireus commented Jun 6, 2025

I have read the contributing guidelines
Self-reported review complexity:
- Low
- Medium
- High


          Check if ffn_up and ffn_gate are of the same type before using fmoe

fa54b58

Thireus merged commit 23c3e73 into Thireus:main

1 check passed

Thireus mentioned this pull request

Revert "Check if ffn_up and ffn_gate are of the same type before using fmoe" #4

Merged

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet