Skip to content

Add ffn_gate_up_exps to --cpu-moe and --n-cpu-moe overrides#1422

Merged
ikawrakow merged 1 commit intomainfrom
ik/ot_ffn_gate_up
Mar 13, 2026
Merged

Add ffn_gate_up_exps to --cpu-moe and --n-cpu-moe overrides#1422
ikawrakow merged 1 commit intomainfrom
ik/ot_ffn_gate_up

Conversation

@ikawrakow
Copy link
Owner

Haha, lots of little details around the merged ffn_gate_up_exps tensors imposed on the world by llama.cpp maintainers.

This PR adds tensor overrides for these tensors when using --cpu-moe or --n-cpu-moe.

Thanks to @ubergarm for reminding me with this comment.

@ubergarm
Copy link
Contributor

oh lol i was just working on this PR after seeing it break on mainline yesterday: ggml-org/llama.cpp#20416

so we're ffn_gate_up_exps everywhere now, so it is

thanks and happy weekend!

@ikawrakow ikawrakow merged commit 07ab0d2 into main Mar 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants