CUDA: extend MOE fusion to specdec, earlier MOE glu fusion and topk-router fusion were restricted to 1 token - #27621

CUDA: extend MOE fusion to specdec, earlier MOE glu fusion and topk-router fusion were restricted to 1 token#27621

am17an merged 3 commits into

ggml-org:masterggml-org/llama.cpp:masterfrom

ynankani:ynankani/specdec_moe_fuseynankani/llama.cpp:ynankani/specdec_moe_fuseCopy head branch name to clipboard