Skip to content

CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3 - #24546

Open
ravel7524 wants to merge 5 commits into
ggml-org:masterfrom
ravel7524:mmqx-rdna3-routed-moe-tiling
Open

CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3#24546
ravel7524 wants to merge 5 commits into
ggml-org:masterfrom
ravel7524:mmqx-rdna3-routed-moe-tiling

refactor: replace moe_ncols_min_cc with use_typical_moe_ncols in mmq …

2adc35b
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs