Skip to content

ggml: treat experts as cache residents during MoE offloading - #2

Closed
avifenesh wants to merge 1 commit into
masterfrom
codex/moe-resident-expert-cache
Closed

ggml: treat experts as cache residents during MoE offloading#2
avifenesh wants to merge 1 commit into
masterfrom
codex/moe-resident-expert-cache

ggml: cache resident MoE experts during offload

85926d5
Select commit
Loading
Failed to load commit list.

There are no checks for this commit