Skip to content

cuda: MoE expert cache, adaptive VRAM caching of CPU-resident experts - #24524

Closed
leloch wants to merge 3 commits into
ggml-org:masterfrom
leloch:moe-cache-pr
Closed

cuda: MoE expert cache, adaptive VRAM caching of CPU-resident experts #24524
leloch wants to merge 3 commits into
ggml-org:masterfrom
leloch:moe-cache-pr

common: MoE-cache-aware fit placement and --moe-cache flag

8853f05
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
labeler
succeeded Jun 12, 2026 in 12s