UPSTREAM PR #18919: metal : support virtual devices#1103
UPSTREAM PR #18919: metal : support virtual devices#1103
Conversation
|
No meaningful performance changes were detected across 115327 analyzed functions in the following binaries: build.bin.libllama.so, build.bin.llama-cvector-generator, build.bin.llama-tts, build.bin.libmtmd.so, build.bin.llama-bench, build.bin.libggml-base.so, build.bin.libggml-cpu.so, build.bin.libggml.so, build.bin.llama-tokenize, build.bin.llama-qwen2vl-cli, build.bin.llama-quantize, build.bin.llama-gguf-split, build.bin.llama-llava-cli, build.bin.llama-minicpmv-cli, build.bin.llama-gemma3-cli. 🔎 Full breakdown: Loci Inspector. |
124d3f7 to
bc286c3
Compare
|
No meaningful performance changes were detected across 115327 analyzed functions in the following binaries: build.bin.libllama.so, build.bin.llama-cvector-generator, build.bin.libmtmd.so, build.bin.llama-tts, build.bin.libggml-cpu.so, build.bin.libggml.so, build.bin.libggml-base.so, build.bin.llama-tokenize, build.bin.llama-quantize, build.bin.llama-qwen2vl-cli, build.bin.llama-bench, build.bin.llama-gemma3-cli, build.bin.llama-gguf-split, build.bin.llama-llava-cli, build.bin.llama-minicpmv-cli. 🔎 Full breakdown: Loci Inspector. |
62123f6 to
8e59b18
Compare
cd152fa to
ab12294
Compare
Note
Source pull request: ggml-org/llama.cpp#18919
Support virtual Metal devices. Allows simulating multi-GPU environments on Mac using the new
GGML_METAL_DEVICESenvironment variable.