UPSTREAM PR #18096: ggml-cpu: ARM64: repack version of q8_0 (dotprod and i8mm) - #589
Open
loci-dev wants to merge 8 commits into
Open
UPSTREAM PR #18096: ggml-cpu: ARM64: repack version of q8_0 (dotprod and i8mm)#589loci-dev wants to merge 8 commits into
loci-dev wants to merge 8 commits into
LOCI Review / Performance Review #589
succeeded
Dec 16, 2025 in 39m 49s
Stable performance (within threshold)
0 binaries improved · 15 binaries unchanged · 1 binary stable ~ within threshold · 0 binaries degraded ~ beyond threshold
| Binary | Δ % Response | Δ % Throughput | Performance (based on response time) |
|---|---|---|---|
build.bin.libggml-base.so |
0 | 0 | unchanged |
build.bin.libggml-cpu.so |
4.02 | 3.09 | stable |
build.bin.libggml.so |
0 | 0 | unchanged |
build.bin.libllama.so |
0 | 0 | unchanged |
build.bin.libmtmd.so |
0 | 0 | unchanged |
build.bin.llama-bench |
0 | 0 | unchanged |
build.bin.llama-cvector-generator |
0 | 0 | unchanged |
build.bin.llama-gemma3-cli |
0 | 0 | unchanged |
build.bin.llama-gguf-split |
0 | 0 | unchanged |
build.bin.llama-llava-cli |
0 | 0 | unchanged |
build.bin.llama-minicpmv-cli |
0 | 0 | unchanged |
build.bin.llama-quantize |
0 | 0 | unchanged |
build.bin.llama-qwen2vl-cli |
0 | 0 | unchanged |
build.bin.llama-run |
0 | 0 | unchanged |
build.bin.llama-tokenize |
0 | 0 | unchanged |
build.bin.llama-tts |
0 | 0 | unchanged |
Performance threshold: 30%
Default configuration used.
Note: Performance status is evaluated only from Δ% Response. Throughput is displayed for reference.
Explore the complete analysis inside the Version Insights.
Loading