Latest benchmark runs. Updated automatically by ./scripts/bench.sh.
See docs/benchmarks/benchmark_log.csv for full history.
| Date | Model | Overall% | 1-Hop | Temporal | Multi-Hop | Open | Adv | EvRec% | Avg Emb (ms) |
|---|---|---|---|---|---|---|---|---|---|
| 2026-03-18 | onnx-bge-small | 70.6 | |||||||
| 2026-03-19 | onnx-bge-small | 83.9 | 76.0 | 82.3 | 45.6 | 90.3 | 86.4 | 85.0 | 47.7 |
| 2026-03-19 | onnx-bge-small | 86.87 | 81.7 | 82.9 | 51.6 | 92.9 | 89.2 | 85.4 | 45.1 |
| 2026-03-19 | onnx-bge-small | 90.52 | 88.0 | 85.2 | 56.4 | 96.0 | 92.9 | 92.2 | 44.1 |
| 2026-03-19 | bge-small-en-v1.5 | 91.1 | 87.6 | 91.5 | 75.6 | 94.0 | 90.9 | 90.2 | 7.5 |
| 2026-03-19 | voyage-4-nano-int8-1024 | 91.8 | 93.5 | 91.5 | 75.6 | 93.3 | 91.6 | 91.3 | 172 |
| 2026-03-19 | voyage-4-nano-int8-512 | 91.3 | 88.8 | 91.5 | 75.6 | 93.7 | 91.6 | 91.6 | 58 |
| 2026-03-19 | voyage-4-nano-fp32-1024 | 91.8 | 93.5 | 91.5 | 75.6 | 93.3 | 91.6 | 91.3 | 82 |
| 2026-03-19 | granite-embedding-30m-english | 90.5 | 88.9 | 91.5 | 76.9 | 91.7 | 91.1 | 87.5 | 3.8 |
| 2026-03-19 | all-MiniLM-L6-v2 | 91.2 | 88.1 | 91.5 | 76.9 | 92.9 | 92.7 | 90.2 | 39.3 |
| 2026-03-19 | all-MiniLM-L12-v2 | 90.9 | 86.8 | 91.5 | 75.6 | 92.6 | 93.1 | 90.4 | 26.6 |
| 2026-03-19 | e5-small-v2 | 91.3 | 90.7 | 91.5 | 76.9 | 92.9 | 91.5 | 89.1 | 40.5 |
| 2026-03-19 | bge-base-en-v1.5 | 92.2 | 89.4 | 91.5 | 76.9 | 94.8 | 93.1 | 91.6 | 42.1 |
| 2026-03-19 | nomic-embed-text-v1.5-int8 | 90.0 | 88.4 | 91.5 | 74.4 | 90.8 | 91.0 | 86.6 | 41.7 |
| 2026-03-19 | voyage-4-lite-api | 91.1 | 91.1 | 91.5 | 73.1 | 93.4 | 90.2 | 91.0 | 304 |
| 2026-03-19 | voyage-4-api | 92.0 | 92.3 | 91.5 | 75.6 | 94.8 | 90.6 | 92.7 | 297 |
| 2026-03-19 | text-embedding-3-large-openai | 93.0 | 94.6 | 91.5 | 74.4 | 95.3 | 93.1 | 93.4 | 444 |
| 2026-03-19 | snowflake-arctic-embed-xs | 90.78 | 88.1 | 91.5 | 76.9 | 93.5 | 90.2 | 88.72 | 30.4 |
| 2026-03-19 | snowflake-arctic-embed-s | 90.54 | 89.5 | 91.5 | 73.1 | 93.0 | 89.5 | 87.57 | 35.8 |
| 2026-03-19 | gte-small | 90.92 | 89.1 | 91.5 | 73.1 | 93.7 | 90.2 | 90.81 | 65.3 |
| 2026-03-19 | all-MiniLM-L6-v2-int8 | 91.3 | 88.5 | 91.5 | 76.9 | 93.1 | 92.3 | 89.2 | 7.4 |
| 2026-03-19 | all-MiniLM-L12-v2-int8 | 91.1 | 86.8 | 91.5 | 75.6 | 94.3 | 90.9 | 90.4 | 12.3 |
| 2026-03-19 | e5-small-v2-int8 | 90.8 | 88.4 | 91.5 | 73.1 | 93.0 | 91.1 | 88.6 | 4.8 |
| 2026-03-19 | bge-base-en-v1.5-int8 | 91.8 | 87.1 | 91.5 | 76.9 | 94.9 | 92.7 | 90.4 | 10.5 |
| 2026-03-19 | snowflake-arctic-embed-xs-int8 | 90.2 | 87.0 | 91.5 | 76.9 | 92.7 | 89.5 | 88.7 | 3.9 |
| 2026-03-19 | gte-small-int8 | 90.9 | 86.2 | 91.5 | 73.1 | 94.0 | 91.7 | 89.5 | 11.7 |
| 2026-03-19 | snowflake-arctic-embed-s-int8 | 90.8 | 89.5 | 91.5 | 73.1 | 93.0 | 90.8 | 87.8 | 7.8 |
| 2026-03-19 | bge-small-en-v1.5-xenova-int8 | 91.1 | 87.6 | 91.5 | 75.6 | 94.0 | 90.9 | 90.2 | 7.0 |
| 2026-03-23 | onnx-bge-small | 90.1 | 86.9 | 85.0 | 56.2 | 95.7 | 92.6 | 92.0 | 5.1 |
| 2026-03-23 | all-MiniLM-L6-v2-int8 | 90.0 | 86.8 | 84.8 | 57.2 | 95.3 | 92.8 | 90.8 | 8.9 |
| 2026-04-01 | onnx-bge-small | 91.5 | 87.1 | 91.5 | 75.6 | 94.3 | 92.7 | 90.9 | 4.9 |
| 2026-04-15 | onnx-bge-small | 90.1 | 86.9 | 85.0 | 56.2 | 95.7 | 92.6 | 92.0 | 7.3 |
| 2026-05-13 | onnx-bge-small | 91.5 | 87.1 | 91.5 | 75.6 | 94.3 | 92.7 | 90.7 | 6.4 |
| 2026-05-13 | onnx-bge-small | 91.5 | 87.1 | 91.5 | 75.6 | 94.3 | 92.7 | 90.7 | 6.0 |
| 2026-05-13 | onnx-bge-small | 91.5 | 87.1 | 91.5 | 75.6 | 94.3 | 92.7 | 90.7 | 6.2 |
| 2026-05-16 | onnx-bge-small | 91.5 | 87.1 | 91.5 | 75.6 | 94.3 | 92.7 | 90.7 | 6.5 |
| 2026-06-04 | onnx-bge-small | 91.5 | 87.1 | 91.5 | 75.6 | 94.3 | 92.7 | 91.0 | 7.0 |
| 2026-06-04 | onnx-bge-small | 91.5 | 87.1 | 91.5 | 75.6 | 94.3 | 92.7 | 91.0 | 7.3 |
| 2026-06-04 | onnx-bge-small | 91.5 | 87.1 | 91.5 | 75.6 | 94.3 | 92.7 | 91.0 | 11.0 |
| 2026-06-04 | onnx-bge-small | 91.5 | 87.1 | 91.5 | 75.6 | 94.3 | 92.7 | 91.0 | 10.8 |