Skip to content

Commit

Permalink
Simplify options for HNSW indexes (castorini#2531)
Browse files Browse the repository at this point in the history
Removed -memoryBuffer 65536 -noMerge options for HNSW regressions: revert to "default settings".
  • Loading branch information
lintool authored and Panizghi committed Jul 9, 2024
1 parent 16675e1 commit 95383a1
Show file tree
Hide file tree
Showing 116 changed files with 116 additions and 116 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-arguana.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-arguana.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-arguana.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-arguana.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-arguana.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-arguana.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-bioasq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-bioasq.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 500 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-bioasq.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-bioasq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-bioasq.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 500 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-bioasq.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-climate-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-climate-fever.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-climate-fever.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-climate-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-climate-fever.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-climate-fever.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-fever.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-fever.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-fever.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-fever.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-fiqa.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-fiqa.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-fiqa.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-fiqa.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-fiqa.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-fiqa.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-hotpotqa.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-hotpotqa.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-hotpotqa.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-hotpotqa.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-hotpotqa.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-hotpotqa.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-nfcorpus.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-nfcorpus.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-nfcorpus.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-nfcorpus.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-nfcorpus.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-nfcorpus.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-nq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-nq.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-nq.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-nq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-nq.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-nq.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-quora.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-quora.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-threads 16 -M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-quora.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-quora.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-quora.bge-base-en-v1.5/ \
-threads 16 -M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-threads 16 -M 16 -efC 100 \
>& logs/log.beir-v1.0.0-quora.bge-base-en-v1.5 &
```

Expand Down
Loading

0 comments on commit 95383a1

Please sign in to comment.