Skip to content

Update paths.json to include Gemma-Embedings-v0.8 Results #69

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
KennethEnevoldsen merged 20 commits into from
Dec 12, 2024
Merged

Update paths.json to include Gemma-Embedings-v0.8 Results #69

Changes from all commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
f2fe004
Add Gofer-Embeddings-v0.8 Retrieval Results
nicholasmonath Dec 2, 2024
f4e4fea
Set revision to be external
nicholasmonath Dec 2, 2024
2577635
Fix revision ID
nicholasmonath Dec 2, 2024
3df2119
Fix formatting
nicholasmonath Dec 2, 2024
cecfff9
Fix formatting
nicholasmonath Dec 2, 2024
eff7c50
Fix formatting
nicholasmonath Dec 3, 2024
b5a7196
Merge branch 'embeddings-benchmark:main' into main
nicholasmonath Dec 3, 2024
28c5baf
model naming
nicholasmonath Dec 9, 2024
1be252c
Update to improved model and results using mteb version 1.21.7
nicholasmonath Dec 9, 2024
0b5e079
Merge branch 'main' of github.com:nicholasmonath/results
nicholasmonath Dec 9, 2024
c4366a5
Merge branch 'embeddings-benchmark:main' into main
nicholasmonath Dec 9, 2024
48e738f
Merge branch 'main' of github.com:nicholasmonath/results
nicholasmonath Dec 9, 2024
618b029
Update results/google__Gemma-Embeddings-v0.8/d6813d20532a97ea8e30fc28…
nicholasmonath Dec 10, 2024
aca915a
Fix -1 evaluation time
nicholasmonath Dec 10, 2024
1ac505f
Merge branch 'main' of github.com:nicholasmonath/results
nicholasmonath Dec 10, 2024
be81705
Fix revision hash / model meta data
nicholasmonath Dec 10, 2024
8944407
Merge branch 'embeddings-benchmark:main' into main
nicholasmonath Dec 10, 2024
f1f47ad
Merge branch 'embeddings-benchmark:main' into main
nicholasmonath Dec 12, 2024
f14ed8e
Update paths to include new Gemma Embedding results. Fix malformed js…
nicholasmonath Dec 12, 2024
06c0120
Merge branch 'main' of github.com:nicholasmonath/results
nicholasmonath Dec 12, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
30 changes: 29 additions & 1 deletion paths.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15012,7 +15012,7 @@
],
"voyageai__voyage-multilingual-2": [
"results/voyageai__voyage-multilingual-2/1/BornholmBitextMining.json",
"results/voyageai__voyage-multilingual-2/1/STSB.json"
"results/voyageai__voyage-multilingual-2/1/STSB.json",
"results/voyageai__voyage-multilingual-2/no_revision_available/MassiveIntentClassification.json",
"results/voyageai__voyage-multilingual-2/no_revision_available/LEMBWikimQARetrieval.json",
"results/voyageai__voyage-multilingual-2/no_revision_available/MLSUMClusteringP2P.json",
Expand Down Expand Up @@ -15105,5 +15105,33 @@
"results/vprelovac__universal-sentence-encoder-multilingual-large-3/no_revision_available/PawsXPairClassification.json",
"results/vprelovac__universal-sentence-encoder-multilingual-large-3/no_revision_available/XPQARetrieval.json",
"results/vprelovac__universal-sentence-encoder-multilingual-large-3/no_revision_available/STSBenchmarkMultilingualSTS.json"
],
"google__Gemma-Embeddings-v0.8": [
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/NQ.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/CQADupstackGisRetrieval.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/CQADupstackTexRetrieval.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/SCIDOCS.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/NFCorpus.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/CQADupstackStatsRetrieval.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/ArguAna.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/DBPedia.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/CQADupstackGamingRetrieval.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/HotpotQA.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/CQADupstackProgrammersRetrieval.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/CQADupstackPhysicsRetrieval.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/CQADupstackWordpressRetrieval.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/ClimateFEVER.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/CQADupstackUnixRetrieval.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/QuoraRetrieval.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/CQADupstackAndroidRetrieval.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/FEVER.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/CQADupstackEnglishRetrieval.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/TRECCOVID.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/SciFact.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/FiQA2018.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/CQADupstackWebmastersRetrieval.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/Touche2020.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/MSMARCO.json",
"results/google__Gemma-Embeddings-v0.8/c9c76df8fa92c9f561bee6c61b4f9c13750a661c/CQADupstackMathematicaRetrieval.json"
]
}