Skip to content

Conversation

@ahxgw
Copy link
Contributor

@ahxgw ahxgw commented Mar 26, 2025

Checklist

  • Run tests locally to make sure nothing is broken using make test.
  • Run the results files checker make pre-push.

Adding a model checklist

  • I have added model implementation to mteb/models/ directory. Instruction to add a model can be found here in the following PR ____

@KennethEnevoldsen
Copy link
Contributor

Seems like this model does not have an implementation/metadata in mteb. This is required for it to appear on the leaderboard.

@@ -0,0 +1 @@
{"name": "OpenSearch-AI/Ops-MoA-Conan-embedding-v1", "revision": "cd42de6d61c103047b7bcd780ef0dbaa9a9d0472", "release_date": "2025-03-26", "languages": ["zho_Hans"], "n_parameters": 343433472, "memory_usage_mb": null, "max_tokens": 512, "embed_dim": 1536, "license": null, "open_weights": true, "public_training_code": null, "public_training_data": null, "framework": ["Sentence Transformers", "PyTorch"], "reference": "https://huggingface.co/OpenSearch-AI/Ops-MoA-Conan-embedding-v1/", "similarity_fn_name": "cosine", "use_instructions": false, "training_datasets": null, "adapted_from": null, "superseded_by": null, "is_cross_encoder": null, "modalities": ["text"], "loader": null}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will have to be updated. Once the metadata is implemented in MTEB.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

embeddings-benchmark/mteb#2439
We have added implementation in mteb.

@Samoed Samoed merged commit d0503f8 into embeddings-benchmark:main Mar 30, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants