Skip to content

Comments

Add IBM Granite Embedding Model results#74

Merged
Samoed merged 2 commits intoembeddings-benchmark:mainfrom
aashka-trivedi:main
Dec 19, 2024
Merged

Add IBM Granite Embedding Model results#74
Samoed merged 2 commits intoembeddings-benchmark:mainfrom
aashka-trivedi:main

Conversation

@aashka-trivedi
Copy link
Contributor

Checklist

  • Run tests locally to make sure nothing is broken using make test.
  • Run the results files checker make pre-push.

Adding a model checklist

Ref # PR 1613

  • I have added model implementation to mteb/models/ directory. Instruction to add a model can be found here

@Samoed Samoed merged commit 71d8e5f into embeddings-benchmark:main Dec 19, 2024
@aashka-trivedi
Copy link
Contributor Author

HI @Samoed -- since this PR has been merged, I do not see the model results on the Leaderboard- Is there something Ive missed? Thanks!

@Samoed
Copy link
Member

Samoed commented Dec 27, 2024

We're currently developing a new version of the leaderboard that pulls results from the results repository, but it's still under development and requires a restart: Leaderboard 2.0 Demo.

To appear on the 'old' leaderboard, the simplest way is to add your model's results to its model card using mteb create_meta.

@aashka-trivedi
Copy link
Contributor Author

Thanks, done-- is there any action needed after modifying the model card metadata?

@Samoed
Copy link
Member

Samoed commented Jan 2, 2025

No, results will appear soon

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants