Skip to content

Comments

add jasper results#68

Merged
Samoed merged 2 commits intoembeddings-benchmark:mainfrom
DunZhang:main
Dec 23, 2024
Merged

add jasper results#68
Samoed merged 2 commits intoembeddings-benchmark:mainfrom
DunZhang:main

Conversation

@DunZhang
Copy link
Contributor

@DunZhang DunZhang commented Dec 11, 2024

Checklist

  • Run tests locally to make sure nothing is broken using make test.
  • Run the results files checker make pre-push.

Adding a model checklist

Ref embeddings-benchmark/mteb#1591

  • I have added model implementation to mteb/models/ directory. Instruction to add a model can be found here

@DunZhang
Copy link
Contributor Author

Hi
The model infgrad/jasper_en_vision_language_v1 is a vision language model, it can encode both text and image.

To reproduce, see https://huggingface.co/infgrad/jasper_en_vision_language_v1/tree/main/scripts/evaluate_en_mteb.

@Samoed
Copy link
Member

Samoed commented Dec 11, 2024

I'll try to add your implementation to mteb repo

@Samoed Samoed enabled auto-merge (squash) December 23, 2024 06:59
@Samoed Samoed merged commit a7ba743 into embeddings-benchmark:main Dec 23, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants