Skip to content

Conversation

@abdurrahmanbutler
Copy link
Contributor

Hi,
I’m submitting this pull request to push the results of intfloat/multilingual-e5-small and sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 on BillSumUS and BillSumCA (the federal and Californian splits of BillSum respectively).

This PR is connected to embeddings-benchmark/mteb#2943 which adds the BillSum test splits to MTEB.

This pull request is being submitted courtesy of Isaacus, a legal AI research company.

Checklist

  • My model has a model sheet, report or similar
  • My model has a reference implementation in mteb/models/ this can be as an API. Instruction on how to add a model can be found here
    • No, but there is an existing PR ___
  • The results submitted is obtained using the reference implementation
  • My model is available, either as a publicly accessible API or publicly on e.g., Huggingface
  • I solemnly swear that for all results submitted I have not trained on the evaluation dataset including training splits. If I have I have disclosed it clearly.

Copy link

@umarbutler umarbutler left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can confirm that I have reviewed and approve this PR on behalf of Isaacus.

@KennethEnevoldsen KennethEnevoldsen added the waiting for review of implementation This PR is waiting for an implementation review before merging the results. label Jul 24, 2025
@github-actions
Copy link

github-actions bot commented Sep 3, 2025

This pull request has been automatically marked as stale due to inactivity.

@github-actions github-actions bot added the stale label Sep 3, 2025
@KennethEnevoldsen
Copy link
Contributor

@abdurrahmanbutler does these results still reflect the final version of the task - if so then I think we are good to merge

@github-actions github-actions bot removed the stale label Sep 4, 2025
@github-actions
Copy link

This pull request has been automatically marked as stale due to inactivity.

@github-actions github-actions bot added the stale label Sep 18, 2025
@KennethEnevoldsen KennethEnevoldsen merged commit 190dbb8 into embeddings-benchmark:main Sep 18, 2025
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

stale waiting for review of implementation This PR is waiting for an implementation review before merging the results.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants