Skip to content

Add unfused clap models for zero-shot audio classification (closed wrong source branch)#2265

Closed
RahulSChand wants to merge 113 commits intoembeddings-benchmark:maebfrom
anime-sh:zero_shot
Closed

Add unfused clap models for zero-shot audio classification (closed wrong source branch)#2265
RahulSChand wants to merge 113 commits intoembeddings-benchmark:maebfrom
anime-sh:zero_shot

Conversation

@RahulSChand
Copy link

Adding unfused clap models, extension to this PR #2133

Code Quality

  • Code Formatted: Format the code using make lint to maintain consistent style.

Documentation

  • Updated Documentation: Add or update documentation to reflect the changes introduced in this PR.

Testing

  • New Tests Added: Write tests to cover new functionality. Validate with make test-with-coverage.
  • Tests Passed: Run tests locally using make test or make test-with-coverage to ensure no existing functionality is broken.

Adding datasets checklist

Reason for dataset addition: ...

  • I have run the following models on the task (adding the results to the pr). These can be run using the mteb -m {model_name} -t {task_name} command.
    • sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2
    • intfloat/multilingual-e5-small
  • I have checked that the performance is neither trivial (both models gain close to perfect scores) nor random (both models gain close to random scores).
  • If the dataset is too big (e.g. >2048 examples), considering using self.stratified_subsampling() under dataset_transform()
  • I have filled out the metadata object in the dataset file (find documentation on it here).
  • Run tests locally to make sure nothing is broken using make test.
  • Run the formatter to format the code using make lint.

Adding a model checklist

  • I have filled out the ModelMeta object to the extent possible
  • I have ensured that my model can be loaded using
    • mteb.get_model(model_name, revision) and
    • mteb.get_model_meta(model_name, revision)
  • I have tested the implementation works on a representative set of tasks.

@RahulSChand RahulSChand changed the title Zero shot Add unfused clap models for zero-shot audio classification Mar 6, 2025
@RahulSChand RahulSChand closed this Mar 6, 2025
@RahulSChand RahulSChand changed the title Add unfused clap models for zero-shot audio classification Add unfused clap models for zero-shot audio classification (closed wrong source branch) Mar 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants