Skip to content

[mieb] merge from main once more#1942

Merged
isaac-chung merged 637 commits intomiebfrom
mieb-merge-main
Feb 3, 2025
Merged

[mieb] merge from main once more#1942
isaac-chung merged 637 commits intomiebfrom
mieb-merge-main

Conversation

@isaac-chung
Copy link
Collaborator

@isaac-chung isaac-chung commented Feb 3, 2025

One more update before merging into main (next PR)

Key points:

  • Removal of instructions.py and moving each instruction to the respective task
  • Resolve merge conflicts

Code Quality

  • Code Formatted: Format the code using make lint to maintain consistent style.

Documentation

  • Updated Documentation: Add or update documentation to reflect the changes introduced in this PR.

Testing

  • New Tests Added: Write tests to cover new functionality. Validate with make test-with-coverage.
  • Tests Passed: Run tests locally using make test or make test-with-coverage to ensure no existing functionality is broken.

cc @gowitheflow-1998 @KennethEnevoldsen

github-actions bot and others added 25 commits February 1, 2025 14:38
Tests currently go into an infinite loop. This should prevent that.
Automatically generated by python-semantic-release
fix: Updated citation for mteb(scandinavian)
* add three out of four datasets in CodeRAG-Bench
* add verified CodeRAGStackoverflowPostsRetrieval dataset
* clean up code and make some comments
* fixed lint errors
* addressed comments about code-rag datasets: fixed grammar and remove unnessary code and loop
* roll back files which is not supposed to change
* fixed the comments in split_by_first_newline() and make the methods private by adding a underscore prefix
* refactor to use common args
* update task descriptions
* add entry in benchmarks
* correct the alphanumeric order for the dataset
* add  in tasks.md
* add  in tasks.md
* update task metadata
* update importing path
* fix lint errors
* correct CodeRAG task metadata description field and id for stackoverflow-posts
* fix error in test
---------
Co-authored-by: Isaac Chung <chungisaac1217@gmail.com>
Automatically generated by python-semantic-release
@isaac-chung isaac-chung requested a review from Samoed February 3, 2025 11:50
@Samoed
Copy link
Member

Samoed commented Feb 3, 2025

Seems that MIEB branch is more compatible with main than v2😅

@isaac-chung isaac-chung merged commit 788f8c4 into mieb Feb 3, 2025
11 checks passed
@isaac-chung isaac-chung deleted the mieb-merge-main branch February 3, 2025 12:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants

Comments