Bump lm-eval version for Transformers v5 compatibility#33994
Bump lm-eval version for Transformers v5 compatibility#33994vllm-bot merged 3 commits intovllm-project:mainfrom
lm-eval version for Transformers v5 compatibility#33994Conversation
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
github-actions
bot
added
the
ready
|
Documentation preview: https://vllm--33994.org.readthedocs.build/en/33994/ |
mergify
bot
added
documentation
![gemini-code-assist[bot]](https://avatars.githubusercontent.com/in/956858?s=60&v=4){kind=small}
There was a problem hiding this comment.
Code Review
This pull request successfully updates the lm-eval package version to 0.4.10 across various build scripts, documentation, and dependency files. This change aligns with the stated goal of ensuring compatibility with Transformers v5. The modifications in requirements/test.txt reflect the updated dependency tree for lm-eval and are expected. Overall, the changes are straightforward and appear to achieve the intended purpose without introducing any high or critical issues.
|
Hmm, I'll look into it |
|
This pull request has merge conflicts that must be resolved before it can be |
|
Looks like a bug in |
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
…t#33994) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
…t#33994) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> Signed-off-by: Eldar Kurtic <research@neuralmagic.com>
…t#33994) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
…t#33994) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
…t#33994) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
3 participants
Update lm-eval pin to
0.4.10so that EleutherAI/lm-evaluation-harness@384118d is included (the previous version imported a class that no longer exists in Transformers v5)