Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Accuracy Issue - accuracy is 0.00 #1090

Open
Pitambartech opened this issue Oct 17, 2024 · 0 comments
Open

Accuracy Issue - accuracy is 0.00 #1090

Pitambartech opened this issue Oct 17, 2024 · 0 comments

Comments

@Pitambartech
Copy link

When I evaluate the score based on the MMLU dataset, the overall accuracy is 0.00, and the predicted answers do not match the actual answers. How can I modify the prompt to generate responses that include the index of the choices?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Pitambartech