Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Removed the accuracy_multilabel in favour of accuracy_thresh #24

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

bharatr21
Copy link
Contributor

Fix #23 by removing the redundant accuracy_multilabel function (since accuracy_thresh already has the same functionality)

@lingdoc
Copy link
Contributor

lingdoc commented Jun 19, 2020

when I train a multi-label classifier, accuracy_thresh outputs a different value than accuracy_multilabel. For example, the logged metrics return something like:

eval_accuracy_thresh after epoch 1: 0.876443088054657 
eval_accuracy_multilabel after epoch 1: 0.6985998526160648

Maybe you want to check again how they're factored? I do think they're measuring different things.

@Pawel-Kranzberg
Copy link
Contributor

@Bharat123rox , @lingdoc - accuracy_thresh is well suited to handle multilabel classification. However, accuracy_multilabel offers alternative, perhaps better handling of multiclass classification, which is independent of a threshold. The problem is that accuracy_multilabel name is misleading, it should rather be accuracy_multiclass.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Accuracy_multilabel function probably incorrect
3 participants