New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Inter-agreement score #4

Open

SaschaHeyer opened this issue Oct 20, 2020 · 0 comments

Labels

Metric

Member

SaschaHeyer commented Oct 20, 2020

Add inter-agreement score to our review interface

Requires a new annotation approach (rather than splitting the workload, the workload has to be mirrored to multiple annotators)
This option should be configurable for each dataset (for customers who don't want to use inter-agreement score and rather want to use split work)

SaschaHeyer added the Metric label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment