Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Comparison of arbitrary number of metrics #67

Open
timgent opened this issue Jul 9, 2020 · 0 comments
Open

Comparison of arbitrary number of metrics #67

timgent opened this issue Jul 9, 2020 · 0 comments
Labels
enhancement New feature or request Large

Comments

@timgent
Copy link
Owner

timgent commented Jul 9, 2020

Turns out DualDatasetMetricCheck is also helpful for comparing different metrics on a single dataset. So maybe the API/naming there could be improved.

The point of this ticket though is that it would also be helpful to compare an arbitrary number of metrics across one or many datasets.

This came up when looking at data where you can get the number of losses, wins, and the net. Each of those can be calculated in a metric, and 2 of them can be compared. However it isn't possible to compare all 3 of them. Could that be done? Possibly with composite metrics (i.e. Define a MetricDescriptor that is composed of other MetricDescriptors), possible with something else like taking a list of arguments rather than set number, or using type params to make things more flexible.

@timgent timgent added enhancement New feature or request Large labels Jul 9, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Large
Projects
None yet
Development

No branches or pull requests

1 participant