Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add log error metrics #2634

Open
wants to merge 4 commits into
base: dev
Choose a base branch
from
Open

Conversation

chris-mcdo
Copy link

Issue #, if available: #2621

Description of changes: add log error metrics (MALE, MSLE, EMALE, ERMSLE) to the evaluation and ev packages. Resolves #2621.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Please tag this pr with at least one of these labels to make our release process faster: new feature

@jaheba
Copy link
Contributor

jaheba commented Feb 10, 2023

Thanks!

Let's add the geometric mean: #2640

@lostella
Copy link
Contributor

I think what's needed is the geometric mean of the predicted distribution

@lostella lostella added the new feature (one of pr required labels) label Feb 17, 2023
@chris-mcdo
Copy link
Author

I think both would be useful (geometric mean of the predicted distribution, and geometric mean as an error aggregator)?

E.g. if aggregating the EMALE (= exp(MALE)), you would want to use the geometric mean, since it's a ratio / multiplicative factor

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
new feature (one of pr required labels)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add log error metrics (MALE and MSLE)
4 participants