Bias metric(s)

[baskrahmer]

In the README (section), the bias metric from HELM is listed, but I could not find this one in the codebase. I assume it is not implemented, and was wondering if there are plans to add this? Or maybe I am just not looking in the right place 🙈

Anyway, thanks for open-sourcing this, its cool

[clefourrier]

Hi!
Good catch! We used to have it, but I removed it before the release, as we tried to have a smooth and homogeneous code base metrics wise, and it was actually quite messy.
To be more specific, we want to have one general standard version of any given metric, and use customizable standards (= one exact match, one quasi exact match, but you can change normalisation if needed) - this one was not standard and not generalizable.

I could go in the history of the internal version and give you the files plus some tips on how to use them if you'd like however :)

[baskrahmer]

Hi @clefourrier ! thanks for your reply
I see, that makes sense. I brought it up out of curiousity cause the bias topic is interesting to me at the moment, but I can move forward with the HELM version for now. Thanks for the offer though, I might come back on it in the future.

Closing the issue as my question is answered :) if you have time it might be nice to remove the metric from the README though

[clefourrier]

Will do, thanks!