Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ChrF++ #634

Closed
stancld opened this issue Nov 24, 2021 · 2 comments · Fixed by #641
Closed

Add ChrF++ #634

stancld opened this issue Nov 24, 2021 · 2 comments · Fixed by #641
Labels

Comments

@stancld
Copy link
Contributor

stancld commented Nov 24, 2021

🚀 Feature

Add ChrF++, a text metric used for NMT evaluation.

Sources:
Paper - CHRF++: words helping character n-grams
Repo / metric is also implemented in sacrebleu

Motivation

Character n-gram F-score (CHRF) is shown to correlate very well with human relative rankings of different machine translation outputs, especially for morphologically rich target languages. (Popović, 2017)

Additional context

I've already started working on this metric, I'll open a PR soon. :]

@stancld stancld added the enhancement New feature or request label Nov 24, 2021
@stancld stancld changed the title [New metric] Add ChrF++ [New metric] Add ChrF++ Nov 24, 2021
@stancld stancld mentioned this issue Nov 25, 2021
4 tasks
@Borda Borda changed the title [New metric] Add ChrF++ Add ChrF++ Jan 26, 2022
@Borda Borda reopened this Aug 2, 2024
@Borda
Copy link
Member

Borda commented Aug 2, 2024

I have contacted the author of m-popovic/chrF@master/chrF++.py so we may ask her if she is willing to change the license (so we could keep implementation dropped in #2668) or contribute directly to TM
or let's import https://github.com/mjpost/sacrebleu/blob/master/sacrebleu/metrics/chrf.py

@SkafteNicki
Copy link
Member

Re closing due to PR #2701

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants