-
Notifications
You must be signed in to change notification settings - Fork 2.4k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Additional Japanese processor for NMT that uses MeCab segmentation. F…
…ix for BLEU in one-many NMT (#3889) * Ja Mecab tokenizer Signed-off-by: MaximumEntropy <[email protected]> * Set correct lang for ja sacrebleu Signed-off-by: MaximumEntropy <[email protected]> * EnJa tok fixes Signed-off-by: MaximumEntropy <[email protected]> * BLEU score for one-many fix Signed-off-by: MaximumEntropy <[email protected]> * Revert megatron nmt changes Signed-off-by: MaximumEntropy <[email protected]> * Fix extra space Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Empty commit to restart CI Signed-off-by: MaximumEntropy <[email protected]>
- Loading branch information
1 parent
9580cf8
commit 84236ba
Showing
2 changed files
with
43 additions
and
5 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters