-
Notifications
You must be signed in to change notification settings - Fork 2.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix AST eval #8112
Fix AST eval #8112
Conversation
Signed-off-by: stevehuang52 <[email protected]>
Signed-off-by: stevehuang52 <[email protected]>
…A/NeMo into add_text_metrics_evaluator
Signed-off-by: stevehuang52 <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM thanks
jenkins |
Signed-off-by: stevehuang52 <[email protected]>
jenkins |
) | ||
if gt_text_attr_name not in sample: | ||
if "text" in sample: | ||
gt_text_attr_name = "text" |
Check notice
Code scanning / CodeQL
Unused local variable Note
f"ground-truth text attribute {pred_text_attr_name} is not present in manifest! Cannot calculate {metric}. Returning!" | ||
) | ||
if "text" in sample: | ||
gt_text_attr_name = "text" |
Check notice
Code scanning / CodeQL
Unused local variable Note
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
jenkins |
* add text metrics to asr eval Signed-off-by: stevehuang52 <[email protected]> * temporary fix for EncDecTransfModelBPE Signed-off-by: stevehuang52 <[email protected]> * fix bleu eval Signed-off-by: stevehuang52 <[email protected]> * fix typo Signed-off-by: stevehuang52 <[email protected]> --------- Signed-off-by: stevehuang52 <[email protected]> Co-authored-by: fayejf <[email protected]>
* add text metrics to asr eval Signed-off-by: stevehuang52 <[email protected]> * temporary fix for EncDecTransfModelBPE Signed-off-by: stevehuang52 <[email protected]> * fix bleu eval Signed-off-by: stevehuang52 <[email protected]> * fix typo Signed-off-by: stevehuang52 <[email protected]> --------- Signed-off-by: stevehuang52 <[email protected]> Co-authored-by: fayejf <[email protected]> Signed-off-by: Sasha Meister <[email protected]>
* add text metrics to asr eval Signed-off-by: stevehuang52 <[email protected]> * temporary fix for EncDecTransfModelBPE Signed-off-by: stevehuang52 <[email protected]> * fix bleu eval Signed-off-by: stevehuang52 <[email protected]> * fix typo Signed-off-by: stevehuang52 <[email protected]> --------- Signed-off-by: stevehuang52 <[email protected]> Co-authored-by: fayejf <[email protected]>
Fix bleu calculation for ASR evaluator