Skip to content

Add rouge metric evalution for llama 70B with orca datasets#169

Merged
3 commits merged into
habana-mainfrom
sushil/mlperf_rouge_eval
Apr 23, 2024
Merged

Add rouge metric evalution for llama 70B with orca datasets#169
3 commits merged into
habana-mainfrom
sushil/mlperf_rouge_eval

Conversation

@sushildubey171
Copy link
Copy Markdown

Fixes # (issue)
use rouge metric to evaluate the correctness of the model, it uses openorca dataset

use rouge metric to evaluate the corretness of the model, it uses
openorca dataset
use rouge metric to evaluate the corretness of the model, it uses
openorca dataset
use rouge metric to evaluate the correctness of the model, it uses
openorca dataset
@sushildubey171 sushildubey171 requested a review from a user April 15, 2024 13:14
Copy link
Copy Markdown

@msinnha1 msinnha1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@ghost ghost merged commit 5a47add into habana-main Apr 23, 2024
astachowiczhabana pushed a commit that referenced this pull request Apr 25, 2024
* Add rouge metric evalution for llama 70B with orca datasets

use rouge metric to evaluate the corretness of the model, it uses
openorca dataset

* Add rouge metric evalution for llama 70B with orca datasets

use rouge metric to evaluate the corretness of the model, it uses
openorca dataset

* Add rouge metric evalution for llama 70B with orca datasets

use rouge metric to evaluate the correctness of the model, it uses
openorca dataset
@sushildubey171
Copy link
Copy Markdown
Author

OH PR: huggingface#1068

astachowiczhabana pushed a commit that referenced this pull request Jun 24, 2024
* Add rouge metric evalution for llama 70B with orca datasets

use rouge metric to evaluate the corretness of the model, it uses
openorca dataset

* Add rouge metric evalution for llama 70B with orca datasets

use rouge metric to evaluate the corretness of the model, it uses
openorca dataset

* Add rouge metric evalution for llama 70B with orca datasets

use rouge metric to evaluate the correctness of the model, it uses
openorca dataset
astachowiczhabana pushed a commit that referenced this pull request Jun 24, 2024
* Add rouge metric evalution for llama 70B with orca datasets

use rouge metric to evaluate the corretness of the model, it uses
openorca dataset

* Add rouge metric evalution for llama 70B with orca datasets

use rouge metric to evaluate the corretness of the model, it uses
openorca dataset

* Add rouge metric evalution for llama 70B with orca datasets

use rouge metric to evaluate the correctness of the model, it uses
openorca dataset
This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants