From 4cb0015a5e40ebbc1b38cbdf51137c0e298318f9 Mon Sep 17 00:00:00 2001
From: Harish Subramony <81822986+hsubramony@users.noreply.github.com>
Date: Tue, 15 Oct 2024 15:36:35 -0700
Subject: [PATCH 1/4] Update language-modeling README.md, add trust_remote_code
 for flan-t5-xl

---
 examples/language-modeling/README.md | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/examples/language-modeling/README.md b/examples/language-modeling/README.md
index b0c027df65..8ea0cdd554 100644
--- a/examples/language-modeling/README.md
+++ b/examples/language-modeling/README.md
@@ -868,7 +868,8 @@ python3 ../gaudi_spawn.py --world_size 8 --use_mpi peft_poly_seq2seq_with_genera
     --per_device_eval_batch_size 4 \
     --bf16 \
     --use_hpu_graphs_for_inference \
-    --use_hpu_graphs_for_training
+    --use_hpu_graphs_for_training \
+    --trust_remote_code
 ```
 
 

From 6868f3c725051fdbcd5ff6c5c3df7440c74eb83d Mon Sep 17 00:00:00 2001
From: Harish Subramony <81822986+hsubramony@users.noreply.github.com>
Date: Wed, 16 Oct 2024 14:37:06 -0700
Subject: [PATCH 2/4] Update text-gen README.md to add not for 
 HF_DATASETS_TRUST_REMOTE_CODE=true in lm_eval

---
 examples/text-generation/README.md | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/examples/text-generation/README.md b/examples/text-generation/README.md
index c01c8afb09..6b7f18e7d7 100755
--- a/examples/text-generation/README.md
+++ b/examples/text-generation/README.md
@@ -617,6 +617,8 @@ First, you should install the requirements:
 pip install -r requirements_lm_eval.txt
 ```
 
+> [!NOTE]
+> Please set env variable HF_DATASETS_TRUST_REMOTE_CODE=true with the installed lm_eval version and dependency datasets==2.21.0
 
 ### Examples
 

From 3df513188007a4f7cc52c17fe4667c7335d8e367 Mon Sep 17 00:00:00 2001
From: Harish Subramony <81822986+hsubramony@users.noreply.github.com>
Date: Wed, 16 Oct 2024 14:53:17 -0700
Subject: [PATCH 3/4] modify readme based on review

---
 examples/text-generation/README.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/examples/text-generation/README.md b/examples/text-generation/README.md
index 6b7f18e7d7..b2dabd1010 100755
--- a/examples/text-generation/README.md
+++ b/examples/text-generation/README.md
@@ -618,7 +618,7 @@ pip install -r requirements_lm_eval.txt
 ```
 
 > [!NOTE]
-> Please set env variable HF_DATASETS_TRUST_REMOTE_CODE=true with the installed lm_eval version and dependency datasets==2.21.0
+> Depending on the model being used, please set env variable HF_DATASETS_TRUST_REMOTE_CODE=true instead of arg --trust_remote_code with the installed lm_eval version and dependency datasets==2.21.0
 
 ### Examples
 

From 5fd458e9f19265007d5977bbf1ac98fc566749cd Mon Sep 17 00:00:00 2001
From: Harish Subramony <81822986+hsubramony@users.noreply.github.com>
Date: Wed, 16 Oct 2024 15:20:08 -0700
Subject: [PATCH 4/4] review comments

---
 examples/text-generation/README.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/examples/text-generation/README.md b/examples/text-generation/README.md
index b2dabd1010..2e74a0b6ee 100755
--- a/examples/text-generation/README.md
+++ b/examples/text-generation/README.md
@@ -618,7 +618,7 @@ pip install -r requirements_lm_eval.txt
 ```
 
 > [!NOTE]
-> Depending on the model being used, please set env variable HF_DATASETS_TRUST_REMOTE_CODE=true instead of arg --trust_remote_code with the installed lm_eval version and dependency datasets==2.21.0
+> If custom models on hub is being used, please set env variable HF_DATASETS_TRUST_REMOTE_CODE=true instead of arg --trust_remote_code with the installed lm_eval version and dependency datasets==2.21.0
 
 ### Examples