update

Signed-off-by: arendu <[email protected]>

scripts/metric_calculation/peft_metric_calc.py

@@ -21,26 +21,18 @@
 
 
 """
-This script can be used to calcualte exact match and F1 scores for many different tasks, not just squad. 
-
-Example command for T5 Preds
-
-    ```
-    python squad_metric_calc.py \
-        --ground-truth squad_test_gt.jsonl \
-        --preds squad_preds_t5.txt
-    ```
+This script can be used to calcualte exact match and F1 scores for many different tasks. 
+The file "squad_test_predictions.jsonl" is assumed to be generated by the 
+`examples/nlp/language_modeling/tuning/megatron_gpt_peft_eval.py` script
 
 Example command for GPT Preds
 
     ```
-    python squad_metric_calc.py \
-        --ground-truth squad_test_gt.jsonl \
-        --preds squad_preds_gpt.txt \
-        --split-string "answer:"
+    python peft_metric_calc.py \
+        --pred_file squad_test_predictions.jsonl \
+        --label_field "original_answers" \
     ```
 
-    In this case, the prediction file will be split on "answer: " when looking for the LM's predicted answer. 
 
 """