Skip to content

Update llama-7b command to include eval #665

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
regisss merged 2 commits into from
Feb 2, 2024
Merged

Update llama-7b command to include eval #665

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
dea58e8
Update llama-7b command to include eval
jiminha Jan 23, 2024
2c83ac9
Merge branch 'main' into llama7b_readme
regisss Feb 2, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions examples/language-modeling/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -370,6 +370,7 @@ python3 run_lora_clm.py \
--max_grad_norm 0.3 \
--logging_steps 1 \
--do_train \
--do_eval \
--use_habana \
--use_lazy_mode \
--throughput_warmup_steps 3 \
Expand All @@ -380,6 +381,7 @@ python3 run_lora_clm.py \
--dataset_concatenation \
--max_seq_length 512 \
--low_cpu_mem_usage True \
--validation_split_percentage 4 \
--adam_epsilon 1e-08
```

Expand Down Expand Up @@ -436,6 +438,7 @@ python ../gaudi_spawn.py \
--max_grad_norm 0.3 \
--logging_steps 1 \
--do_train \
--do_eval \
--use_habana \
--use_lazy_mode \
--throughput_warmup_steps 3 \
Expand All @@ -447,6 +450,7 @@ python ../gaudi_spawn.py \
--max_seq_length 512 \
--ddp_bucket_cap_mb 50 \
--adam_epsilon 1e-08 \
--validation_split_percentage 4 \
--low_cpu_mem_usage True
```

Expand Down