Add changes to support FSDP#598

Merged

regisss merged 20 commits into

huggingface:mainfrom

Jan 23, 2024

Commits on Jan 23, 2024

Commit 1
Vivek
committed
Commit 2
Vivek
committed
Commit 3
Vivek
committed
Commit 4
Vivek
committed
Commit 5
Vivek
committed
Commit 6
Vivek
committed
Commit 7
Vivek
committed
Commit 8
Vivek
committed
Add FSDP tests
Vivek
committed
update fsdp test
Vivek
committed
Add peft linear layer monkey patch for hpu
Vivek
committed
Fix issues with activation_checkpointing code
Vivek
committed
Add FSDP configuration file for Llama2 FT
Vivek
committed
Update as per review comments
Vivek
committed
Run formatter
Vivek
committed
Rebase to commit 979c13247027fa9c8b9cba5137c4a17e27615589
Vivek
committed
Additional wrap policy for reducing device memory usage with PEFT
Vivek
committed
Update save checkpoint code to fix issue with LoRA + FSDP checkpoints
Vivek
committed
Delete question-answering/gaudi_config.json
Vivek
committed
Update device id usage in dataclasses.py
Vivek
committed