Skip to content

Add a test for llama finetuning with FP8 precision#1106

Merged
regisss merged 2 commits into
huggingface:mainfrom
HabanaAI:fp8-tests-upstream
Jul 8, 2024
Merged

Add a test for llama finetuning with FP8 precision#1106
regisss merged 2 commits into
huggingface:mainfrom
HabanaAI:fp8-tests-upstream

Conversation

@scsudhak-intel
Copy link
Copy Markdown
Contributor

What does this PR do?

Adding example test case for the combination of Llama2-7B + MPI + LoRA + FP8 precision

Fixes # (issue)

Before submitting

  • This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • Did you make sure to update the documentation with your changes?
  • Did you write any new necessary tests?

@scsudhak-intel scsudhak-intel requested a review from regisss as a code owner June 27, 2024 03:38
@vivekgoe vivekgoe requested a review from libinta June 27, 2024 10:09
@vivekgoe vivekgoe mentioned this pull request Jun 27, 2024
3 tasks
@vivekgoe vivekgoe added the synapse1.17 PR that should be available along with Synapse 1.17 but have no dependency on Synapse 1.17 content. label Jun 28, 2024
@libinta libinta added the run-test Run CI for PRs from external contributors label Jul 2, 2024
@HuggingFaceDocBuilderDev
Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Comment thread tests/test_examples.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

run-test Run CI for PRs from external contributors synapse1.17 PR that should be available along with Synapse 1.17 but have no dependency on Synapse 1.17 content.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants