Skip to content

v1.16 Llama3-405B text-generation. Added DEEPSPEED_USE_HABANA_FRAMEWORKS_DETERMINISTIC_API flag.#1812

Merged
regisss merged 1 commit into
huggingface:v1.16-releasefrom
dsmertin:patch-1
Mar 5, 2025
Merged

v1.16 Llama3-405B text-generation. Added DEEPSPEED_USE_HABANA_FRAMEWORKS_DETERMINISTIC_API flag.#1812
regisss merged 1 commit into
huggingface:v1.16-releasefrom
dsmertin:patch-1

Conversation

@dsmertin
Copy link
Copy Markdown
Contributor

@dsmertin dsmertin commented Mar 3, 2025

Updated README:
added DEEPSPEED_USE_HABANA_FRAMEWORKS_DETERMINISTIC_API=true for Llama3-405B

related to this change: #1745

What does this PR do?

Fixes # (issue)

Before submitting

  • This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • Did you make sure to update the documentation with your changes?
  • Did you write any new necessary tests?

@dsmertin dsmertin requested a review from regisss as a code owner March 3, 2025 15:48
@regisss regisss merged commit bbdf8d8 into huggingface:v1.16-release Mar 5, 2025
regisss pushed a commit that referenced this pull request Mar 5, 2025
ugolowic added a commit to HabanaAI/optimum-habana-fork that referenced this pull request Mar 6, 2025
…_FRAMEWORKS_DETERMINISTIC_API flag (huggingface#1812)"

This reverts commit bbdf8d8.
alekseyfa pushed a commit to alekseyfa/optimum-habana that referenced this pull request Jun 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants