Skip to content

Tensor parallel distributed strategy without using deepspeed (#280)#299

Merged
1 commit merged into
HabanaAI:v1.17-synapsefrom
kalyanjk:tp_strategy_v1.17
Jul 15, 2024
Merged

Tensor parallel distributed strategy without using deepspeed (#280)#299
1 commit merged into
HabanaAI:v1.17-synapsefrom
kalyanjk:tp_strategy_v1.17

Conversation

@kalyanjk
Copy link
Copy Markdown

  • TP reference - ibm foundation-model-stack

  • Code cleanup -removed unused code

…I#280)

* TP reference -  ibm foundation-model-stack

* Code cleanup -removed unused code

---------

Co-authored-by: Kalyan <kkumar@habana.ai>
@kalyanjk kalyanjk requested a review from a user July 15, 2024 16:20
@ghost ghost merged commit 32c86d3 into HabanaAI:v1.17-synapse Jul 15, 2024
kalyanjk pushed a commit to kalyanjk/optimum-habana-fork that referenced this pull request Jul 31, 2024
ghost pushed a commit that referenced this pull request Jul 31, 2024
* Revert "Tensor parallel  distributed strategy without using deepspeed (#280) (#299)"

This reverts commit 32c86d3.

* Tensor parallel distributed strategy without using deepspeed (huggingface#1121)

Co-authored-by: Kalyan <kkumar@habana.ai>

---------

Co-authored-by: Kalyan <kkumar@habana.ai>
@astachowiczhabana
Copy link
Copy Markdown

huggingface#1121

This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants