Skip to content

add fused rope optimization to mistral model#163

Merged
skaulintel merged 5 commits into
ae_mistral_fp8from
skaul/fusedrope_mistral
Apr 12, 2024
Merged

add fused rope optimization to mistral model#163
skaulintel merged 5 commits into
ae_mistral_fp8from
skaul/fusedrope_mistral

Conversation

@skaulintel
Copy link
Copy Markdown

@skaulintel skaulintel commented Apr 12, 2024

Adds fusedrope optimization to mistral

@skaulintel skaulintel changed the title Skaul/fusedrope mistral add fused rope optimization to mistral model Apr 12, 2024
@skaulintel skaulintel merged commit e3fc815 into ae_mistral_fp8 Apr 12, 2024
@skaulintel skaulintel deleted the skaul/fusedrope_mistral branch April 12, 2024 21:55
astachowiczhabana pushed a commit that referenced this pull request Mar 5, 2025
[SW-217550] Update transformer_engine._convert_model to skip LoRA lay…
549f26a 
…ers (#133) (#163)

* Update transformer_engine._convert_model to skip LoRA layers

* Remove print statement

* Add check for peft module availability
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@libinta libinta libinta approved these changes

@jiminha jiminha jiminha approved these changes

@hsubramony hsubramony Awaiting requested review from hsubramony

@ssarkar2 ssarkar2 Awaiting requested review from ssarkar2

@yeonsily yeonsily Awaiting requested review from yeonsily

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@skaulintel @libinta @jiminha