Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

[1.6.x] Cherry-pick Interleaved MHA for CPU path (#17138) #17211

Merged
merged 1 commit into from
Jan 4, 2020
Merged

[1.6.x] Cherry-pick Interleaved MHA for CPU path (#17138) #17211

merged 1 commit into from
Jan 4, 2020

Conversation

eric-haibin-lin
Copy link
Member

backport #17138

@TaoLv
Interleaved MHA for CPU path (apache#17138)
d240f83 
* init qk attention

* qk: fake backward

* cpu selfatt and encdec; move tests to test_operator.py

* coding style

* fix lint

* use random seed in tests

* remove ut in test_operator_gpu.py

* coding style

* retrigger ci
@eric-haibin-lin
Copy link
Member Author

@ptrendx can we merge this to v1.6?

@eric-haibin-lin
Copy link
Member Author

@TaoLv @PatricZhao FYI

@TaoLv TaoLv changed the title Cherry-pick Interleaved MHA for CPU path (#17138) [1.6.x] Cherry-pick Interleaved MHA for CPU path (#17138) Jan 4, 2020
@ptrendx ptrendx merged commit a0fcb9a into apache:v1.6.x Jan 4, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@TaoLv TaoLv TaoLv approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@eric-haibin-lin @TaoLv @ptrendx