Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

[1.6.x] Cherry-pick Interleaved MHA for CPU path (#17138) #17211

Merged
merged 1 commit into from
Jan 4, 2020

Conversation

eric-haibin-lin
Copy link
Member

backport #17138

* init qk attention

* qk: fake backward

* cpu selfatt and encdec; move tests to test_operator.py

* coding style

* fix lint

* use random seed in tests

* remove ut in test_operator_gpu.py

* coding style

* retrigger ci
@eric-haibin-lin
Copy link
Member Author

@ptrendx can we merge this to v1.6?

@eric-haibin-lin
Copy link
Member Author

@TaoLv @PatricZhao FYI

@TaoLv TaoLv changed the title Cherry-pick Interleaved MHA for CPU path (#17138) [1.6.x] Cherry-pick Interleaved MHA for CPU path (#17138) Jan 4, 2020
@ptrendx ptrendx merged commit a0fcb9a into apache:v1.6.x Jan 4, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants