Skip to content

Commit

Permalink
Interleaved MHA for CPU path (apache#17138)
Browse files Browse the repository at this point in the history 
* init qk attention

* qk: fake backward

* cpu selfatt and encdec; move tests to test_operator.py

* coding style

* fix lint

* use random seed in tests

* remove ut in test_operator_gpu.py

* coding style

* retrigger ci
  • Loading branch information
@TaoLv
TaoLv authored and Lin committed Jan 3, 2020
1 parent dafbb11 commit d240f83
Show file tree
Hide file tree
Showing 3 changed files with 861 additions and 327 deletions.
Loading

0 comments on commit d240f83

Please sign in to comment.