Skip to content

[Bugfix][Kernel] Add head size check for attention backend selection#4944

Merged
mgoin merged 5 commits intovllm-project:mainfrom
Isotr0py:fix_phi
May 21, 2024
Merged

[Bugfix][Kernel] Add head size check for attention backend selection#4944
mgoin merged 5 commits intovllm-project:mainfrom
Isotr0py:fix_phi

Commits

Commits on May 21, 2024