Enables GQA support in the prefix prefill kernels#3007
Merged
WoosukKwon merged 1 commit intovllm-project:mainfrom Feb 27, 2024
Merged
Enables GQA support in the prefix prefill kernels#3007WoosukKwon merged 1 commit intovllm-project:mainfrom
WoosukKwon merged 1 commit intovllm-project:mainfrom