Skip to content

Enables GQA support in the prefix prefill kernels#3007

Merged
WoosukKwon merged 1 commit intovllm-project:mainfrom
sighingnow:ht/prefix-gqa
Feb 27, 2024
Merged

Enables GQA support in the prefix prefill kernels#3007
WoosukKwon merged 1 commit intovllm-project:mainfrom
sighingnow:ht/prefix-gqa

Commits

Commits on Feb 27, 2024