Added GQA support for CUDNNAttention backend#3984

MaciejBalaNV wants to merge 1 commit into

vllm-project:mainvllm-project/vllm-omni:mainfrom

MaciejBalaNV:gqa_for_cudnn_attnMaciejBalaNV/vllm-omni:gqa_for_cudnn_attnCopy head branch name to clipboard