CUDA: optimize FA for GQA + large batches#12014

JohannesGaessler merged 1 commit intoggml-org:masterggml-org/llama.cpp:masterfrom

JohannesGaessler:cuda-fa-mma-23JohannesGaessler/llama.cpp:cuda-fa-mma-23Copy head branch name to clipboard