CUDA: optimize and refactor MMQ#8416

JohannesGaessler merged 2 commits intoggml-org:masterggml-org/llama.cpp:masterfrom

JohannesGaessler:cuda-mmq-256k-5JohannesGaessler/llama.cpp:cuda-mmq-256k-5Copy head branch name to clipboard