[CUDA] Reduce CPU-side stalls due to the CUDA command buffer being full#19042

ggerganov merged 4 commits intoggml-org:masterggml-org/llama.cpp:masterfrom

gaugarg-nv:pp_perf_improvegaugarg-nv/llama.cpp:pp_perf_improveCopy head branch name to clipboard