UPSTREAM PR #19042: [CUDA] Reduce CPU-side stalls due to the CUDA command buffer being full#1006

loci-dev wants to merge 3 commits intomainauroralabs-loci/llama.cpp:mainfrom

upstream-PR19042-branch_gaugarg-nv-pp_perf_improveauroralabs-loci/llama.cpp:upstream-PR19042-branch_gaugarg-nv-pp_perf_improveCopy head branch name to clipboard