UPSTREAM PR #17795: [DRAFT] CUDA: Improve performance via less synchronizations between token#456

loci-dev wants to merge 11 commits intomainauroralabs-loci/llama.cpp:mainfrom

upstream-PR17795-branch_aendk-akieslinger/reduce-per-token-syncsauroralabs-loci/llama.cpp:upstream-PR17795-branch_aendk-akieslinger/reduce-per-token-syncsCopy head branch name to clipboard