cuda: add partial eviction on pool OOM#22193

leonardHONG wants to merge 3 commits into

ggml-org:masterggml-org/llama.cpp:masterfrom

leonardHONG:cuda-pool-partial-evictionleonardHONG/llama.cpp:cuda-pool-partial-evictionCopy head branch name to clipboard