cuda: reserve space for quantize kv-cache at startup#23907

am17an merged 4 commits into

ggml-org:masterggml-org/llama.cpp:masterfrom

am17an:fattn-static-kv-cacheam17an/llama.cpp:fattn-static-kv-cacheCopy head branch name to clipboard