speculative : draft performance improvement (+10% t/s with deeper draft depth possible with this) + token rollback bugfix - #27173

speculative : draft performance improvement (+10% t/s with deeper draft depth possible with this) + token rollback bugfix#27173

PatrickWalther wants to merge 3 commits into

ggml-org:masterggml-org/llama.cpp:masterfrom

PatrickWalther:performance-improvementsPatrickWalther/llama.cpp:performance-improvementsCopy head branch name to clipboard