llama : more tokenizer fixes#2810

ggerganov merged 13 commits intomasterggml-org/llama.cpp:masterfrom

fix-tokenizerggml-org/llama.cpp:fix-tokenizerCopy head branch name to clipboard