Tweak Tiktoken's BytePairEncode for improved perf#7017

tarekgh merged 1 commit intodotnet:maindotnet/machinelearning:mainfrom

stephentoub:bpeperfstephentoub/machinelearning:bpeperfCopy head branch name to clipboard