[WIP] free speed/mem optimizations with ahash, dary_heap, and compact_str#1618

mjbommar wants to merge 1 commit intohuggingface:mainhuggingface/tokenizers:mainfrom

alea-institute:consolidated-optimization-ahash-dary-compact-stralea-institute/tokenizers:consolidated-optimization-ahash-dary-compact-strCopy head branch name to clipboard