Skip to content

perf(core): Replace tiktoken WASM with gpt-tokenizer#1343

Closed
yamadashy wants to merge 11 commits intomainfrom
perf/replace-tiktoken-with-gpt-tokenizer
Closed

perf(core): Replace tiktoken WASM with gpt-tokenizer#1343
yamadashy wants to merge 11 commits intomainfrom
perf/replace-tiktoken-with-gpt-tokenizer

Commits

Commits on Mar 28, 2026