Skip to content

perf(core): Replace tiktoken WASM with gpt-tokenizer and move token counting to main thread#1334

Closed
yamadashy wants to merge 1 commit intomainfrom
perf/replace-tiktoken-wasm
Closed

perf(core): Replace tiktoken WASM with gpt-tokenizer and move token counting to main thread#1334
yamadashy wants to merge 1 commit intomainfrom
perf/replace-tiktoken-wasm

Commits

Commits on Mar 28, 2026