Refactor tokenizers #332
Labels
priority:high
High priority
technical debt
A feature/requirement implemented in a sub-optimal way & must be re-written. Contrast to "cleanup"
I think we're inconsistent on how strings get tokenized. We should be consistent in using regex
The text was updated successfully, but these errors were encountered: