support xxxFast alias in v5 tokenizers #44766

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

ArthurZucker merged 4 commits into main from fast_tok_v5

Mar 18, 2026

+26 −1

Merged

support xxxFast alias in v5 tokenizers #44766

Merge branch 'main' into fast_tok_v5

CircleCI Checks / setup_and_quality succeeded Mar 18, 2026 in 4m 54s

Workflow: setup_and_quality

View CircleCI Workflow

View more details on CircleCI Checks