From 17f5c73c7e235482b1536adc8ec1805a2b179f20 Mon Sep 17 00:00:00 2001
From: Lucy Qiu <lfq@meta.com>
Date: Sat, 18 Oct 2025 13:18:03 -0700
Subject: [PATCH] Pin bump tokenizer

Summary: Pull in https://github.com/meta-pytorch/tokenizers/pull/146

Differential Revision: D84991625
---
 extension/llm/tokenizers | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/extension/llm/tokenizers b/extension/llm/tokenizers
index b2a3d77d672..572e4073117 160000
--- a/extension/llm/tokenizers
+++ b/extension/llm/tokenizers
@@ -1 +1 @@
-Subproject commit b2a3d77d672d50f24d0ae7cd6df3b428469c2548
+Subproject commit 572e4073117cb8f8bb4651d2e738ae0d3a4f476a