From 104cd28835c898f63799d5cb0ced07837507824f Mon Sep 17 00:00:00 2001
From: Mergen Nachin <mnachin@meta.com>
Date: Thu, 11 Dec 2025 07:55:51 -0800
Subject: [PATCH] Update tokenizer pin

Summary:

Bring in this fix:

https://github.com/meta-pytorch/tokenizers/commit/92cf202d5f470f641a3dc516676066d4129eb6e8

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
---
 extension/llm/tokenizers | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/extension/llm/tokenizers b/extension/llm/tokenizers
index 3aada3fe28c..92cf202d5f4 160000
--- a/extension/llm/tokenizers
+++ b/extension/llm/tokenizers
@@ -1 +1 @@
-Subproject commit 3aada3fe28c945d14d5ec62254eb56ccdf10eb11
+Subproject commit 92cf202d5f470f641a3dc516676066d4129eb6e8