Add changeset

dqbd · Feb 4, 2025 · 5f92348 · 5f92348
1 parent 9fc37ed
commit 5f92348
Showing 1 changed file with 7 additions and 0 deletions.
diff --git a/.changeset/beige-grapes-wink.md b/.changeset/beige-grapes-wink.md
@@ -0,0 +1,7 @@
+---
+"tiktoken": patch
+"js-tiktoken": patch
+"@dqbd/tiktoken": patch
+---
+
+Add missing historic models, fix incorrect tokenizers for old instruct models