fixed tokenizer dependencies

HMUNACHI · Mar 14, 2024 · 2af3047 · 2af3047
1 parent 16cfff5
commit 2af3047
Show file tree

Hide file tree

Showing 2 changed files with 4 additions and 1 deletion.
diff --git a/requirements.txt b/requirements.txt
@@ -2,4 +2,5 @@ jax
 jaxlib
 flax
 optax
-einops
+einops
+sentencepiece
diff --git a/setup.py b/setup.py
@@ -15,6 +15,8 @@
         'jax',
         'jaxlib',
         'optax',
+        'einops',
+        'sentencepiece',
     ],
     classifiers=[
         'Development Status :: 3 - Alpha',