Add rust-tokenizers-example

Signed-off-by: Daniel Bevenius <[email protected]>
danbev · Aug 29, 2023 · c98607e · c98607e
1 parent d5baccd
commit c98607e
Show file tree

Hide file tree

Showing 4 changed files with 1,910 additions and 0 deletions.
diff --git a/embeddings/rust/rust-tokenizers-example/.gitignore b/embeddings/rust/rust-tokenizers-example/.gitignore
@@ -0,0 +1 @@
+target