Skip to content

πŸ† A ranked list of awesome machine learning Rust libraries.

License

Notifications You must be signed in to change notification settings

e-tornike/best-of-ml-rust

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

best-of-ml-rust

πŸ†Β  A ranked list of awesome machine learning Rust libraries.

This curated list contains 220 awesome open-source projects with a total of 480K stars grouped into 10 categories. All projects are ranked by a project-quality score, which is calculated based on various metrics automatically collected from GitHub and different package managers. If you like to add or update projects, feel free to open an issue, submit a pull request, or directly edit the projects.yaml. Contributions are very welcome!

πŸ§™β€β™‚οΈ Discover other best-of lists or create your own.

Contents

Explanation

  • πŸ₯‡πŸ₯ˆπŸ₯‰Β  Combined project-quality score
  • ⭐️  Star count from GitHub
  • 🐣  New project (less than 6 months old)
  • πŸ’€Β  Inactive project (6 months no activity)
  • πŸ’€Β  Dead project (12 months no activity)
  • πŸ“ˆπŸ“‰Β  Project is trending up or down
  • βž•Β  Project was recently added
  • ❗️  Warning (e.g. missing/risky license)
  • πŸ‘¨β€πŸ’»Β  Contributors count from GitHub
  • πŸ”€Β  Fork count from GitHub
  • πŸ“‹Β  Issue count from GitHub
  • ⏱️  Last update timestamp on package manager
  • πŸ“₯Β  Download count from package manager
  • πŸ“¦Β  Number of dependent projects
  • Β  A binding for another project.

Machine Learning Frameworks

Back to top

General-purpose machine learning and deep learning frameworks.

statrs (πŸ₯‡23 Β· ⭐ 580) - Statistical computation library for Rust. MIT
  • GitHub (πŸ‘¨β€πŸ’» 46 Β· πŸ”€ 83 Β· πŸ“¦ 17K Β· πŸ“‹ 150 - 27% open Β· ⏱️ 23.09.2024):

     git clone https://github.com/boxtown/statrs
    
burn (πŸ₯‡22 Β· ⭐ 8.5K) - Burn is a new comprehensive dynamic Deep Learning Framework built using.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 140 Β· πŸ”€ 420 Β· πŸ“¦ 430 Β· πŸ“‹ 670 - 30% open Β· ⏱️ 30.09.2024):

     git clone https://github.com/burn-rs/burn
    
nalgebra (πŸ₯‡22 Β· ⭐ 3.9K Β· πŸ“‰) - Linear algebra library for Rust. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 220 Β· πŸ”€ 470 Β· πŸ“¦ 42K Β· πŸ“‹ 710 - 44% open Β· ⏱️ 21.07.2024):

     git clone https://github.com/dimforge/nalgebra
    
linfa (πŸ₯‡22 Β· ⭐ 3.7K) - A Rust machine learning framework. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 45 Β· πŸ”€ 240 Β· πŸ“¦ 520 Β· πŸ“‹ 160 - 37% open Β· ⏱️ 03.07.2024):

     git clone https://github.com/rust-ml/linfa
    
candle (πŸ₯‡21 Β· ⭐ 15K) - Minimalist ML framework for Rust. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 150 Β· πŸ”€ 890 Β· πŸ“¦ 1.1K Β· πŸ“‹ 680 - 45% open Β· ⏱️ 02.10.2024):

     git clone https://github.com/huggingface/candle
    
tvm (πŸ₯‡21 Β· ⭐ 12K) - Open deep learning compiler stack for cpu, gpu and specialized.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 1K Β· πŸ”€ 3.3K Β· πŸ“₯ 4.5K Β· πŸ“‹ 3.4K - 12% open Β· ⏱️ 02.10.2024):

     git clone https://github.com/apache/tvm
    
mistral.rs (πŸ₯‡21 Β· ⭐ 3.6K Β· βž•) - Blazingly fast LLM inference. MIT
  • GitHub (πŸ‘¨β€πŸ’» 25 Β· πŸ”€ 250 Β· πŸ“₯ 830 Β· πŸ“‹ 240 - 27% open Β· ⏱️ 02.10.2024):

     git clone https://github.com/EricLBuehler/mistral.rs
    
Peroxide (πŸ₯‡21 Β· ⭐ 510) - Rust numeric library with R, MATLAB & Python syntax. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 19 Β· πŸ”€ 30 Β· πŸ“¦ 200 Β· πŸ“‹ 35 - 31% open Β· ⏱️ 30.07.2024):

     git clone https://github.com/Axect/Peroxide
    
tch-rs (πŸ₯ˆ20 Β· ⭐ 4.2K) - Rust bindings for the C++ api of PyTorch. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 76 Β· πŸ”€ 330 Β· πŸ“₯ 1.9K Β· πŸ“¦ 1.9K Β· πŸ“‹ 560 - 24% open Β· ⏱️ 15.09.2024):

     git clone https://github.com/LaurentMazare/tch-rs
    
rust-numpy (πŸ₯ˆ20 Β· ⭐ 1.1K) - PyO3-based Rust bindings of the NumPy C-API. BSD-2
  • GitHub (πŸ‘¨β€πŸ’» 43 Β· πŸ”€ 100 Β· πŸ“¦ 3.3K Β· πŸ“‹ 130 - 10% open Β· ⏱️ 21.07.2024):

     git clone https://github.com/PyO3/rust-numpy
    
sprs (πŸ₯ˆ20 Β· ⭐ 390) - sparse linear algebra library for rust. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 36 Β· πŸ”€ 44 Β· πŸ“¦ 1.4K Β· πŸ“‹ 150 - 29% open Β· ⏱️ 22.09.2024):

     git clone https://github.com/vbarrielle/sprs
    
azure-sdk-for-rust (πŸ₯ˆ19 Β· ⭐ 700 Β· πŸ“ˆ) - This repository is for active development of the.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 140 Β· πŸ”€ 230 Β· πŸ“¦ 1.3K Β· πŸ“‹ 600 - 30% open Β· ⏱️ 28.08.2024):

     git clone https://github.com/Azure/azure-sdk-for-rust
    
smartcore (πŸ₯ˆ18 Β· ⭐ 700 Β· πŸ’€) - A comprehensive library for machine learning and numerical.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 29 Β· πŸ”€ 73 Β· πŸ“¦ 230 Β· πŸ“‹ 120 - 56% open Β· ⏱️ 04.03.2024):

     git clone https://github.com/smartcorelib/smartcore
    
argmin (πŸ₯ˆ17 Β· ⭐ 990) - Numerical optimization in pure Rust. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 40 Β· πŸ”€ 77 Β· πŸ“¦ 520 Β· πŸ“‹ 120 - 24% open Β· ⏱️ 31.08.2024):

     git clone https://github.com/argmin-rs/argmin
    
faiss-rs (πŸ₯ˆ17 Β· ⭐ 200) - Rust language bindings for Faiss. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 11 Β· πŸ”€ 32 Β· πŸ“¦ 32 Β· πŸ“‹ 36 - 25% open Β· ⏱️ 18.09.2024):

     git clone https://github.com/Enet4/faiss-rs
    
rust (πŸ₯ˆ16 Β· ⭐ 5.1K Β· πŸ’€) - Rust language bindings for TensorFlow. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 49 Β· πŸ”€ 420 Β· πŸ“‹ 190 - 32% open Β· ⏱️ 03.12.2023):

     git clone https://github.com/tensorflow/rust
    
ratchet (πŸ₯ˆ15 Β· ⭐ 580 Β· βž•) - A cross-platform browser ML framework. MIT
  • GitHub (πŸ‘¨β€πŸ’» 14 Β· πŸ”€ 31 Β· πŸ“¦ 4 Β· πŸ“‹ 90 - 27% open Β· ⏱️ 20.09.2024):

     git clone https://github.com/huggingface/ratchet
    
luminal (πŸ₯ˆ14 Β· ⭐ 1.5K Β· βž•) - Deep learning at the speed of light. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 10 Β· πŸ”€ 90 Β· πŸ“¦ 3 Β· πŸ“‹ 50 - 48% open Β· ⏱️ 04.08.2024):

     git clone https://github.com/jafioti/luminal
    
autograph (πŸ₯‰13 Β· ⭐ 310) - A machine learning library for Rust. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 4 Β· πŸ”€ 16 Β· πŸ“¦ 2 Β· ⏱️ 19.08.2024):

     git clone https://github.com/charles-r-earp/autograph
    
instant-distance (πŸ₯‰11 Β· ⭐ 310) - Fast approximate nearest neighbor searching in Rust,.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 10 Β· πŸ”€ 22 Β· πŸ“¦ 2 Β· πŸ“‹ 7 - 28% open Β· ⏱️ 04.08.2024):

     git clone https://github.com/InstantDomain/instant-distance
    
kdtree-rs (πŸ₯‰11 Β· ⭐ 230 Β· πŸ’€) - K-dimensional tree in Rust for fast geospatial indexing and.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 16 Β· πŸ”€ 43 Β· πŸ“‹ 19 - 5% open Β· ⏱️ 02.02.2024):

     git clone https://github.com/mrhooray/kdtree-rs
    
rurel (πŸ₯‰11 Β· ⭐ 140) - Flexible, reusable reinforcement learning (Q learning) implementation in.. MPL-2.0
  • GitHub (πŸ‘¨β€πŸ’» 9 Β· πŸ”€ 17 Β· πŸ“¦ 18 Β· πŸ“‹ 11 - 18% open Β· ⏱️ 25.06.2024):

     git clone https://github.com/milanboers/rurel
    
Show 65 hidden projects...
  • rusoto (πŸ₯‡22 Β· ⭐ 2.7K Β· πŸ’€) - AWS SDK for Rust. MIT
  • tract (πŸ₯ˆ19 Β· ⭐ 2.2K) - Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference. ❗Unlicensed
  • pyrus-cramjam (πŸ₯ˆ19 Β· ⭐ 88) - Your go-to for easy access to a plethora of compression algorithms,.. MIT
  • evcxr (πŸ₯ˆ18 Β· ⭐ 5.5K) - ❗Unlicensed
  • xaynet (πŸ₯ˆ18 Β· ⭐ 200 Β· πŸ’€) - Xaynet represents an agnostic Federated Machine Learning framework.. Apache-2
  • weld (πŸ₯ˆ17 Β· ⭐ 3K Β· πŸ’€) - High-performance runtime for data analytics applications. BSD-3
  • rusty-machine (πŸ₯ˆ17 Β· ⭐ 1.3K Β· πŸ’€) - Machine Learning library for Rust. MIT
  • juice (πŸ₯ˆ16 Β· ⭐ 1.1K) - The Hacker's Machine Learning Engine. ❗Unlicensed
  • rustlearn (πŸ₯ˆ16 Β· ⭐ 620 Β· πŸ’€) - Machine learning crate for Rust. Apache-2
  • granne (πŸ₯ˆ16 Β· ⭐ 310 Β· πŸ’€) - Graph-based Approximate Nearest Neighbor Search. MIT
  • gap_statistic (πŸ₯ˆ16 Β· ⭐ 220 Β· πŸ’€) - Dynamically get the suggested clusters in the data for.. Unlicense
  • dfdx (πŸ₯ˆ15 Β· ⭐ 1.7K Β· πŸ’€) - Deep learning in Rust, with shape checked tensors and neural.. ❗Unlicensed
  • onnxruntime-rs (πŸ₯ˆ15 Β· ⭐ 280 Β· πŸ’€) - Rust wrapper for Microsoft's ONNX Runtime (version.. Apache-2
  • leaf (πŸ₯ˆ14 Β· ⭐ 5.6K Β· πŸ’€) - Open Machine Intelligence Framework for Hackers. (GPU/CPU). Apache-2
  • Enzyme (πŸ₯ˆ14 Β· ⭐ 1.3K) - High-performance automatic differentiation of LLVM and MLIR. ❗Unlicensed
  • rain (πŸ₯ˆ14 Β· ⭐ 750 Β· πŸ’€) - Framework for large distributed pipelines. MIT
  • cleora (πŸ₯ˆ14 Β· ⭐ 480 Β· πŸ’€) - Cleora AI is a general-purpose model for efficient, scalable.. ❗Unlicensed
  • hnsw (πŸ₯ˆ14 Β· ⭐ 220 Β· πŸ’€) - HNSW ANN from the paper Efficient and robust approximate nearest neighbor.. MIT
  • rsrl (πŸ₯ˆ14 Β· ⭐ 180 Β· πŸ’€) - A fast, safe and easy to use reinforcement learning framework in Rust. MIT
  • hora (πŸ₯‰13 Β· ⭐ 2.6K Β· πŸ’€) - efficient approximate nearest neighbor search algorithm collections.. Apache-2
  • NeuroFlow (πŸ₯‰13 Β· ⭐ 110 Β· πŸ’€) - Awesome deep learning crate. MIT
  • kodama (πŸ₯‰13 Β· ⭐ 91 Β· πŸ’€) - Fast hierarchical agglomerative clustering in Rust. MIT
  • bhtsne (πŸ₯‰13 Β· ⭐ 67) - Parallel Barnes-Hut t-SNE implementation written in Rust. MIT
  • gym-rs (πŸ₯‰13 Β· ⭐ 61 Β· πŸ’€) - OpenAI Gym bindings for Rust. MIT
  • rust-autograd (πŸ₯‰12 Β· ⭐ 480 Β· πŸ’€) - Tensors and differentiable operations (like TensorFlow) in Rust. MIT
  • L2 (πŸ₯‰11 Β· ⭐ 190 Β· πŸ’€) - l2 is a fast, Pytorch-style Tensor+Autograd library written in Rust. MIT
  • rustml (πŸ₯‰11 Β· ⭐ 65 Β· πŸ’€) - Machine learning in Rust. ❗Unlicensed
  • ffsvm-rust (πŸ₯‰11 Β· ⭐ 65) - FFSVM stands for Really Fast Support Vector Machine. MIT
  • rstats (πŸ₯‰11 Β· ⭐ 47) - Statistics, Information Measures, Linear Algebra, Cholesky Matrix.. Apache-2
  • black-jack (πŸ₯‰11 Β· ⭐ 29 Β· πŸ’€) - DataFrame / Series data processing in Rust. ❗️GPL-3.0
  • petal-clustering (πŸ₯‰11 Β· ⭐ 25) - DBSCAN and OPTICS clustering algorithms. Apache-2
  • unda (πŸ₯‰11 Β· ⭐ 13) - General purpose machine learning crate. Apache-2
  • neuronika (πŸ₯‰10 Β· ⭐ 1K Β· πŸ’€) - Tensors and dynamic neural networks in pure Rust. Apache-2
  • RustNN (πŸ₯‰10 Β· ⭐ 330 Β· πŸ’€) - A neural network crate. Apache-2
  • deeplearn-rs (πŸ₯‰10 Β· ⭐ 210 Β· πŸ’€) - Neural networks in Rust. MIT
  • orkhon (πŸ₯‰10 Β· ⭐ 150 Β· πŸ’€) - Orkhon: ML Inference Framework and Server Runtime. MIT
  • gamma (πŸ₯‰10 Β· ⭐ 120 Β· πŸ’€) - A graph library for Rust. ❗Unlicensed
  • tflite-rs (πŸ₯‰10 Β· ⭐ 110) - Apache-2
  • rten (πŸ₯‰10 Β· ⭐ 110 Β· βž•) - ONNX neural network inference engine. ❗Unlicensed
  • alumina (πŸ₯‰10 Β· ⭐ 100 Β· πŸ’€) - A deep learning library for rust. ❗Unlicensed
  • torchrs (πŸ₯‰10 Β· ⭐ 77 Β· πŸ’€) - Deep Learning in Rust with the PyTorch API. BSD-2
  • rustdef (πŸ₯‰10 Β· ⭐ 28 Β· πŸ’€) - Jupyter extension for Rust. MIT
  • reductive (πŸ₯‰10 Β· ⭐ 6 Β· πŸ’€) - Vector quantization. Apache-2
  • hal (πŸ₯‰9 Β· ⭐ 90 Β· πŸ’€) - Rust based Cross-GPU Machine Learning. MIT
  • tractjs (πŸ₯‰9 Β· ⭐ 75 Β· πŸ’€) - Run ONNX and TensorFlow inference in the browser. ❗Unlicensed
  • ngt-rs (πŸ₯‰9 Β· ⭐ 36) - Rust wrappers for NGT approximate nearest neighbor search. Apache-2
  • RusticSOM (πŸ₯‰9 Β· ⭐ 33 Β· πŸ’€) - Rust library for Self Organising Maps (SOM). MIT
  • batched-fn (πŸ₯‰9 Β· ⭐ 18 Β· πŸ’€) - Rust server plugin for deploying deep learning models with.. Apache-2
  • bayespam (πŸ₯‰9 Β· ⭐ 13 Β· πŸ’€) - A simple bayesian spam classifier written in Rust. MIT
  • vpsearch (πŸ₯‰8 Β· ⭐ 32 Β· πŸ’€) - C library for finding nearest (most similar) element in a set. ❗Unlicensed
  • crfsuite-rs (πŸ₯‰8 Β· ⭐ 25 Β· πŸ’€) - Rust binding to crfsuite. MIT
  • cntk-rs (πŸ₯‰8 Β· ⭐ 21 Β· πŸ’€) - Wrapper around Microsoft CNTK library. Apache-2
  • liblinear-rs (πŸ₯‰8 Β· ⭐ 9 Β· πŸ’€) - Rust language bindings for the LIBLINEAR C/C++ library. MIT
  • mushin (πŸ₯‰7 Β· ⭐ 390 Β· πŸ’€) - Computational graphs with reverse automatic differentation in.. ❗Unlicensed
  • fwumious_wabbit (πŸ₯‰7 Β· ⭐ 130) - Fwumious Wabbit, fast on-line machine learning toolkit.. ❗Unlicensed
  • cogent (πŸ₯‰7 Β· ⭐ 44 Β· πŸ’€) - Simple neural network library for classification written in Rust. ❗Unlicensed
  • prophet (πŸ₯‰7 Β· ⭐ 39 Β· πŸ’€) - A simple neural net implementation. ❗Unlicensed
  • rust-dl-webserver (πŸ₯‰7 Β· ⭐ 33 Β· πŸ’€) - Example of serving deep learning models in Rust with.. ❗Unlicensed
  • revonet (πŸ₯‰7 Β· ⭐ 20 Β· πŸ’€) - Rust implementation of real-coded GA for solving optimization.. ❗️GPL-3.0
  • drug (πŸ₯‰7 Β· ⭐ 16 Β· πŸ’€) - Differentiable Rust Graphs (neural network library). MIT
  • craftml-rs (πŸ₯‰7 Β· ⭐ 15 Β· πŸ’€) - A Rust implementation of CRAFTML, an Efficient Clustering-based.. MIT
  • hwt (πŸ₯‰7 Β· ⭐ 7 Β· πŸ’€) - Hamming Weight Tree from the paper Online Nearest Neighbor Search in Hamming.. MIT
  • REnforce (πŸ₯‰6 Β· ⭐ 22 Β· πŸ’€) - Reinforcement learning library written in Rust. ❗Unlicensed
  • fann-rs (πŸ₯‰6 Β· ⭐ 15 Β· πŸ’€) - Rust wrapper for the Fast Artificial Neural Network library. ❗️LGPL-3.0
  • rust-hf-hub-loader (πŸ₯‰6 Β· ⭐ 3 Β· πŸ’€) - Apache-2

Text Data & NLP

Back to top

Libraries for processing, cleaning, manipulating, and analyzing text data as well as for diverse NLP tasks.

tiktoken (πŸ₯‡25 Β· ⭐ 12K) - tiktoken is a fast BPE tokeniser for use with OpenAI's models. MIT
  • GitHub (πŸ‘¨β€πŸ’» 17 Β· πŸ”€ 740 Β· πŸ“¦ 96K Β· πŸ“‹ 230 - 18% open Β· ⏱️ 13.05.2024):

     git clone https://github.com/openai/tiktoken
    
tokenizers (πŸ₯‡25 Β· ⭐ 8.9K) - Fast State-of-the-Art Tokenizers optimized for Research and.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 93 Β· πŸ”€ 760 Β· πŸ“₯ 65 Β· πŸ“¦ 100K Β· πŸ“‹ 980 - 3% open Β· ⏱️ 01.10.2024):

     git clone https://github.com/huggingface/tokenizers
    
aho-corasick (πŸ₯‡23 Β· ⭐ 1K) - A fast implementation of Aho-Corasick in Rust. Unlicense
  • GitHub (πŸ‘¨β€πŸ’» 32 Β· πŸ”€ 88 Β· πŸ“¦ 490K Β· πŸ“‹ 67 - 4% open Β· ⏱️ 25.09.2024):

     git clone https://github.com/BurntSushi/aho-corasick
    
memchr (πŸ₯‡23 Β· ⭐ 870) - Optimized string search routines for Rust. Unlicense
  • GitHub (πŸ‘¨β€πŸ’» 43 Β· πŸ”€ 97 Β· πŸ“¦ 630K Β· πŸ“‹ 67 - 8% open Β· ⏱️ 25.09.2024):

     git clone https://github.com/BurntSushi/memchr
    
ollama-rs (πŸ₯‡21 Β· ⭐ 480 Β· πŸ“ˆ) - A Rust library allowing to interact with the Ollama API. MIT
  • GitHub (πŸ‘¨β€πŸ’» 26 Β· πŸ”€ 73 Β· πŸ“¦ 220 Β· πŸ“‹ 34 - 17% open Β· ⏱️ 01.10.2024):

     git clone https://github.com/pepperoni21/ollama-rs
    
grex (πŸ₯‡20 Β· ⭐ 7.2K) - A command-line tool and Rust library with Python bindings for generating.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 10 Β· πŸ”€ 170 Β· πŸ“₯ 45K Β· πŸ“¦ 160 Β· πŸ“‹ 53 - 15% open Β· ⏱️ 01.10.2024):

     git clone https://github.com/pemistahl/grex
    
llama-rs (πŸ₯‡19 Β· ⭐ 6.1K) - [Unmaintained, see README] An ecosystem of Rust libraries for.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 53 Β· πŸ”€ 340 Β· πŸ“₯ 1.2K Β· πŸ“¦ 320 Β· πŸ“‹ 230 - 35% open Β· ⏱️ 24.06.2024):

     git clone https://github.com/rustformers/llama-rs
    
fancy-regex (πŸ₯‡19 Β· ⭐ 420) - Rust library for regular expressions using fancy features like look-.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 24 Β· πŸ”€ 37 Β· πŸ“¦ 11K Β· πŸ“‹ 45 - 31% open Β· ⏱️ 19.07.2024):

     git clone https://github.com/fancy-regex/fancy-regex
    
lindera (πŸ₯‡19 Β· ⭐ 380) - A multilingual morphological analysis library. MIT
  • GitHub (πŸ‘¨β€πŸ’» 18 Β· πŸ”€ 37 Β· πŸ“₯ 2K Β· πŸ“¦ 790 Β· πŸ“‹ 84 - 13% open Β· ⏱️ 01.10.2024):

     git clone https://github.com/lindera-morphology/lindera
    
rust-bert (πŸ₯ˆ18 Β· ⭐ 2.6K) - Rust native ready-to-use NLP pipelines and transformer-based.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 48 Β· πŸ”€ 210 Β· πŸ“¦ 610 Β· πŸ“‹ 220 - 26% open Β· ⏱️ 29.09.2024):

     git clone https://github.com/guillaume-be/rust-bert
    
lingua-rs (πŸ₯ˆ17 Β· ⭐ 880) - The most accurate natural language detection library for Rust,.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 6 Β· πŸ”€ 40 Β· πŸ“¦ 200 Β· πŸ“‹ 54 - 20% open Β· ⏱️ 30.09.2024):

     git clone https://github.com/pemistahl/lingua-rs
    
nnsplit (πŸ₯ˆ17 Β· ⭐ 690) - Toolkit to segment text into sentences or other semantic units in a.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 9 Β· πŸ”€ 38 Β· πŸ“¦ 47 Β· πŸ“‹ 69 - 8% open Β· ⏱️ 24.09.2024):

     git clone https://github.com/bminixhofer/nnsplit
    
sudachi.rs (πŸ₯ˆ17 Β· ⭐ 310) - Sudachi in Rust and new generation of SudachiPy. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 15 Β· πŸ”€ 32 Β· πŸ“₯ 320 Β· πŸ“¦ 1.3K Β· πŸ“‹ 140 - 18% open Β· ⏱️ 28.06.2024):

     git clone https://github.com/WorksApplications/sudachi.rs
    
text-splitter (πŸ₯ˆ16 Β· ⭐ 260) - Split text into semantic chunks, up to a desired chunk size... MIT
  • GitHub (πŸ‘¨β€πŸ’» 6 Β· πŸ”€ 15 Β· πŸ“¦ 150 Β· πŸ“‹ 24 - 25% open Β· ⏱️ 01.10.2024):

     git clone https://github.com/benbrandt/text-splitter
    
aici (πŸ₯ˆ15 Β· ⭐ 1.9K) - AICI: Prompts as (Wasm) Programs. MIT
  • GitHub (πŸ‘¨β€πŸ’» 10 Β· πŸ”€ 79 Β· πŸ“₯ 420 Β· πŸ“‹ 75 - 45% open Β· ⏱️ 13.08.2024):

     git clone https://github.com/microsoft/aici
    
whatlang-rs (πŸ₯ˆ15 Β· ⭐ 970 Β· πŸ’€) - Natural language detection library for Rust. Try demo online:.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 24 Β· πŸ”€ 54 Β· πŸ“‹ 55 - 14% open Β· ⏱️ 16.03.2024):

     git clone https://github.com/greyblake/whatlang-rs
    
rust-tokenizers (πŸ₯ˆ14 Β· ⭐ 290 Β· πŸ’€) - Rust-tokenizer offers high-performance tokenizers for.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 8 Β· πŸ”€ 25 Β· πŸ“¦ 600 Β· πŸ“‹ 11 - 36% open Β· ⏱️ 01.10.2023):

     git clone https://github.com/guillaume-be/rust-tokenizers
    
rust-sbert (πŸ₯ˆ13 Β· ⭐ 100) - Rust port of sentence-transformers.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 6 Β· πŸ”€ 12 Β· πŸ“¦ 6 Β· πŸ“‹ 5 - 20% open Β· ⏱️ 17.09.2024):

     git clone https://github.com/cpcdoy/rust-sbert
    
ungoliant (πŸ₯ˆ12 Β· ⭐ 160 Β· πŸ’€) - The pipeline for the OSCAR corpus. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 7 Β· πŸ”€ 14 Β· πŸ“¦ 7 Β· πŸ“‹ 43 - 41% open Β· ⏱️ 09.11.2023):

     git clone https://github.com/oscar-corpus/ungoliant
    
Show 43 hidden projects...
  • nlprule (πŸ₯ˆ18 Β· ⭐ 590 Β· πŸ’€) - A fast, low-resource Natural Language Processing and Text.. Apache-2
  • rs-natural (πŸ₯ˆ15 Β· ⭐ 230 Β· πŸ’€) - Natural Language Processing for Rust. MIT
  • snips-nlu-rs (πŸ₯ˆ14 Β· ⭐ 340 Β· πŸ’€) - Snips NLU rust implementation. ❗Unlicensed
  • rust-stemmers (πŸ₯ˆ14 Β· ⭐ 110 Β· πŸ’€) - A rust implementation of some popular snowball stemming.. MIT
  • levenshtein-automata (πŸ₯ˆ14 Β· ⭐ 62 Β· πŸ’€) - MIT
  • rustling (πŸ₯ˆ13 Β· ⭐ 76 Β· πŸ’€) - Rust implementation of Duckling. ❗Unlicensed
  • tokenizations (πŸ₯ˆ12 Β· ⭐ 180 Β· πŸ’€) - Robust and Fast tokenizations alignment library for Rust and.. MIT
  • rustling-ontology (πŸ₯ˆ12 Β· ⭐ 130 Β· πŸ’€) - Ontology for rustling. ❗Unlicensed
  • rust-stop-words (πŸ₯ˆ12 Β· ⭐ 19 Β· πŸ’€) - Common stop words in a variety of languages. MIT
  • spm_precompiled (πŸ₯ˆ12 Β· ⭐ 18 Β· πŸ’€) - Highly specialized crate to parse and use.. Apache-2
  • tokengrams (πŸ₯ˆ12 Β· ⭐ 15 Β· βž•) - Efficiently computing & storing token n-grams from large corpora. MIT
  • srx (πŸ₯ˆ12 Β· ⭐ 7 Β· πŸ’€) - A mostly compliant Rust implementation of the Segmentation Rules.. Apache-2
  • deduplicate-text-datasets (πŸ₯‰11 Β· ⭐ 1.1K) - Apache-2
  • rustfst (πŸ₯‰11 Β· ⭐ 140) - Rust re-implementation of OpenFST - library for constructing,.. ❗Unlicensed
  • finalfusion-rust (πŸ₯‰11 Β· ⭐ 92 Β· πŸ’€) - finalfusion embeddings in Rust. ❗Unlicensed
  • snips-nlu-ontology (πŸ₯‰11 Β· ⭐ 57 Β· πŸ’€) - Ontology of Snips NLU. ❗Unlicensed
  • word2vec (πŸ₯‰11 Β· ⭐ 29 Β· πŸ’€) - Rust interface to word2vec. MIT
  • rllama (πŸ₯‰10 Β· ⭐ 540 Β· πŸ’€) - Rust+OpenCL+AVX2 implementation of LLaMA inference code. ❗️AGPL-3.0
  • vtext (πŸ₯‰10 Β· ⭐ 150 Β· πŸ’€) - Simple NLP in Rust with Python bindings. Apache-2
  • finalfrontier (πŸ₯‰10 Β· ⭐ 87 Β· πŸ’€) - Context-sensitive word embeddings with subwords. In.. ❗Unlicensed
  • chr (πŸ₯‰10 Β· ⭐ 40 Β· πŸ’€) - A command-line tool that gives information about Unicode characters. Apache-2
  • dpar (πŸ₯‰9 Β· ⭐ 43 Β· πŸ’€) - Neural network transition-based dependency parser (in Rust). Apache-2
  • sentencepiece (πŸ₯‰9 Β· ⭐ 19 Β· πŸ’€) - Rust binding for the sentencepiece library. ❗Unlicensed
  • rust-tfidf (πŸ₯‰9 Β· ⭐ 17 Β· πŸ’€) - Apache-2
  • snips-nlu-parsers (πŸ₯‰9 Β· ⭐ 16 Β· πŸ’€) - Rust crate for entity parsing. ❗Unlicensed
  • lumberjack (πŸ₯‰9 Β· ⭐ 10 Β· πŸ’€) - Read and modify constituency trees in Rust. Apache-2
  • syntaxdot (πŸ₯‰8 Β· ⭐ 71 Β· πŸ’€) - Neural syntax annotator, supporting sequence labeling,.. ❗Unlicensed
  • fasttext-rs (πŸ₯‰8 Β· ⭐ 55 Β· πŸ’€) - fastText Rust binding. ❗Unlicensed
  • treebender (πŸ₯‰8 Β· ⭐ 43 Β· πŸ’€) - A HDPSG-inspired symbolic natural language parser written in Rust. MIT
  • sticker (πŸ₯‰8 Β· ⭐ 25 Β· πŸ’€) - Succeeded by SyntaxDot: https://github.com/tensordot/syntaxdot. ❗Unlicensed
  • deepfrog (πŸ₯‰8 Β· ⭐ 19 Β· πŸ’€) - An NLP-suite powered by deep learning. ❗️GPL-3.0
  • awabi (πŸ₯‰8 Β· ⭐ 9) - A morphological analyzer using mecab dictionary. MIT
  • gazetteer-entity-parser (πŸ₯‰7 Β· ⭐ 16) - Rust library for parsing and resolving entity values.. ❗Unlicensed
  • alpino-tokenizer (πŸ₯‰7 Β· ⭐ 3 Β· πŸ’€) - Rust wrapper for the Alpino tokenizer. ❗Unlicensed
  • seqalign (πŸ₯‰7 Β· ⭐ 1 Β· πŸ’€) - Sequence alignments. Apache-2
  • word2vec-rs (πŸ₯‰6 Β· ⭐ 78 Β· πŸ’€) - pure rust implemention of word2vec. ❗Unlicensed
  • ollama-rag-rs (πŸ₯‰6 Β· ⭐ 13) - Experimenting with LLMs through Ollama and retrieval augmented.. Apache-2
  • oxidized-transformers (πŸ₯‰5 Β· ⭐ 36) - Modular Rust transformer/LLM library using Candle. ❗Unlicensed
  • rsnltk (πŸ₯‰5 Β· ⭐ 17 Β· πŸ’€) - Rust-based Natural Language Toolkit using Python Bindings. ❗Unlicensed
  • blingfire-rs (πŸ₯‰5 Β· ⭐ 15 Β· πŸ’€) - Rust wrapper for the BlingFire tokenization library. MIT
  • wordpieces (πŸ₯‰5 Β· ⭐ 5 Β· πŸ’€) - Split tokens into word pieces. ❗Unlicensed
  • rustberta-snli (πŸ₯‰4 Β· ⭐ 12 Β· πŸ’€) - A Rust implementation of a RoBERTa classification.. ❗Unlicensed
  • ohnomore (πŸ₯‰4 Β· πŸ’€) - Explorations in lemmatization. ❗Unlicensed

Image Data

Back to top

Libraries for image & video processing, manipulation, augmentation, and visualization as well as libraries for computer vision.

rerun (πŸ₯‡23 Β· ⭐ 6.3K) - Visualize streams of multimodal data. Fast, easy to use, and simple to.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 61 Β· πŸ”€ 300 Β· πŸ“₯ 41K Β· πŸ“¦ 75 Β· πŸ“‹ 3K - 33% open Β· ⏱️ 02.10.2024):

     git clone https://github.com/rerun-io/rerun
    
imageproc (πŸ₯ˆ20 Β· ⭐ 740) - Image processing operations. MIT
  • GitHub (πŸ‘¨β€πŸ’» 78 Β· πŸ”€ 140 Β· πŸ“¦ 5K Β· πŸ“‹ 230 - 25% open Β· ⏱️ 19.09.2024):

     git clone https://github.com/image-rs/imageproc
    
opencv-rust (πŸ₯ˆ17 Β· ⭐ 2K Β· πŸ“‰) - Rust bindings for OpenCV 3 & 4. MIT
  • GitHub (πŸ‘¨β€πŸ’» 51 Β· πŸ”€ 150 Β· πŸ“‹ 520 - 4% open Β· ⏱️ 30.09.2024):

     git clone https://github.com/twistedfall/opencv-rust
    
kornia-rs (πŸ₯‰15 Β· ⭐ 170) - Low-level Computer Vision library in Rust. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 8 Β· πŸ”€ 15 Β· πŸ“¦ 12 Β· πŸ“‹ 52 - 46% open Β· ⏱️ 30.09.2024):

     git clone https://github.com/kornia/kornia-rs
    
Show 8 hidden projects...
  • cgmath (πŸ₯‡22 Β· ⭐ 1.1K Β· πŸ’€) - A linear algebra and mathematics library for computer graphics. Apache-2
  • texture-synthesis (πŸ₯ˆ17 Β· ⭐ 1.8K Β· πŸ’€) - Example-based texture synthesis written in Rust. Apache-2
  • rustface (πŸ₯‰16 Β· ⭐ 390) - Face detection library for the Rust programming language. ❗Unlicensed
  • rust-cv-convert (πŸ₯‰13 Β· ⭐ 43 Β· πŸ’€) - Type conversion among popular Rust computer vision libraries. MIT
  • cv (πŸ₯‰11 Β· ⭐ 830 Β· πŸ’€) - Rust CV mono-repo. Contains pure-Rust dependencies which attempt to.. ❗Unlicensed
  • visionmagic (πŸ₯‰9 Β· ⭐ 57 Β· πŸ’€) - Collection of vision & graphics algorithms. ❗Unlicensed
  • visual-odometry-rs (πŸ₯‰9 Β· ⭐ 53 Β· πŸ’€) - Visual Odometry in Rust (vors). MPL-2.0
  • image-ssd (πŸ₯‰6 Β· ⭐ 5 Β· πŸ’€) - A Rust library for object detection via SSD MobileNet. MIT

Data Loading & Extraction

Back to top

Libraries for loading, collecting, and extracting data from a variety of data sources and formats.

vector (πŸ₯‡28 Β· ⭐ 18K) - A high-performance observability data pipeline. MPL-2.0
  • GitHub (πŸ‘¨β€πŸ’» 450 Β· πŸ”€ 1.5K Β· πŸ“₯ 2.1M Β· πŸ“‹ 7.6K - 23% open Β· ⏱️ 01.10.2024):

     git clone https://github.com/timberio/vector
    
rayon (πŸ₯‡24 Β· ⭐ 11K) - Rayon: A data parallelism library for Rust. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 150 Β· πŸ”€ 480 Β· πŸ“¦ 240K Β· πŸ“‹ 570 - 31% open Β· ⏱️ 19.08.2024):

     git clone https://github.com/rayon-rs/rayon
    
arrow-rs (πŸ₯‡24 Β· ⭐ 2.5K) - Official Rust implementation of Apache Arrow. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 600 Β· πŸ”€ 730 Β· πŸ“¦ 6.9K Β· πŸ“‹ 2.7K - 13% open Β· ⏱️ 02.10.2024):

     git clone https://github.com/apache/arrow-rs
    
rust-csv (πŸ₯‡24 Β· ⭐ 1.7K) - A CSV parser for Rust, with Serde support. Unlicense
  • GitHub (πŸ‘¨β€πŸ’» 53 Β· πŸ”€ 220 Β· πŸ“¦ 83K Β· πŸ“‹ 230 - 24% open Β· ⏱️ 25.09.2024):

     git clone https://github.com/BurntSushi/rust-csv
    
redb (πŸ₯ˆ23 Β· ⭐ 3.2K Β· πŸ“ˆ) - An embedded key-value database in pure Rust. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 23 Β· πŸ”€ 140 Β· πŸ“¦ 650 Β· πŸ“‹ 300 - 2% open Β· ⏱️ 01.10.2024):

     git clone https://github.com/cberner/redb
    
arrow (πŸ₯ˆ22 Β· ⭐ 14K) - Apache Arrow is a multi-language toolbox for accelerated data.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 1.3K Β· πŸ”€ 3.4K Β· πŸ“₯ 410 Β· πŸ“¦ 8 Β· πŸ“‹ 26K - 17% open Β· ⏱️ 02.10.2024):

     git clone https://github.com/apache/arrow
    
lance (πŸ₯ˆ22 Β· ⭐ 3.8K) - Modern columnar data format for ML and LLMs implemented in Rust... Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 70 Β· πŸ”€ 210 Β· πŸ“¦ 2.8K Β· πŸ“‹ 980 - 42% open Β· ⏱️ 01.10.2024):

     git clone https://github.com/eto-ai/lance
    
synth (πŸ₯ˆ22 Β· ⭐ 1.4K) - The Declarative Data Generator. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 32 Β· πŸ”€ 110 Β· πŸ“₯ 13K Β· πŸ“¦ 110 Β· πŸ“‹ 160 - 50% open Β· ⏱️ 27.09.2024):

     git clone https://github.com/openquery-io/synth
    
arrow-datafusion (πŸ₯‰21 Β· ⭐ 6K) - Apache DataFusion SQL Query Engine. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 690 Β· πŸ”€ 1.1K Β· πŸ“¦ 2.7K Β· πŸ“‹ 5.1K - 21% open Β· ⏱️ 02.10.2024):

     git clone https://github.com/apache/arrow-datafusion
    
delta-rs (πŸ₯‰21 Β· ⭐ 2.2K) - A native Rust library for Delta Lake, with bindings into Python. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 190 Β· πŸ”€ 390 Β· πŸ“¦ 400 Β· πŸ“‹ 1.1K - 18% open Β· ⏱️ 30.09.2024):

     git clone https://github.com/delta-io/delta-rs
    
fst (πŸ₯‰21 Β· ⭐ 1.8K) - Represent large sets and maps compactly with finite state transducers. Unlicense
  • GitHub (πŸ‘¨β€πŸ’» 25 Β· πŸ”€ 110 Β· πŸ“¦ 11K Β· πŸ“‹ 88 - 29% open Β· ⏱️ 25.09.2024):

     git clone https://github.com/BurntSushi/fst
    
arroyo (πŸ₯‰19 Β· ⭐ 3.7K) - Distributed stream processing engine in Rust. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 22 Β· πŸ”€ 200 Β· πŸ“₯ 350 Β· πŸ“‹ 140 - 36% open Β· ⏱️ 01.10.2024):

     git clone https://github.com/ArroyoSystems/arroyo
    
kafka-delta-ingest (πŸ₯‰11 Β· ⭐ 360) - A highly efficient daemon for streaming data from Kafka.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 17 Β· πŸ”€ 77 Β· πŸ“‹ 65 - 40% open Β· ⏱️ 18.09.2024):

     git clone https://github.com/delta-io/kafka-delta-ingest
    
Show 8 hidden projects...
  • polars (πŸ₯‡24 Β· ⭐ 30K Β· πŸ“ˆ) - Dataframes powered by a multithreaded, vectorized query.. ❗Unlicensed
  • datafuse (πŸ₯‰18 Β· ⭐ 7.7K) - , & . Modern alternative to Snowflake. Cost-effective and.. ❗Unlicensed
  • datafrog (πŸ₯‰17 Β· ⭐ 800 Β· πŸ’€) - A lightweight Datalog engine in Rust. Apache-2
  • rust-tfrecord (πŸ₯‰12 Β· ⭐ 25 Β· πŸ’€) - A Rust crate that reads and writes tfrecord files. MIT
  • rust-dataframe (πŸ₯‰11 Β· ⭐ 280 Β· πŸ’€) - A Rust DataFrame implementation, built on Apache Arrow. Apache-2
  • tch-serde (πŸ₯‰9 Β· ⭐ 4 Β· πŸ’€) - Serialize/Deserialize tch-rs types with serde. MIT
  • flaco (πŸ₯‰8 Β· ⭐ 15 Β· πŸ’€) - (PoC) A very memory-efficient way to read data from PostgreSQL. Unlicense
  • NewsAggregator (πŸ₯‰7 Β· ⭐ 10 Β· πŸ’€) - A fast, searchable, knowledge engine using various machine.. Apache-2

Graph Data

Back to top

Libraries for graph processing, clustering, embedding, and machine learning tasks.

petgraph (πŸ₯‡25 Β· ⭐ 2.9K) - Graph data structure library for Rust. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 110 Β· πŸ”€ 330 Β· πŸ“¦ 120K Β· πŸ“‹ 310 - 50% open Β· ⏱️ 08.05.2024):

     git clone https://github.com/petgraph/petgraph
    
Raphtory (πŸ₯ˆ19 Β· ⭐ 340) - Scalable graph analytics database powered by a multithreaded,.. ❗️GPL-3.0
  • GitHub (πŸ‘¨β€πŸ’» 30 Β· πŸ”€ 54 Β· πŸ“₯ 340 Β· πŸ“¦ 14 Β· πŸ“‹ 500 - 21% open Β· ⏱️ 02.10.2024):

     git clone https://github.com/Pometry/Raphtory
    
graph-rs (πŸ₯ˆ18 Β· ⭐ 110) - Microsoft Graph API Client And Identity Platform Client in Rust. MIT
  • GitHub (πŸ‘¨β€πŸ’» 16 Β· πŸ”€ 29 Β· πŸ“¦ 57 Β· πŸ“‹ 270 - 6% open Β· ⏱️ 09.09.2024):

     git clone https://github.com/sreeise/graph-rs
    
GraphScope (πŸ₯‰17 Β· ⭐ 3.3K) - GraphScope: A One-Stop Large-Scale Graph Computing System from.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 67 Β· πŸ”€ 400 Β· πŸ“₯ 200 Β· πŸ“‹ 1.6K - 24% open Β· ⏱️ 30.09.2024):

     git clone https://github.com/alibaba/GraphScope
    
Show 2 hidden projects...
  • graphlib (πŸ₯‰16 Β· ⭐ 190 Β· πŸ’€) - Simple but powerful graph library for Rust. MIT
  • propagon (πŸ₯‰4 Β· ⭐ 8 Β· πŸ’€) - Fast, large scale library for computing rankings and features.. ❗Unlicensed

Model Interpretability

Back to top

Libraries to visualize, explain, debug, evaluate, and interpret machine learning models.

Show 1 hidden projects...
  • eval-metrics (πŸ₯‡8 Β· ⭐ 12 Β· πŸ’€) - Evaluation metrics for machine learning. ❗Unlicensed

MLOps

Back to top

Libraries to design workflows, deploy, test, and maintain machine learning pipelines.

mosec (πŸ₯‡17 Β· ⭐ 750) - A high-performance ML model serving framework, offers dynamic batching.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 12 Β· πŸ”€ 51 Β· πŸ“¦ 50 Β· πŸ“‹ 98 - 13% open Β· ⏱️ 28.09.2024):

     git clone https://github.com/mosecorg/mosec
    
Show 2 hidden projects...
  • TensorZero (πŸ₯‰9 Β· ⭐ 140 Β· 🐣) - data & learning flywheel for LLM systems. Apache-2
  • h2o-kubernetes (πŸ₯‰8 Β· ⭐ 21 Β· πŸ’€) - H2O Open Source Kubernetes operator and a command-line.. Apache-2

Applications

Back to top

ML, NLP, or relevant applications.

qdrant (πŸ₯‡28 Β· ⭐ 20K Β· πŸ“ˆ) - Qdrant - High-performance, massive-scale Vector Database for the.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 120 Β· πŸ”€ 1.3K Β· πŸ“₯ 170K Β· πŸ“¦ 110 Β· πŸ“‹ 1.2K - 19% open Β· ⏱️ 23.09.2024):

     git clone https://github.com/qdrant/qdrant
    
MeiliSearch (πŸ₯‡24 Β· ⭐ 47K) - A lightning-fast search API that fits effortlessly into your apps,.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 190 Β· πŸ”€ 1.8K Β· πŸ“₯ 210K Β· πŸ“‹ 2K - 7% open Β· ⏱️ 30.09.2024):

     git clone https://github.com/meilisearch/MeiliSearch
    
tantivy (πŸ₯‡23 Β· ⭐ 12K) - Tantivy is a full-text search engine library inspired by Apache Lucene and.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 150 Β· πŸ”€ 640 Β· πŸ“¦ 1.6K Β· πŸ“‹ 1K - 27% open Β· ⏱️ 25.09.2024):

     git clone https://github.com/tantivy-search/tantivy
    
sonic (πŸ₯ˆ22 Β· ⭐ 20K) - Fast, lightweight & schema-less search backend. An alternative to.. MPL-2.0
  • GitHub (πŸ‘¨β€πŸ’» 44 Β· πŸ”€ 560 Β· πŸ“₯ 410 Β· πŸ“¦ 21 Β· πŸ“‹ 260 - 23% open Β· ⏱️ 22.07.2024):

     git clone https://github.com/valeriansaliou/sonic
    
bloop (πŸ₯ˆ20 Β· ⭐ 9.4K) - bloop is a fast code search engine written in Rust. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 28 Β· πŸ”€ 570 Β· πŸ“₯ 53K Β· πŸ“‹ 140 - 29% open Β· ⏱️ 12.06.2024):

     git clone https://github.com/BloopAI/bloop
    
LlamaEdge (πŸ₯ˆ20 Β· ⭐ 1K) - The easiest & fastest way to run customized and fine-tuned LLMs.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 9 Β· πŸ”€ 85 Β· πŸ“₯ 250K Β· πŸ“¦ 20 Β· πŸ“‹ 97 - 4% open Β· ⏱️ 01.10.2024):

     git clone https://github.com/LlamaEdge/LlamaEdge
    
screenpipe (πŸ₯ˆ17 Β· ⭐ 5.3K Β· 🐣) - 24/7 local AI screen & mic recording. Build AI apps that have the.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 20 Β· πŸ”€ 280 Β· πŸ“₯ 1.6K Β· πŸ“‹ 180 - 29% open Β· ⏱️ 02.10.2024):

     git clone https://github.com/mediar-ai/screenpipe
    
RustQuant (πŸ₯ˆ17 Β· ⭐ 1.1K Β· βž•) - Rust library for quantitative finance. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 40 Β· πŸ”€ 120 Β· πŸ“¦ 18 Β· πŸ“‹ 120 - 22% open Β· ⏱️ 01.10.2024):

     git clone https://github.com/avhz/RustQuant
    
weggli (πŸ₯‰16 Β· ⭐ 2.3K Β· πŸ’€) - weggli is a fast and robust semantic search tool for C and C++.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 10 Β· πŸ”€ 130 Β· πŸ“¦ 86 Β· πŸ“‹ 65 - 56% open Β· ⏱️ 16.01.2024):

     git clone https://github.com/googleprojectzero/weggli
    
lsp-ai (πŸ₯‰16 Β· ⭐ 2.1K Β· βž•) - LSP-AI is an open-source language server that serves as a backend for.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 8 Β· πŸ”€ 72 Β· πŸ“₯ 160 Β· πŸ“‹ 45 - 33% open Β· ⏱️ 25.09.2024):

     git clone https://github.com/SilasMarvin/lsp-ai
    
lnx (πŸ₯‰15 Β· ⭐ 1.2K) - Insanely fast, Feature-rich searching. lnx is the adaptable, typo tollerant.. MIT
  • GitHub (πŸ‘¨β€πŸ’» 9 Β· πŸ”€ 46 Β· πŸ“‹ 78 - 46% open Β· ⏱️ 15.07.2024):

     git clone https://github.com/lnx-search/lnx
    
Toshi (πŸ₯‰13 Β· ⭐ 4.2K Β· πŸ’€) - A full-text search engine in rust. MIT
  • GitHub (πŸ‘¨β€πŸ’» 19 Β· πŸ”€ 130 Β· πŸ“‹ 120 - 11% open Β· ⏱️ 12.10.2023):

     git clone https://github.com/toshi-search/Toshi
    
Show 12 hidden projects...
  • ChatGPT (πŸ₯ˆ21 Β· ⭐ 52K) - ChatGPT Desktop Application (Mac, Windows and Linux). ❗Unlicensed
  • zombodb (πŸ₯ˆ18 Β· ⭐ 4.7K) - Making Postgres and Elasticsearch work together like it's 2023. ❗Unlicensed
  • chat-ai-desktop (πŸ₯ˆ18 Β· ⭐ 2K Β· πŸ’€) - Unofficial ChatGPT desktop app for Mac & Windows menubar.. MIT
  • quickwit (πŸ₯ˆ17 Β· ⭐ 8K) - Cloud-native search engine for observability. An open-source.. ❗Unlicensed
  • milli (πŸ₯ˆ17 Β· ⭐ 460 Β· πŸ’€) - Search engine library for Meilisearch. MIT
  • bayard (πŸ₯‰15 Β· ⭐ 1.9K Β· πŸ’€) - A full-text search and indexing server written in Rust. MIT
  • erdos (πŸ₯‰15 Β· ⭐ 200 Β· πŸ’€) - Dataflow system for building self-driving car and robotics.. Apache-2
  • hora-hora (πŸ₯‰13 Β· ⭐ 2.6K Β· πŸ’€) - efficient approximate nearest neighbor search algorithm.. Apache-2
  • nerve (πŸ₯‰11 Β· ⭐ 480 Β· 🐣) - Instrument any LLM to do actual stuff. ❗Unlicensed
  • voy (πŸ₯‰9 Β· ⭐ 870 Β· πŸ’€) - A WASM vector similarity search written in Rust. Apache-2
  • opentau (πŸ₯‰8 Β· ⭐ 95 Β· πŸ’€) - Using Large Language Models for Repo-wide Type Prediction. Apache-2
  • llamacord (πŸ₯‰7 Β· ⭐ 91 Β· πŸ’€) - A Discord bot, written in Rust, that generates responses using.. ❗️GPL-3.0

Analysis

Back to top

Libraries for analyzing data.

Show 1 hidden projects...
  • vega (πŸ₯‡16 Β· ⭐ 2.2K Β· πŸ’€) - A new arguably faster implementation of Apache Spark from scratch in.. Apache-2

Other

Back to top

Other libraries useful for ML.

Show 2 hidden projects...
  • Rust-CUDA (πŸ₯‡17 Β· ⭐ 3.1K Β· πŸ’€) - Ecosystem of libraries and tools for writing and executing.. Apache-2
  • zkml (πŸ₯‰8 Β· ⭐ 340 Β· πŸ’€) - Apache-2

Others

Back to top

Oxen (πŸ₯‡15 Β· ⭐ 180) - Oxen.ai's core rust library, server, and CLI. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 16 Β· πŸ”€ 11 Β· πŸ“₯ 7.6K Β· πŸ“¦ 1 Β· πŸ“‹ 31 - 38% open Β· ⏱️ 01.10.2024):

     git clone https://github.com/Oxen-AI/Oxen
    
sail (πŸ₯‰10 Β· ⭐ 340 Β· βž•) - LakeSail's computation framework with a mission to unify stream.. Apache-2
  • GitHub (πŸ‘¨β€πŸ’» 4 Β· πŸ”€ 9 Β· πŸ“‹ 27 - 77% open Β· ⏱️ 02.10.2024):

     git clone https://github.com/lakehq/sail
    
Show 1 hidden projects...
  • extractous (πŸ₯‰7 Β· ⭐ 55 Β· 🐣) - Fast and efficient unstructured data extraction. Written in.. Apache-2

Related Resources

Contribution

Contributions are encouraged and always welcome! If you like to add or update projects, choose one of the following ways:

  • Open an issue by selecting one of the provided categories from the issue page and fill in the requested information.
  • Modify the projects.yaml with your additions or changes, and submit a pull request. This can also be done directly via the Github UI.

If you like to contribute to or share suggestions regarding the project metadata collection or markdown generation, please refer to the best-of-generator repository. If you like to create your own best-of list, we recommend to follow this guide.

For more information on how to add or update projects, please read the contribution guidelines. By participating in this project, you agree to abide by its Code of Conduct.

License

CC0

About

πŸ† A ranked list of awesome machine learning Rust libraries.

Resources

License

Code of conduct

Stars

Watchers

Forks

Packages

No packages published