Retrieval Augmented Generation with Llamafile, LanceDB in Rust

Note, this is WIP. I try to avoid building abstractions too early.

Useful Commands

Start Ollama in the background and log outputs.

nohup ollama serve > ~/Repos/rag-rs/logs/ollama_serve.log 2>&1 &

Install protobuf for LanceDB

brew install protobuf

License Notice

The Rust Book is licensed under MIT and Apache License 2.0. The Rust Book was downloaded as pdf from here: https://doc.rust-lang.org/book/print.html and converted to txt via:

# brew install poppler

pdftotext .data/2024-02-13_the_rust_book.pdf knowledge/2024-02-13_the_rust_book.txt