From aac9a0bc1d9f3c10be00b7d1f57b0d091e5c9f29 Mon Sep 17 00:00:00 2001 From: Julien Jerphanion Date: Tue, 21 Apr 2026 17:08:05 +0200 Subject: [PATCH 1/2] docs: Add instructions to install `llama.cpp` from conda-forge Signed-off-by: Julien Jerphanion --- README.md | 2 +- docs/install.md | 32 ++++++++++++++++++++++++++++++-- 2 files changed, 31 insertions(+), 3 deletions(-) diff --git a/README.md b/README.md index be23abcea67f..fbf16bc19735 100644 --- a/README.md +++ b/README.md @@ -34,7 +34,7 @@ LLM inference in C/C++ Getting started with llama.cpp is straightforward. Here are several ways to install it on your machine: -- Install `llama.cpp` using [brew, nix or winget](docs/install.md) +- Install `llama.cpp` using [brew, nix, winget, or from conda-forge (using conda, mamba or pixi)](docs/install.md) - Run with Docker - see our [Docker documentation](docs/docker.md) - Download pre-built binaries from the [releases page](https://github.com/ggml-org/llama.cpp/releases) - Build from source by cloning this repository - check out [our build guide](docs/build.md) diff --git a/docs/install.md b/docs/install.md index 7200bf9b7b91..7198e61bf35b 100644 --- a/docs/install.md +++ b/docs/install.md @@ -1,12 +1,40 @@ # Install pre-built version of llama.cpp -| Install via | Windows | Mac | Linux | -|-------------|---------|-----|-------| +| Install via | Windows | Mac | Linux | +|-------------|---------|------|-------| +| conda-forge | ✅ | ✅ | ✅ | | Winget | ✅ | | | | Homebrew | | ✅ | ✅ | | MacPorts | | ✅ | | | Nix | | ✅ | ✅ | +## conda-forge (Windows, Mac and Linux) + +conda-forge provides builds for: + - CUDA (Windows and Linux) + - Vulkan (Windows and Linux) + - Apple Metal (macOS) + +```sh +conda install -c conda-forge llama-cpp +``` + +```sh +mamba install -c conda-forge llama-cpp +``` + +```sh +# Project-local installation +pixi add llama-cpp + +# Global installation +pixi global install llama-cpp +``` + +This distribution is managed on [`conda-forge/llama-cpp-feedstock`](https://github.com/conda-forge/llama.cpp-feedstock/). + +Shall you have any problems, please open an issue on [its issue tracker](https://github.com/conda-forge/llama.cpp-feedstock/issues). + ## Winget (Windows) ```sh From cf0a62a8fe0175f963438e5e62ad1c2622dc1937 Mon Sep 17 00:00:00 2001 From: Julien Jerphanion Date: Mon, 15 Jun 2026 10:25:15 +0200 Subject: [PATCH 2/2] Rewording of instructions Co-authored-by: Georgi Gerganov --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index fbf16bc19735..59cc2c39a0b9 100644 --- a/README.md +++ b/README.md @@ -34,7 +34,7 @@ LLM inference in C/C++ Getting started with llama.cpp is straightforward. Here are several ways to install it on your machine: -- Install `llama.cpp` using [brew, nix, winget, or from conda-forge (using conda, mamba or pixi)](docs/install.md) +- Install `llama.cpp` using [brew, nix, winget, or conda-forge](docs/install.md) - Run with Docker - see our [Docker documentation](docs/docker.md) - Download pre-built binaries from the [releases page](https://github.com/ggml-org/llama.cpp/releases) - Build from source by cloning this repository - check out [our build guide](docs/build.md)