llama.cpp: Releases and Overview

September 18, 2026

LLM inference engine written in C/C++. Runs GGUF models on CPU and GPU (CUDA / Metal / Vulkan / ROCm) and underpins much of the local-LLM ecosystem, including Ollama, LM Studio and KoboldCpp.

Category: Inference engines and runtimes. Part of our engine and tool tracker.

At a Glance

Item Value
Repository ggml-org/llama.cpp
License MIT
Main language C++
GitHub stars 128,500 (as of 2026-09-17)
Latest release v0.4.1 (2026-09-15)
Install / docs official documentation

The project describes itself as: “LLM inference in C/C++”

Release History

Compiled by Local Model Watch from the project’s GitHub releases. Pre-releases are omitted. Where we wrote an article about a release, it is linked in the last column; smaller releases are tracked here only.

Version Released Release notes Our article
v0.4.1 2026-09-15 GitHub
v0.4.0 2026-09-05 GitHub
v0.3.0 2026-08-25 GitHub

Articles on Local Model Watch

No articles yet.

Last updated 2026-09-18 (JST). Facts above come from the GitHub API; the one-paragraph summary is written by the site’s editors.