LocalAI v5.0.1 Released: Native Windows Support and ROCm Enhancements

LocalAI v5.0.1 Released: Native Windows Support and ROCm Enhancements

At a Glance

Item Value
Repository mudler/LocalAI
Version v5.0.1
Published 2026-11-21
License MIT
Source type Primary source (the publisher itself)

Values determined by this site’s code when the information was collected. Dates are JST.

Overview

LocalAI, an open-source AI engine, has released version v5.0.1. LocalAI is MIT-licensed software developed in Go that allows users to run generative models for LLM, vision, audio, image, and video tasks on a variety of hardware, including environments without a GPU.

The most significant change for users in this release is the addition of native support for Windows environments. With the server itself and the llama-cpp backend now natively supporting windows/amd64, deployment and operation on Windows have become significantly easier.

Key Changes

Native Windows Support Added

Native support has been added for Windows environments, which previously often required additional configurations or container environments, through the server itself and the llama-cpp backend for windows/amd64 (PR #11429). This greatly improves convenience for users who want to run local LLMs and inference engines directly on Windows. No special configuration migration is required for the update, and direct execution on Windows is now possible.

Improved Model Downloader Safety

The model download process has been modified to retain existing old model files until the new model file is correctly verified (PR #13308). This prevents the risk of previous model files being unexpectedly corrupted or lost in the event of a network disconnection or error during the download. This is a reassuring change for users who frequently update or add models.

Enhanced ROCm (AMD GPU) Support and Bug Fixes

Several enhancements and fixes have been implemented for environments using AMD GPUs. The hipblas image is now built based on ROCm 10.1 by default (PR #13169), and *_TENSILE_LIBPATH has been corrected to properly point to the folder of the installed GPU (PR #13321). Additionally, the privacy-filter now builds a ROCm (hipblas) image (PR #13316). Users running LocalAI in AMD GPU environments can expect resolution of runtime library path-related errors and improved compatibility.

Expanded Platform and Launcher Support

The darwin/arm64 (Apple Silicon Mac) package has been enabled in the sandbox environment (PR #13306). Furthermore, fixes have been applied so that the x64 version of the AppImage can start correctly even in environments without glibc (such as musl-based Linux environments) (PR #13340). This expands the range of operating environments for users who previously faced restrictions on certain Linux distributions or macOS.

Modernization of Major Inference Backends

Various inference libraries used internally by LocalAI have been updated. Specifically, ggml-org/llama.cpp (PR #13284), ggml-org/whisper.cpp (PR #13283), ikawrakow/ik_llama.cpp (PR #13290), mudler/timestral.cpp (PR #13286), 0xShug0/audio.cpp (PR #13282), CrispStrobe/CrispASR (PR #13288), and ServeurpersoCom/omnivoice.cpp (PR #13287) have all been updated to their latest commits. This affects all users running text generation, speech recognition, or text-to-speech models, applying the latest fixes from each upstream project.

UI and Desktop Feature Improvements

Enhancements have been made to the user interface and desktop application features. A desktop notification function for the server inbox has been implemented (PR #13298), and “Custom" labeling and domain display have been added to network options in the UI (PR #13294). Additionally, Bengali (bn) translation has been added for the React UI and add-ons (PR #13304). This improves usability for users operating primarily via the desktop app or Web UI.

Supported Models and Hardware

LocalAI v5.0.1 expands the range of supported hardware environments and backends.

First, native support for Windows has been implemented. With the addition of the llama-cpp backend for the windows/amd64 architecture, llama.cpp-based model inference can now be executed directly on Windows without using containers or similar wrappers (PR #11429).

Support for AMD GPU (ROCm) environments has also been updated. The hipblas image is now built based on ROCm 10.1 by default (PR #13169), and a ROCm (hipblas) image has been added to the build targets for the privacy-filter component (PR #13316). Furthermore, *_TENSILE_LIBPATH has been corrected to properly point to the installed GPU folder (PR #13321). This enables more stable model execution on servers and PCs equipped with AMD GPUs.

Additionally, support for Apple Silicon (macOS) has been improved by enabling the darwin/arm64 package in the sandbox environment (PR #13306).

Regarding the internal inference backends, several major libraries have been updated to their latest versions. Specifically, the following repositories have been updated to their latest commits:

These backend updates allow users to utilize the latest features and fixes in various inference engines for text generation, speech recognition (Whisper, etc.), and text-to-speech models.

How to Get It

Multiple methods are provided for installing and updating LocalAI, depending on your environment. Typical procedures following the official installation guide are as follows:

Using the Installation Script (Linux and Apple Silicon macOS)

This automatically downloads the release binary for your machine, verifies the checksum, and performs the installation. Run the following command in your terminal:

curl -sSL https://localai.io/install.sh | sh
local-ai

The installation script only handles program placement, so run the local-ai command after installation to start the server. Once started, open http://localhost:8080 in your browser.

If you want to start by specifying a model directly, run it with the model name as follows (e.g., the small model for CPU gemma-4-e2b-it-qat-q4_0):

local-ai run gemma-4-e2b-it-qat-q4_0

Using Containers (Docker / podman, etc.)

To run the latest image in a container environment like Docker, use the following command:

docker run -ti --name local-ai -p 8080:8080 localai/localai:latest

To restart an existing container that has already been created, run the following command:

docker start -i local-ai

Using the Desktop App

A desktop application is provided for macOS and Linux. It automatically handles server installation, updates, starting, and stopping, and allows you to view the web interface in a dedicated window. Download it from the latest release page. For detailed usage instructions, refer to the Desktop App Guide.

Related Articles

What to Read Next

Sources