{"id":13054,"date":"2026-11-17T11:01:59","date_gmt":"2026-11-17T02:01:59","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/?p=13054"},"modified":"2026-11-17T11:11:09","modified_gmt":"2026-11-17T02:11:09","slug":"localai-v4-12-0-released-2","status":"publish","type":"post","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/localai-v4-12-0-released-2\/","title":{"rendered":"LocalAI v4.12.0 Released: Web UI Refresh and Streaming Audio"},"content":{"rendered":"<p><!-- lmw:facts --><\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Repository<\/td>\n<td><a href=\"https:\/\/github.com\/mudler\/LocalAI\">mudler\/LocalAI<\/a><\/td>\n<\/tr>\n<tr>\n<td>Version<\/td>\n<td><a href=\"https:\/\/github.com\/mudler\/LocalAI\/releases\/tag\/v4.12.0\">v4.12.0<\/a><\/td>\n<\/tr>\n<tr>\n<td>Published<\/td>\n<td>2026-10-22<\/td>\n<\/tr>\n<tr>\n<td>License<\/td>\n<td>MIT<\/td>\n<\/tr>\n<tr>\n<td>Source type<\/td>\n<td>Primary source (the publisher itself)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Values determined by this site&#8217;s code when the information was collected. Dates are JST.<\/em><\/p>\n<p><!-- \/lmw:facts --><\/p>\n<h2>Overview<\/h2>\n<p><a href=\"https:\/\/localai.io\">mudler\/LocalAI<\/a> is an open-source AI engine (written in Go under the MIT license) that allows users to run various models locally\u2014including LLMs, vision, audio, image, and video\u2014regardless of hardware.<\/p>\n<p>Version v4.12.0 brings a complete overhaul of the Web UI, streaming audio responses, native decision routing, and advanced control features for model memory and prompt states. With numerous changes to speech synthesis, model behavior, and privacy protection, operational flexibility in local environments is significantly improved, and users utilizing these features are recommended to update.<\/p>\n<h2>Breaking Changes and Deprecations<\/h2>\n<p>Several changes have been made to chat-related endpoints and parameters in this release. The dedicated pickup function for modifying inference load during chats, specifically the individual <code>\/reasoning<\/code> action, has been removed.<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Before<\/th>\n<th>After<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Controlled via <code>\/reasoning<\/code> action<\/td>\n<td>Removed (Integrated into the UI&#8217;s <code>reasoning_effort<\/code> picker)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>This change affects users who previously used fine-grained control over reasoning effort in the chat interface or called <code>\/reasoning<\/code> directly via the API. Moving forward, please use the UI on the chat screen or the integrated parameters.<\/p>\n<h2>Key Changes<\/h2>\n<h3>Web UI Refresh and Improved Model Management<\/h3>\n<p>The Web UI has been redesigned using a common CSS\/SVG kit and an ink\/teal theme, making models and studio workflows much clearer. Remote manual imports are now executed as background gallery jobs, allowing users to track progress, failures, and cancellations.<\/p>\n<p>Model storage aggregation now distinguishes between shared files and model-specific files. Please note that the storage reclaimed upon deletion may not always match the displayed size.<\/p>\n<h3>Streaming Voice and Enhanced Audio Analysis<\/h3>\n<p>For text-to-speech engines like Qwen TTS, a live streaming feature has been added that feeds LLM fragments sequentially to start audio generation early. This enables audio output to begin without waiting for the LLM to complete its full response.<\/p>\n<p>Parakeet audio bundles can now contain multiple roles such as automatic speech recognition (ASR), VAD, and speaker diarization, while also supporting speaker verification via <code>voice_verify_threshold<\/code>. This impacts users building advanced audio-related pipelines.<\/p>\n<h3>Notice Regarding Proprietary Weights<\/h3>\n<p>YuE2, newly added to the audio generation path, is subject to the CC-BY-NC-4.0 license and is restricted to non-commercial use. Users expecting commercial deployment should take note, as it cannot be adopted in such environments.<\/p>\n<h3>Model Memory and Prompt State Control<\/h3>\n<p>Additions include <code>moe_cache_mib<\/code> for caching MoE model experts on the host side, <code>lazy_mode<\/code> to enable lazy loading, and slot saving and restoration functions via <code>\/v1\/slots\/save<\/code> and <code>\/v1\/slots\/restore<\/code>. These allow for memory usage optimization according to workloads and the persistence of prompt states.<\/p>\n<p>Slot persistence functions operate only on POSIX environments, retaining up to 32 save states per model. Saved files are treated as sensitive data, requiring appropriate access management.<\/p>\n<h2>Supported Models and Hardware<\/h2>\n<p>This version expands supported models and hardware across a wide range of fields, including audio\/music generation, image processing, and motion capture.<\/p>\n<h3>Audio and Music Generation Models<\/h3>\n<p>Qwen TTS has introduced the <code>TTSLive<\/code> backend RPC, enabling it to output audio while sequentially receiving generated text from an LLM. This allows for real-time interaction where audio playback starts without waiting for the entire text generation to finish.<\/p>\n<p>The Parakeet model bundling feature now handles multiple roles collectively, including automatic speech recognition (ASR), voice activity detection (VAD), speaker diarization, acoustic event detection for environmental sounds, and a speaker encoder. It also supports voice embeddings using the speaker encoder and matching via cosine distance.<\/p>\n<p>In the music generation domain, YuE2 is now supported in the audio.cpp generation path. However, note that YuE2 model weights are governed by the CC-BY-NC-4.0 license, which prohibits commercial use.<\/p>\n<p>Furthermore, OmniVoice now allows generation time settings (up to 30 seconds) and post-processing parameter controls, while Pocket TTS supports language settings during model loading (e.g., <code>options: [\"language:french\"]<\/code>).<\/p>\n<p>In the model gallery, three streaming assistant presets have been added: <code>qwen3-streaming-assistant<\/code>, <code>vits-streaming-assistant<\/code>, and <code>piper-streaming-assistant<\/code>. Because these provide only pipeline configuration settings, users must separately prepare and install the corresponding LLM, transcription, VAD, and TTS models to run them.<\/p>\n<h3>Image\/Video Processing and Motion Capture Models<\/h3>\n<p>For image processing, a native mode for ESRGAN-based upscaling has been introduced to perform tiling without retaining diffusion model context. This enables memory-efficient high-resolution scaling.<\/p>\n<p>In video and multimedia, MiniMax-H3 now allows reference images, reference videos, and WAV audio to be set as input fields (available via API only in this version).<\/p>\n<p>Additionally, real-time motion capture using GEM-X via the new <code>gemxcpp<\/code> backend has been introduced. Pose data in SOMA-77 or SMPL-24 formats can be extracted in real-time from streamed RGB video frames. The hardware supports CPU and Vulkan, running on CPU on macOS. Note that the use of GEM-X weights is subject to NVIDIA&#8217;s model license terms.<\/p>\n<h3>Vector Databases and Execution Launcher<\/h3>\n<p>For persistent vector management, the <code>qdrant-store<\/code> backend has been added to utilize Qdrant via <code>\/stores\/*<\/code> endpoints. It supports TLS communication, custom certificate authorities, API key configuration via environment variables, and batch write control.<\/p>\n<p>Additionally, a lightweight AppImage launcher for Linux x86_64 has been added to the distribution packages. Running this launcher requires glibc 2.35 or higher and appropriate host graphics libraries installed on the system.<\/p>\n<h2>How to Get It<\/h2>\n<p>Specific commands for updating to LocalAI v4.12.0 are not provided in the distribution materials. Please refer to the official <a href=\"https:\/\/github.com\/mudler\/LocalAI\/releases\/tag\/v4.12.0\">LocalAI v4.12.0 Release Page<\/a> to check update procedures tailored to your deployment format, whether Docker, compilation, or various binary distributions.<\/p>\n<p>If you are deploying the newly provided AppImage launcher in a Linux environment, please ensure beforehand that your environment meets the operational requirements of glibc 2.35 or higher along with the necessary host graphics libraries.<\/p>\n<p><!-- lmw:related --><\/p>\n<h2>Related Articles<\/h2>\n<ul>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/10\/03\/localai-v4-11-0-released\/\">LocalAI v4.11.0 Released with Failover and NeMo Audio Models<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/18\/localai-v4-10-0-released\/\">LocalAI v4.10.0 Released: Fleet Dashboard &amp; M5 Support<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:related --><\/p>\n<p><!-- lmw:next-steps --><\/p>\n<h2>What to Read Next<\/h2>\n<ul>\n<li><strong>Follow this tool<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-localai-en\/\">LocalAI overview and release history (138 releases tracked)<\/a><\/li>\n<li><strong>Other inference engines and runtimes<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-llama-cpp-en\/\">llama.cpp<\/a> \/ <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-ollama-en\/\">Ollama<\/a> \/ <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-vllm-en\/\">vLLM<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:next-steps --><\/p>\n<h2>Sources<\/h2>\n<ul>\n<li><a href=\"https:\/\/github.com\/mudler\/LocalAI\/releases\/tag\/v4.12.0\">mudler\/LocalAI v4.12.0 Release Notes<\/a><\/li>\n<li><a href=\"https:\/\/github.com\/mudler\/LocalAI\/pull\/12497\">PR #12497: fix(model): stop listing a backend that exited on its own<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>LocalAI v4.12.0 is released with a refreshed Web UI, streaming audio response, native decision routing, and advanced memory controls.<\/p>\n","protected":false},"author":1,"featured_media":13053,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[105],"tags":[1507,730,165,1547,213],"class_list":["post-13054","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-engines-and-tools","tag-localai-en","tag-minimax-h3-en","tag-moe-en","tag-verified","tag--en"],"lang":"en","translations":{"en":13054,"ja":13052},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/13054","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=13054"}],"version-history":[{"count":2,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/13054\/revisions"}],"predecessor-version":[{"id":17911,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/13054\/revisions\/17911"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media\/13053"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=13054"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/categories?post=13054"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/tags?post=13054"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}