{"id":15068,"date":"2026-11-17T11:03:18","date_gmt":"2026-11-17T02:03:18","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/?p=15068"},"modified":"2026-11-17T11:12:54","modified_gmt":"2026-11-17T02:12:54","slug":"ramalama-v0260-released-2","status":"publish","type":"post","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/ramalama-v0260-released-2\/","title":{"rendered":"RamaLama v0.26.0 Released: TLS Support and GPU Detection Updates"},"content":{"rendered":"<p><!-- lmw:facts --><\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Repository<\/td>\n<td><a href=\"https:\/\/github.com\/containers\/ramalama\">containers\/ramalama<\/a><\/td>\n<\/tr>\n<tr>\n<td>Version<\/td>\n<td><a href=\"https:\/\/github.com\/containers\/ramalama\/releases\/tag\/v0.26.0\">v0.26.0<\/a><\/td>\n<\/tr>\n<tr>\n<td>Published<\/td>\n<td>2026-11-04<\/td>\n<\/tr>\n<tr>\n<td>License<\/td>\n<td>MIT<\/td>\n<\/tr>\n<tr>\n<td>Source type<\/td>\n<td>Primary source (the publisher itself)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Values determined by this site&#8217;s code when the information was collected. Dates are JST.<\/em><\/p>\n<p><!-- \/lmw:facts --><\/p>\n<h2>Overview<\/h2>\n<p>Version v0.26.0 of containers\/ramalama has been released. RamaLama is an open-source development tool written in Python under the MIT license that leverages container technology to simplify local AI model serving from various sources and production inference processing.<\/p>\n<p>This v0.26.0 release introduces significant functional additions and improvements affecting user operations and security, such as added TLS communication support in llama.cpp and vLLM, extended API key settings for RAG pipelines, and optimized GPU detection processing.<\/p>\n<h2>Key Changes<\/h2>\n<h3>Added TLS Support in llama.cpp and vLLM<\/h3>\n<p>TLS communication has been enabled in both the llama.cpp and vLLM backends. This allows for the encryption of communication paths for model inference servers. This affects users who want to serve local models while ensuring network security. Communication encryption settings can now be configured to match operational environments.<\/p>\n<h3>Extended API Key Management and Improved llama.cpp Router Mode<\/h3>\n<p>API keys for llama.cpp can now be output from the CLI, and the scope of the <code>--api-key<\/code> option has been extended to RAG pipelines. Additionally, a fix ensures that the <code>--generate<\/code> option is properly respected when running llama.cpp in router mode. This affects users building API environments or RAG pipelines that require authentication for inference. After updating, API keys specified during command execution are passed across all related pipelines.<\/p>\n<h3>Optimized GPU Detection and Expanded Information Display<\/h3>\n<p>The specification has been changed to automatically skip GPU detection processing when running subcommands that do not require it. Concurrently, the output of the <code>ramalama info<\/code> command now includes information on identified GPU and accelerator devices. Furthermore, an issue where GPU detection crashed on Windows environments without Podman installed has been resolved. Omitting unnecessary detection processing reduces command execution overhead and makes it easier to verify accessible hardware configurations.<\/p>\n<h3>RAG Feature and Networking Bug Fixes<\/h3>\n<p>Bugs related to port management and detach processing when using the <code>--rag<\/code> option, as well as an off-by-one error in port validation, have been fixed. Handling of <code>model_alias<\/code> for models specified in HTTP or HTTPS URL formats has also been improved. This affects users utilizing RAG features or operating by loading models directly from web URLs.<\/p>\n<h3>Backend llama.cpp Version Update<\/h3>\n<p>The internally used llama.cpp version has been bumped to v0.8.0 via v0.7.0. This affects all users running inference using llama.cpp as a backend. No special re-conversion or reconfiguration is required; users can update directly to use the new llama.cpp backend features.<\/p>\n<h2>Supported Models and Hardware<\/h2>\n<p>This version updates container environments and inference engines with hardware accelerator support.<\/p>\n<p>First, the Docker image tag (<code>quay.io\/ascend\/cann<\/code>) for Huawei&#8217;s NPU (Neural Processing Unit) development toolkit, Ascend CANN (Compute Architecture for Neural Networks), has been updated to v9.2.0. This enables inference execution utilizing the latest CANN v9.2.0 runtime when running RamaLama containers on hardware environments equipped with Ascend accelerators. Users serving local models in Ascend hardware environments can build more stable inference environments thanks to the updated container base image.<\/p>\n<p>In addition, the output of the system information command <code>ramalama info<\/code> has been expanded to include detailed information on detected GPUs and various accelerator devices in the report. Hardware devices recognized from the container side, such as NVIDIA CUDA-enabled GPUs, AMD HIP-enabled GPUs, Intel accelerators, and Ascend NPUs, are enumerated. This allows users to easily verify whether accelerators are properly recognized and passed through to the container in their execution environment.<\/p>\n<p>Furthermore, with the internal inference engine llama.cpp updated to v0.8.0, it supports loading and running inference on various GGUF quantized model architectures supported by the latest llama.cpp. Environments operating existing GGUF models can execute inference using the updated engine without requiring special re-conversion or re-downloading of model files.<\/p>\n<h2>How to Get It<\/h2>\n<p>RamaLama can be updated using methods tailored to your operating system and deployment format. The main installation and update procedures are as follows:<\/p>\n<h3>Updating via pip (PyPI)<\/h3>\n<p>If you installed using Python&#8217;s package management tool <code>pip<\/code>, or in a Windows environment (using the WSL2 backend of Docker Desktop or Podman Desktop), use the <code>pip<\/code> command to update to the latest version.<\/p>\n<pre><code class=\"language-bash\">pip install --upgrade ramalama\n<\/code><\/pre>\n<p>The standard command for a fresh installation is:<\/p>\n<pre><code class=\"language-bash\">pip install ramalama\n<\/code><\/pre>\n<h3>Updating on Fedora<\/h3>\n<p>If you installed from the Fedora package repository, use the <code>dnf<\/code> package manager to update.<\/p>\n<pre><code class=\"language-bash\">sudo dnf upgrade ramalama\n<\/code><\/pre>\n<p>For a fresh installation, run the following command:<\/p>\n<pre><code class=\"language-bash\">sudo dnf install ramalama\n<\/code><\/pre>\n<h3>Updating via Installation Script (Linux \/ macOS)<\/h3>\n<p>If you are using the official installation script on Linux or macOS environments, you can fetch and install the latest version of RamaLama by running the following <code>curl<\/code> command:<\/p>\n<pre><code class=\"language-bash\">curl -fsSL https:\/\/ramalama.ai\/install.sh | bash\n<\/code><\/pre>\n<h3>Updating via Standalone macOS Installer (.pkg)<\/h3>\n<p>If you use a self-contained installer containing Python and dependency packages on macOS, download the latest <code>.pkg<\/code> installer from the GitHub releases page. After downloading, double-click the file and follow the dialogs to install, or run the following command in the terminal to apply it to your system:<\/p>\n<pre><code class=\"language-bash\">sudo installer -pkg RamaLama-*-macOS-Installer.pkg -target \/\n<\/code><\/pre>\n<p><!-- lmw:related --><\/p>\n<h2>Related Articles<\/h2>\n<ul>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/25\/ramalama-v0-25-0-released\/\">RamaLama v0.25.0 Released: Security and Engine Updates<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/nvidia-dory-1-0-4b-recurrent-llm\/\">NVIDIA Releases Dory1.0-4B: A Recurrent 4B LLM with Dynamic Loops<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/minicpm-v-4-7-1b-dspark-gguf-released\/\">MiniCPM-V-4.7-1B-DSpark-gguf Text Generation Model: 4GB+ VRAM<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/minicpm-v-4-7-35b-a3b-dspark-gguf-2\/\">MiniCPM-V-4.7-35B-A3B-DSpark-gguf Draft Model for Speedup: 4GB+ VRAM<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:related --><\/p>\n<p><!-- lmw:next-steps --><\/p>\n<h2>What to Read Next<\/h2>\n<ul>\n<li><strong>Follow this tool<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-ramalama-en\/\">RamaLama overview and release history (68 releases tracked)<\/a><\/li>\n<li><strong>Other inference engines and runtimes<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-llama-cpp-en\/\">llama.cpp<\/a> \/ <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-ollama-en\/\">Ollama<\/a> \/ <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-vllm-en\/\">vLLM<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:next-steps --><\/p>\n<h2>Sources<\/h2>\n<ul>\n<li><a href=\"https:\/\/github.com\/containers\/ramalama\/releases\/tag\/v0.26.0\">containers\/ramalama v0.26.0<\/a><\/li>\n<li><a href=\"https:\/\/github.com\/containers\/ramalama\/pull\/2975\">Update quay.io\/ascend\/cann Docker tag to v9.2.0<\/a><\/li>\n<li><a href=\"https:\/\/github.com\/containers\/ramalama\/pull\/2986\">Bump llama.cpp to v0.8.0<\/a><\/li>\n<li><a href=\"https:\/\/github.com\/containers\/ramalama\/pull\/2584\">Report GPU\/accelerator devices in ramalama info<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>containers\/ramalama v0.26.0 is out, featuring TLS support for llama.cpp and vLLM, API key extensions, and GPU detection improvements.<\/p>\n","protected":false},"author":1,"featured_media":15067,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[105],"tags":[2300,163,1073,2302,1547,592],"class_list":["post-15068","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-engines-and-tools","tag-containers-en","tag-gguf-en","tag-llama-cpp-en","tag-ramalama-en","tag-verified","tag-vllm-en"],"lang":"en","translations":{"en":15068,"ja":15066},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/15068","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=15068"}],"version-history":[{"count":2,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/15068\/revisions"}],"predecessor-version":[{"id":18042,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/15068\/revisions\/18042"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media\/15067"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=15068"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/categories?post=15068"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/tags?post=15068"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}