RamaLama v0.25.0 Released: Security and Engine Updates

September 25, 2026

At a Glance

Values determined by this site’s code at collection time. Dates are JST.

Overview

RamaLama is an open-source Python developer tool that simplifies local serving of AI models from any source and facilitates production inference usage through container mechanisms. This v0.25.0 update brings enhanced network security, updated inference engines, and improved environment compatibility.

Notably, the change to the default bind setting for the serve command is an important update for users exposing models over the network. Additionally, caution is advised for those using existing workflows, as specific API transports have been deprecated.

Breaking Changes and Deprecations

This release includes changes to default values and the deprecation of certain features.

The change to the serve command affects users attempting to access the RamaLama server from other machines on the network. Because it binds to loopback (127.0.0.1) by default, external connections will no longer be accepted unless the setting is explicitly changed.

Furthermore, the hosted API transport has been deprecated. If you use systems or scripts that rely on this feature, you should consider migrating to other transport methods in preparation for its eventual removal.

Key Changes

Vulkan Support in NVIDIA Environments

Changes have been made to enable Vulkan for users utilizing NVIDIA GPUs. This provides new options utilizing Vulkan when running inference in NVIDIA environments.

llama.cpp Version Upgrade

llama.cpp, which forms the core of the inference engine, has been updated to v0.4.1. This may improve support for the latest models and the stability of inference processing.

WSL2 and GPU Passthrough Fixes

Multiple fixes related to detection, image selection, and GPU device passthrough in WSL2 environments have been implemented. Operation stability is improved for users utilizing GPU acceleration via the WSL2 backend using Docker Desktop or Podman Desktop on Windows.

Prevention of File Mixing in Snapshots

An issue where GGUF format and safetensors format files could become mixed during snapshot creation has been fixed. This prevents potential inconsistencies that could occur when saving or loading models.

Full Support for Toolbox Environments

Running inside a toolbox using containers is now fully supported. This is suited for users who want to run RamaLama within more isolated environments or specific development container environments.

Podman 6 Support on macOS

When using Podman 6 on macOS, a fix was made so that calls to podman-machine-list function correctly. This impacts users utilizing Podman in macOS environments.

Update to huggingface-hub Dependencies

Dependencies on huggingface-hub have been updated to support the latest version (~=1.32.0). This improves the stability of fetching models from Hugging Face.

Supported Models and Hardware

With this update, the update of the inference engine llama.cpp to v0.4.1 potentially broadens the range of supported model architectures and quantization formats. Furthermore, enabling Vulkan in NVIDIA GPU environments and fixing GPU device passthrough in WSL2 allows for more stable inference leveraging NVIDIA GPUs from container environments on Windows.

How to Update

Updates can be performed using the following commands depending on your environment.

When Using PyPI

pip install --upgrade ramalama

When Using Fedora

sudo dnf upgrade ramalama

When Using the Install Script

curl -fsSL https://ramalama.ai/install.sh | bash

If you are using the .pkg installer on macOS, please download the latest installer from Releases and reinstall.

Releases Since Our Last Article

Compiled by Local Model Watch from the project’s GitHub releases: the versions between this release and the last one we covered, which did not get separate articles. Full history: release tracker.

What to Read Next

• Follow this tool → RamaLama overview and release history (67 releases tracked)
• Other inference engines and runtimes → llama.cpp / Ollama / vLLM

Sources

• containers/ramalama v0.25.0