{"id":4612,"date":"2026-09-26T18:11:15","date_gmt":"2026-09-26T09:11:15","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/2026\/09\/26\/koboldcpp-v1-122-released\/"},"modified":"2026-09-27T17:53:48","modified_gmt":"2026-09-27T08:53:48","slug":"koboldcpp-v1-122-released","status":"publish","type":"post","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/26\/koboldcpp-v1-122-released\/","title":{"rendered":"KoboldCpp v1.122 Released with Built-in Agentic Framework"},"content":{"rendered":"<p><!-- lmw:facts --><\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Repository<\/td>\n<td><a href=\"https:\/\/github.com\/LostRuins\/koboldcpp\">LostRuins\/koboldcpp<\/a><\/td>\n<\/tr>\n<tr>\n<td>Version<\/td>\n<td><a href=\"https:\/\/github.com\/LostRuins\/koboldcpp\/releases\/tag\/v1.122\">v1.122<\/a><\/td>\n<\/tr>\n<tr>\n<td>Published<\/td>\n<td>2026-09-26<\/td>\n<\/tr>\n<tr>\n<td>License<\/td>\n<td>AGPL-3.0<\/td>\n<\/tr>\n<tr>\n<td>Source type<\/td>\n<td>Primary source (the publisher itself)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Values determined by this site&#8217;s code at collection time. Dates are JST.<\/em><\/p>\n<p><!-- \/lmw:facts --><\/p>\n<h2>Overview<\/h2>\n<p>KoboldCpp v1.122, the latest version of the AGPL-3.0 licensed inference engine for running GGUF models with ease, has been released. KoboldCpp operates as a single-binary application and is a C++-based inference environment that includes the browser-accessible KoboldAI UI.<\/p>\n<p>The most significant change in this version is the integration of the lightweight agent foundation &#8220;KoboldCpp Agent&#8221;. Designed with 9 built-in tools and keeping system prompt consumption down to around 2k tokens, it enables the creation of autonomous coding and task execution environments using local LLMs with minimal overhead.<\/p>\n<h2>Breaking Changes and Deprecations<\/h2>\n<p>This release introduces changes to the build script behavior specifications and streamlines several startup flags.<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Old Specification<\/th>\n<th>New Specification (v1.122 and later)<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Portable builds via build script <code>koboldcpp.sh<\/code><\/td>\n<td>Generates portable builds by default<\/td>\n<td>Automatically optimizes for the execution environment. Creating binaries for other environments requires setting the environment variable <code>KCPP_PORTABLE=1<\/code><\/td>\n<\/tr>\n<tr>\n<td>Pipeline parallelism flag<\/td>\n<td>Manually specified via dedicated flag<\/td>\n<td>Flag removed (automatically enabled when <code>ubatch<\/code> is smaller than <code>batchsize<\/code>)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>Maintainers distributing packages via <code>koboldcpp.sh<\/code> and users setting up build pipelines must explicitly set the environment variable <code>KCPP_PORTABLE=1<\/code> to prevent generated binaries from being locked to the execution machine&#8217;s specific optimizations.<\/p>\n<h2>Key Changes<\/h2>\n<h3>Addition of Built-in Agent Feature &#8220;KoboldCpp Agent&#8221;<\/h3>\n<p>A lightweight agent framework acting as an alternative to Opencode, Codex, Claude Code, and others has been bundled directly into KoboldCpp. Featuring 9 built-in tools, it keeps total system prompt consumption including all tool definitions down to approximately 2k tokens.<\/p>\n<p>It can be enabled from the &#8220;Admin&#8221; tab in the GUI launcher or by specifying <code>--agent<\/code> in the startup options. It supports connecting to external OpenAI Chat Completions-compatible endpoints, and tool extension via the Model Context Protocol (MCP) is also possible by loading an <code>mcp.json<\/code> file (MCP tools execute on the KoboldCpp server side, while Agent tools execute on the agent client side). Three approval modes\u2014<code>on<\/code>, <code>auto<\/code>, and <code>off<\/code>\u2014are available for confirming tool calls. To run the agent practically, an environment with at least 28k+ context length, 8k+ generated token count, and 12GB+ VRAM is recommended.<\/p>\n<h3>Independent ubatchsize Setting and Pipeline Parallelism Automation<\/h3>\n<p>Similar to llama.cpp, <code>ubatchsize<\/code> (micro-batch size) can now be specified independently of <code>batchsize<\/code>. Accompanying this, a <code>ubatch<\/code> slider has been added to the GUI, and various slider UIs have been compactly rearranged. In addition, conventional flags for pipeline parallelism have been streamlined, changing to a behavior where they are automatically enabled when the <code>ubatch<\/code> value is set lower than <code>batchsize<\/code>.<\/p>\n<h3>Introduction of Model Swap Control Flag <code>--autoswapthreshold<\/code><\/h3>\n<p>The <code>--autoswapthreshold<\/code> option has been added to specify the size limit that triggers automatic model swapping. This prevents unnecessary memory swaps from occurring when auxiliary smaller models are loaded and used.<\/p>\n<h3>Expansion of Default Context Size and Improved Context Management<\/h3>\n<p>The startup default context size has been increased, and the handling of maximum output generation tokens when approaching the maximum context length is now controlled more intelligently. Furthermore, changes have been made to return error objects if an error occurs during streaming generation, and keep-alive whitespace padding has been added for tool streaming and text synchronization requests.<\/p>\n<h3>Fixes for Image and Music Generation and Stable Diffusion Integration<\/h3>\n<p>Upstream <code>sd.cpp<\/code> synchronization has been incorporated, lowering the SD VAE tiling threshold to 512. Additionally, maximum size limits for image previews have been introduced to properly handle pixel space diffusion models, along with support for audio code generation (two-step processing) when using LLMs for lyrics generation, and improvements to music-related UIs.<\/p>\n<h3>Hardware-Specific Bug Fixes and Optimizations<\/h3>\n<p>The VRAM usage increase issue occurring in P40 environments has been reverted, and smartcache logging suppression during quiet mode operation, fixes to the tool call parser, and updates to Kobold Lite have been implemented.<\/p>\n<h2>Supported Models and Hardware<\/h2>\n<p>KoboldCpp v1.122 supports a wide variety of hardware environments and modern model architectures. By merging the latest improvements from upstream <code>llama.cpp<\/code> and <code>sd.cpp<\/code>, inference stability and supported ranges have been further enhanced.<\/p>\n<h3>Supported Models and Quantization Formats<\/h3>\n<p>This version enables inference for a broad range of LLMs (Large Language Models) provided in the GGUF format. Support for modern model architectures continues to be updated through upstream merges.<\/p>\n<ul>\n<li><strong>Latest Model Support<\/strong>: To make maximum use of the new agent feature, <code>.kcppt<\/code> templates adapted for models such as Qwen 3.6 35BA3B have been released. This allows the latest high-performance models to be utilized as agents immediately.<\/li>\n<li><strong>Image Generation Models<\/strong>: Through <code>sd.cpp<\/code> synchronization, image generation capabilities using Stable Diffusion have been enhanced. The VAE tiling threshold has been lowered to 512, and image preview size limits have been introduced to properly handle pixel space diffusion models.<\/li>\n<li><strong>Quantization Tools<\/strong>: Tool suites for converting and quantizing into the GGUF format are also provided in connection with the project.<\/li>\n<\/ul>\n<h3>Supported Hardware Environments<\/h3>\n<p>Optimized binaries are provided to match users&#8217; environments.<\/p>\n<ul>\n<li><strong>NVIDIA GPU<\/strong>: Standard <code>koboldcpp.exe<\/code> (Windows) and <code>koboldcpp-linux-x64<\/code> (Linux) utilizing CUDA 12 are recommended. Additionally, VRAM usage issues that occurred on specific hardware such as the Tesla P40 have been fixed, improving convenience for users of those GPUs.<\/li>\n<li><strong>Older PCs and Legacy GPUs<\/strong>: An <code>oldpc<\/code> version (CUDA 11 + AVX1) is provided for older NVIDIA GPUs that cannot run the latest CUDA or older CPUs supporting only the AVX1 instruction set.<\/li>\n<li><strong>AMD GPU<\/strong>: In environments without NVIDIA GPUs, using the <strong>Vulkan<\/strong> option with the <code>nocuda<\/code> version is recommended. For Linux environments, a ROCm-supported binary is also provided separately.<\/li>\n<li><strong>Apple Silicon<\/strong>: For modern macOS with chips like M1\/M2\/M3, the <code>koboldcpp-mac-arm64<\/code> binary is provided, enabling high-speed inference utilizing Metal acceleration.<\/li>\n<li><strong>Android<\/strong>: Execution via the Termux environment is officially supported, enabling inference on mobile devices as well.<\/li>\n<\/ul>\n<p>For package maintainers who build and distribute pre-built binaries themselves, the environment variable <code>KCPP_PORTABLE=1<\/code> has been introduced to create environment-agnostic binaries.<\/p>\n<h2>How to Get It<\/h2>\n<p>KoboldCpp is designed around a &#8220;Zero Install&#8221; philosophy, meaning updates can generally be completed simply by downloading a new binary and replacing the existing one.<\/p>\n<h3>Usage on Windows<\/h3>\n<ol>\n<li>Download the latest <code>koboldcpp.exe<\/code> from the releases page.<\/li>\n<li>Run the downloaded file. The GUI launcher will start; select your model, configure settings (such as GPU layer count), and click &#8220;Launch&#8221;.<\/li>\n<li>If you wish to configure detailed settings from the command line, you can check available options with <code>koboldcpp.exe --help<\/code>.<\/li>\n<\/ol>\n<h3>Usage on Linux<\/h3>\n<p>The recommended method is to download the <code>koboldcpp-linux-x64<\/code> prebuilt binary from the releases page. After downloading, grant execution permissions (<code>chmod +x<\/code>) and run it.<\/p>\n<p>To fetch and install the latest version directly from the terminal, the following command can be used:<\/p>\n<pre><code class=\"language-bash\">curl -fLo koboldcpp https:\/\/github.com\/LostRuins\/koboldcpp\/releases\/latest\/download\/koboldcpp-linux-x64-oldpc &amp;&amp; chmod +x koboldcpp\n<\/code><\/pre>\n<p>After installation, you can launch it with <code>.\/koboldcpp<\/code>.<\/p>\n<h3>Usage on Android (Termux)<\/h3>\n<p>If you are using Termux on an Android device, running the following quick setup script will automatically handle everything from installing necessary dependencies to building:<\/p>\n<pre><code class=\"language-bash\">curl -sSL https:\/\/raw.githubusercontent.com\/LostRuins\/koboldcpp\/concedo\/android_install.sh | sh\n<\/code><\/pre>\n<p>If you prefer to build manually, clone the repository and run the <code>make<\/code> command. To create a portable build shareable with other devices, you must build with the <code>LLAMA_PORTABLE=1<\/code> flag.<\/p>\n<p><!-- lmw:releases --><\/p>\n<h2>Releases Since Our Last Article<\/h2>\n<p><em>Compiled by Local Model Watch from the project&#8217;s GitHub releases: the versions between this release and the last one we covered, which did not get separate articles.<\/em> <em>Full history: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-koboldcpp-en\/\">release tracker<\/a>.<\/em><\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Version<\/th>\n<th>Released<\/th>\n<th>Release notes<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>v1.122.1<\/td>\n<td>2026-09-26<\/td>\n<td><a href=\"https:\/\/github.com\/LostRuins\/koboldcpp\/releases\/tag\/v1.122.1\">GitHub<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><!-- \/lmw:releases --><\/p>\n<p><!-- lmw:next-steps --><\/p>\n<h2>What to Read Next<\/h2>\n<ul>\n<li><strong>Follow this tool<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-koboldcpp-en\/\">KoboldCpp overview and release history (132 releases tracked)<\/a><\/li>\n<li><strong>Other inference engines and runtimes<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-llama-cpp-en\/\">llama.cpp<\/a> \/ <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-ollama-en\/\">Ollama<\/a> \/ <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-vllm-en\/\">vLLM<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:next-steps --><\/p>\n<h2>Sources<\/h2>\n<ul>\n<li><a href=\"https:\/\/github.com\/LostRuins\/koboldcpp\/releases\/tag\/v1.122\">https:\/\/github.com\/LostRuins\/koboldcpp\/releases\/tag\/v1.122<\/a><\/li>\n<li><a href=\"https:\/\/github.com\/LostRuins\/koboldcpp\/blob\/concedo\/README.md\">https:\/\/github.com\/LostRuins\/koboldcpp\/blob\/concedo\/README.md<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>KoboldCpp v1.122 is released, featuring the new KoboldCpp Agent, ubatchsize controls, and upstream fixes from llama.cpp and sd.cpp.<\/p>\n","protected":false},"author":1,"featured_media":4611,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[105],"tags":[656,163,1277,1073,1547],"class_list":["post-4612","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-engines-and-tools","tag-ai-agents-en","tag-gguf-en","tag-koboldcpp-en","tag-llama-cpp-en","tag-verified"],"lang":"en","translations":{"en":4612,"ja":4610},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/4612","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=4612"}],"version-history":[{"count":1,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/4612\/revisions"}],"predecessor-version":[{"id":5849,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/4612\/revisions\/5849"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media\/4611"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=4612"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/categories?post=4612"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/tags?post=4612"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}