{"id":15824,"date":"2026-11-17T11:04:24","date_gmt":"2026-11-17T02:04:24","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/?p=15824"},"modified":"2026-11-17T11:13:42","modified_gmt":"2026-11-17T02:13:42","slug":"zoomgain-9b-gguf-released","status":"publish","type":"post","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/zoomgain-9b-gguf-released\/","title":{"rendered":"ZoomGain-9B-GGUF Vision-Language Model: 8GB+ VRAM"},"content":{"rendered":"<p><!-- lmw:facts --><\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Repository<\/td>\n<td><a href=\"https:\/\/huggingface.co\/inclusionAI\/ZoomGain-9B-GGUF\">inclusionAI\/ZoomGain-9B-GGUF<\/a><\/td>\n<\/tr>\n<tr>\n<td>Family guide<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/model-inclusionai-zoomgain-en\/\">ZoomGain guide (3 articles)<\/a><\/td>\n<\/tr>\n<tr>\n<td>Publisher guide<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-inclusionai-en\/\">inclusionAI (Ant Group): models and licenses<\/a><\/td>\n<\/tr>\n<tr>\n<td>Published<\/td>\n<td>2026-11-11<\/td>\n<\/tr>\n<tr>\n<td>Formats<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-gguf-en\/\">GGUF<\/a><\/td>\n<\/tr>\n<tr>\n<td>Source type<\/td>\n<td>Primary source (the publisher itself)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Values determined by this site&#8217;s code when the information was collected. Dates are JST.<\/em><\/p>\n<p><!-- \/lmw:facts --><\/p>\n<h2>Overview<\/h2>\n<p>inclusionAI has released model weights converted into the GGUF format for the vision-language model &#8220;ZoomGain-9B&#8221;, available as &#8220;<a href=\"https:\/\/huggingface.co\/inclusionAI\/ZoomGain-9B-GGUF\">inclusionAI\/ZoomGain-9B-GGUF<\/a>&#8220;.<\/p>\n<p>ZoomGain-9B-GGUF is an open-weight model converted into the GGUF format using <a href=\"https:\/\/github.com\/ggml-org\/llama.cpp\">llama.cpp<\/a>. It supports multimodal image-text-to-text (vision-language) tasks, accepting both image and text inputs to generate response text. Equipped with multimodal conversational capabilities based on the Qwen3.5 architecture, it is primarily provided for engineers and developers who want to run vision-language models on local PCs or servers.<\/p>\n<p>In this repository, alongside the language model weights themselves, an <code>mmproj<\/code> file containing the vision encoder and projector\u2014which handle image analysis and projection into the language space\u2014is distributed simultaneously. When performing image-input processing during local inference, it is necessary to prepare both the language model&#8217;s GGUF file and its corresponding <code>mmproj<\/code> file, and load them into the execution engine.<\/p>\n<p>Available precision variants include FP16 for full precision, as well as quantized versions Q8_0 and Q4_K_M. These precision options are provided for both the language model and the <code>mmproj<\/code> file, allowing combinations to be chosen according to the memory limitations and computational resources of the execution environment. Note that the model card from the publisher cautions that applying quantization processing may affect the output accuracy of the model. Additionally, execution assumes the use of a build of llama.cpp that supports the multimodal features of Qwen3.5.<\/p>\n<h2>Specifications<\/h2>\n<p>Specifications explicitly stated in the model card and related materials are as follows:<\/p>\n<ul>\n<li>Language model available precisions: FP16, Q8_0, Q4_K_M<\/li>\n<li>Vision encoder and projector (<code>mmproj<\/code>) available precisions: FP16, Q8_0, Q4_K_M<\/li>\n<li>Supported pipeline: image-text-to-text \/ vision-language \/ conversational<\/li>\n<li>Distribution format: GGUF<\/li>\n<\/ul>\n<h2>Strengths and Use Cases<\/h2>\n<p>ZoomGain-9B-GGUF excels at vision-language tasks that simultaneously understand input image content and text instructions to output response text. Specifically, it is designed for use in multimodal conversations such as detailed image descriptions, situation explanations, and answering questions about images.<\/p>\n<p>Featuring image-text processing capabilities based on the Qwen3.5 architecture and converted into the GGUF format, it is well-suited for running inference in local environments using llama.cpp. It can be utilized when running vision-language models on a personal PC or local server without sending images to external cloud services, or for building local web chat systems combined with conversational UIs.<\/p>\n<p>Note that this model consists of weights obtained by quantizing and converting the original ZoomGain-9B model. Users should be aware that quantization processing may potentially impact output accuracy.<\/p>\n<p><!-- lmw:hardware --><\/p>\n<h2>Hardware Requirements<\/h2>\n<p><strong>Estimated requirements (calculated by Local Model Watch)<\/strong><\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Your VRAM<\/th>\n<th>Quantization<\/th>\n<th>File size<\/th>\n<th>Est. memory needed<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>8GB (RTX 4060 \/ 3060 Ti, etc.)<\/td>\n<td>Q4_K_M<\/td>\n<td>5.2GB<\/td>\n<td>6.3GB<\/td>\n<\/tr>\n<tr>\n<td>12GB (RTX 4070 \/ 3060 12GB, etc.)<\/td>\n<td>Q8_0<\/td>\n<td>8.9GB<\/td>\n<td>10.6GB<\/td>\n<\/tr>\n<tr>\n<td>24GB (RTX 4090 \/ 3090, etc.)<\/td>\n<td>F16<\/td>\n<td>16.7GB<\/td>\n<td>20.0GB<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model&#8217;s authors. Compare with other models in our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference<\/a>. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<p><!-- \/lmw:hardware --><\/p>\n<p><!-- lmw:runnability --><\/p>\n<h2>Can You Run It Locally?<\/h2>\n<p><strong>Runs in Ollama, LM Studio and llama.cpp as-is.<\/strong><\/p>\n<p>It is distributed in GGUF, so no conversion is needed.<\/p>\n<p><em>Compiled by this site&#8217;s code from the published formats, converted builds we have found, and each engine&#8217;s own model registry. &#8220;Not found&#8221; means we have not seen such a build, not that none exists.<\/em><\/p>\n<p><!-- \/lmw:runnability --><\/p>\n<p><!-- lmw:lab --><\/p>\n<h2>Our Own Measurements<\/h2>\n<h3>Measurements We Did Not Take<\/h3>\n<p>This model does not state a license, so we cannot confirm permission to use it. Because this site carries advertising, we did not run the model (no CPU run, answers, quantization comparison, conversion or generation).<\/p>\n<p><!-- \/lmw:lab --><\/p>\n<h2>How to Get It<\/h2>\n<p>From the ZoomGain-9B-GGUF repository, the GGUF format language model weights and an <code>mmproj<\/code> file containing the vision encoder and projector are distributed. Obtaining and running inference requires a build of llama.cpp that supports the multimodal features of Qwen3.5.<\/p>\n<p>When performing inference involving image inputs, specify and load the language model file (<code>-m<\/code>) alongside the <code>mmproj<\/code> file (<code>--mmproj<\/code>) of the same or corresponding precision simultaneously.<\/p>\n<p>When running inference in a CLI environment, use <code>llama-mtmd-cli<\/code> as follows:<\/p>\n<pre><code class=\"language-bash\">llama-mtmd-cli \\\n  -m ZoomGain-9B-Q8_0.gguf \\\n  --mmproj mmproj-ZoomGain-9B-Q8_0.gguf \\\n  --image \/path\/to\/image.jpg \\\n  -p &quot;Describe this image.&quot; \\\n  --temp 0 -n 2048\n<\/code><\/pre>\n<p>To operate it as a web chat or API server, start the server using <code>llama-server<\/code>:<\/p>\n<pre><code class=\"language-bash\">llama-server \\\n  -m ZoomGain-9B-Q8_0.gguf \\\n  --mmproj mmproj-ZoomGain-9B-Q8_0.gguf \\\n  --host 127.0.0.1 --port 8080\n<\/code><\/pre>\n<p>By replacing <code>Q8_0<\/code> in the commands with <code>F16<\/code> or <code>Q4_K_M<\/code>, you can select and run the file corresponding to your desired precision.<\/p>\n<p><!-- lmw:related --><\/p>\n<h2>Related Articles<\/h2>\n<ul>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/zoomgain-9b-open-weight-vision-language-model\/\">ZoomGain-9B Fine-Grained Visual Language Model: 8GB+ VRAM, GGUF Builds<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/zwz2-27b-gguf-released\/\">ZwZ2-27B-GGUF Vision-Language Model: 24GB+ VRAM<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/zwz2-9b-gguf-released\/\">ZwZ2-9B-GGUF Vision-Language Model: 8GB+ VRAM<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/zoomgain-4b-fine-grained-vlm\/\">ZoomGain-4B: 4GB+ VRAM, GGUF Builds<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:related --><\/p>\n<p><!-- lmw:next-steps --><\/p>\n<h2>What to Read Next<\/h2>\n<ul>\n<li><strong>Find models by VRAM<\/strong> (This model runs from the 8GB tier) \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-8gb-en\/\">Other models that run on a 8GB GPU<\/a><\/li>\n<li><strong>Explore the same model family<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/model-inclusionai-zoomgain-en\/\">ZoomGain family overview (3 articles, 4 converted builds)<\/a><\/li>\n<li><strong>Engines that run this model<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-llama-cpp-en\/\">llama.cpp<\/a> \/ <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-ollama-en\/\">Ollama<\/a><\/li>\n<li><strong>What Q4_K_M, Q8_0 mean and where to get this model<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-gguf-en\/\">GGUF format guide and models<\/a> \/ <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">Quantization and model-format glossary<\/a><\/li>\n<li><strong>Learn about the publisher<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-inclusionai-en\/\">inclusionAI (Ant Group): models, licenses and articles<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:next-steps --><\/p>\n<h2>Sources<\/h2>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/inclusionAI\/ZoomGain-9B-GGUF\">inclusionAI\/ZoomGain-9B-GGUF<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>inclusionAI has released ZoomGain-9B-GGUF, converting the ZoomGain-9B vision-language model into the GGUF format for local inference with llama.cpp.<\/p>\n","protected":false},"author":1,"featured_media":15823,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[310],"tags":[163,1691,1073,1547,4145,1952,4901,4903],"class_list":["post-15824","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-new-models","tag-gguf-en","tag-inclusionai-en","tag-llama-cpp-en","tag-verified","tag-vision-language-en","tag-vlm-en","tag-zoomgain-en","tag-zoomgain-9b-en"],"lang":"en","translations":{"en":15824,"ja":15822},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/15824","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=15824"}],"version-history":[{"count":2,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/15824\/revisions"}],"predecessor-version":[{"id":18098,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/15824\/revisions\/18098"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media\/15823"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=15824"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/categories?post=15824"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/tags?post=15824"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}