ZwZ2-27B-GGUF Vision-Language Model: 24GB+ VRAM

At a Glance
| Item | Value |
|---|---|
| Repository | inclusionAI/ZwZ2-27B-GGUF |
| Publisher guide | inclusionAI (Ant Group): models and licenses |
| Published | 2026-10-30 |
| Formats | GGUF |
| Paper | arXiv:2610.37037 |
| Source type | Primary source (the publisher itself) |
Values determined by this site’s code when the information was collected. Dates are JST.
Overview
-inclusionAI has released “inclusionAI/ZwZ2-27B-GGUF", a GGUF format version of the vision-language multimodal model “ZwZ2-27B". This model is provided as part of the “Zooming without Zooming v2 (ZwZ2)" project, and is a 27B-scale open-weight model built on the Qwen3.6-27B base model. By using GGUF-compatible inference engines such as llama.cpp, users can run multimodal inference on their own PC or local environment.
According to the paper “Zooming without Zooming v2: From Seeing Details to Connecting Evidence for Generalizable Multimodal Perception“, this model aims to improve spatial perception and long-context understanding, which serve as the foundation for Embodied AI and multimodal agents. The development team focused on the ability of “connecting evidence," which identifies related visual facts, ties them to the correct targets, restores their relationships, and leads to answers. It is equipped with the ability to compare, collate, and aggregate visual evidence spanning multiple regions from the entire image and perform multi-step reasoning without using an external zoom tool during inference.
Specifications
- Parameters: 27.4B
- Architecture: Qwen3_5ForConditionalGeneration (qwen3_5)
- Base Model: inclusionAI/ZwZ2-27B (The original base model is Qwen3.6-27B)
Performance
This model is a quantized version converted into GGUF format, and the publishers have noted that the quantization process may affect inference accuracy. Benchmark measurement scores are based on the results published for the original model, “inclusionAI/ZwZ2-27B".
According to the original model card and paper, it is reported that ZwZ2-27B outperformed the base model Qwen3.6-27B across all 25 benchmarks spanning 6 domains. The overall average accuracy (Overall Accuracy) improved by 4.99 points from the base model’s 55.52% to 60.51%. This performance improvement is explained to extend from fine-grained perception and spatial reasoning to long-context understanding, multimodal agents, and general visual reasoning.
Detailed numerical tables for each benchmark are not provided as text in the main model card body, but figures summarizing the representative 8 benchmark highlights and the overall results of all 25 benchmarks have been published. Evaluation tasks include “MMLongBench*" using visual cores consisting of a total of 25 non-count tasks such as V-RAG, Image MM-NIAH, and VH-Multi, showing results that consistently outperform the base model in domain-specific averages and overall averages.
These measurement results are figures published by the publisher inclusionAI itself and are not independent verification results by a third party. Furthermore, as for the training methodology, it is reported that the model used a multi-region question dataset of approximately 20,000 cases automatically generated from SA-1B images through the “EvidenceConnect" framework, and was optimized solely via reinforcement learning using GRPO (Group Relative Policy Optimization) without additional supervised fine-tuning (SFT). When running the GGUF format in a local environment, attention must be paid to the fact that some degradation or variation from the published accuracy of the original model may occur depending on the selected quantization precision (FP16, Q8_0, Q4_K_M, etc.).
Strengths and Use Cases
This model (and its original model) excels at comparing, aggregating, and collating visual evidence spanning multiple regions within an image to perform multi-step reasoning. Specifically, it is suited for the following tasks and uses:
- Spatial Perception and Spatial Reasoning: The ability to capture positional relationships and spatial features among objects in an image.
- Multimodal Long-Context Understanding: Understanding visual information with long contexts.
- Multimodal Agents: Usage as an agent that executes tasks based on visual information.
- General Visual Reasoning: From fine-grained perception to complex visual logic construction.
The model’s tags include vision-language, image-text-to-text, visual-reasoning, conversational, and others, assuming interactive tasks combining images and text. It is also designed to read information from the entire image without requiring external zoom tools during inference.
Hardware Requirements
Estimated requirements (calculated by Local Model Watch) — 27.4B parameters (taken from the base model inclusionAI/ZwZ2-27B)
| Your VRAM | Quantization | File size | Est. memory needed |
|---|---|---|---|
| 24GB (RTX 4090 / 3090, etc.) | Q4_K_M | 15.4GB | 18.5GB |
| 32GB (RTX 5090, etc.) | Q8_0 | 26.6GB | 32.0GB |
| 80GB class (A100 / H100) | F16 | 50.1GB | 60.1GB |
Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model’s authors. Compare with other models in our VRAM quick reference. What the quantization names mean: glossary.
Can You Run It Locally?
Runs in Ollama, LM Studio and llama.cpp as-is.
It is distributed in GGUF, so no conversion is needed.
Compression: the Q4_K_M build measures 4.84 bits per weight — about 30% the size of the original 16-bit weights, calculated by this site from the actual file sizes.
Compiled by this site’s code from the published formats, converted builds we have found, and each engine’s own model registry. “Not found" means we have not seen such a build, not that none exists.
Our Own Measurements
Measurements We Did Not Take
This model does not state a license, so we cannot confirm permission to use it. Because this site carries advertising, we did not run the model (no CPU run, answers, quantization comparison, conversion or generation).
Recent Models in the Same Size Class
Models with 15–40B parameters that Local Model Watch covered recently, listed by code from our article log for comparison. VRAM tiers are this site’s estimates; licenses are as stated on the model cards.
→ Scroll horizontally to see all columns
| Model | Parameters | Smallest VRAM tier | License | Our article |
|---|---|---|---|---|
| ggml-org/Muse-Glimmer-30B-GGUF | 29.8B | 24GB | apache-2.0 | Muse-Glimmer-30B-GGUF 30B Multimodal Local Agent Model: 24GB+ VRAM (2026-11-17) |
| Cloudflare/clef-omni | 35.3B | 80GB | apache-2.0 | clef-omni 30B Multimodal Decision Model: 80GB+ VRAM (2026-11-17) |
| ggml-org/vllm-d3-GGUF | 26.1B | 24GB | apache-2.0 | vllm-d3 GGUF Models Released: Decision Models for Local Run (2026-11-17) |
| Cloudflare/clef | 27.4B | 12GB | apache-2.0 | clef Structured Decision-Making Model: 12GB+ VRAM, GGUF Builds (2026-10-01) |
| ggml-org/OpenJev-GGUF | 27.4B | 24GB | cc-by-nc-4.0 | OpenJev-GGUF 27.4B Decision-Making Specialized Model: 24GB+ VRAM (2026-10-01) |
How to Get It
This model is distributed in GGUF format and is available in the following formats:
- Distribution Format: GGUF
- Supported Components: The language model body (Language model) and the image processing projector (Vision component /
mmproj) are provided as separate files. Depending on the use case, different precisions such as FP16, Q8_0, and Q4_K_M can be combined and used. - Supported Engines: Operation is recommended on relatively recent versions of
llama.cppthat feature multimodal support for Qwen3.5.
CLI Inference Example
llama-mtmd-cli \
-m ZwZ2-27B-Q8_0.gguf \
--mmproj mmproj-ZwZ2-27B-Q8_0.gguf \
--image /path/to/image.jpg \
-p "Describe this image." \
--temp 0 -n 2048
Local API Server Example
llama-server \
-m ZwZ2-27B-Q8_0.gguf \
--mmproj mmproj-ZwZ2-27B-Q8_0.gguf \
--host 127.0.0.1 --port 8080
*Please read file names accordingly based on the precision you use (FP16, Q4_K_M, etc.). When performing image input, you must specify the corresponding mmproj component.
Related Articles
- ZoomGain-9B-GGUF Vision-Language Model: 8GB+ VRAM
- ZwZ2-4B-GGUF Vision-Language Model: 4GB+ VRAM
- ZwZ2-9B-GGUF Vision-Language Model: 8GB+ VRAM
- Realtime-Venus Full-Duplex Audio-Video Dialog Model: 24GB+ VRAM
What to Read Next
- Find models by VRAM (This model runs from the 24GB tier) → Other models that run on a 24GB GPU
- Engines that run this model → llama.cpp / Ollama
- What Q4_K_M, Q8_0 mean and where to get this model → GGUF format guide and models / Quantization and model-format glossary
- Learn about the publisher → inclusionAI (Ant Group): models, licenses and articles
- Other models for the same task → Other vision-language models

