ZwZ2-27B-GGUF Vision-Language Model: 24GB+ VRAM

ZwZ2-27B-GGUF Vision-Language Model: 24GB+ VRAM

At a Glance

Item Value
Repository inclusionAI/ZwZ2-27B-GGUF
Publisher guide inclusionAI (Ant Group): models and licenses
Published 2026-10-30
Formats GGUF
Paper arXiv:2610.37037
Source type Primary source (the publisher itself)

Values determined by this site’s code when the information was collected. Dates are JST.

Overview

-inclusionAI has released “inclusionAI/ZwZ2-27B-GGUF", a GGUF format version of the vision-language multimodal model “ZwZ2-27B". This model is provided as part of the “Zooming without Zooming v2 (ZwZ2)" project, and is a 27B-scale open-weight model built on the Qwen3.6-27B base model. By using GGUF-compatible inference engines such as llama.cpp, users can run multimodal inference on their own PC or local environment.

According to the paper “Zooming without Zooming v2: From Seeing Details to Connecting Evidence for Generalizable Multimodal Perception“, this model aims to improve spatial perception and long-context understanding, which serve as the foundation for Embodied AI and multimodal agents. The development team focused on the ability of “connecting evidence," which identifies related visual facts, ties them to the correct targets, restores their relationships, and leads to answers. It is equipped with the ability to compare, collate, and aggregate visual evidence spanning multiple regions from the entire image and perform multi-step reasoning without using an external zoom tool during inference.

Specifications

  • Parameters: 27.4B
  • Architecture: Qwen3_5ForConditionalGeneration (qwen3_5)
  • Base Model: inclusionAI/ZwZ2-27B (The original base model is Qwen3.6-27B)

Performance

This model is a quantized version converted into GGUF format, and the publishers have noted that the quantization process may affect inference accuracy. Benchmark measurement scores are based on the results published for the original model, “inclusionAI/ZwZ2-27B".

According to the original model card and paper, it is reported that ZwZ2-27B outperformed the base model Qwen3.6-27B across all 25 benchmarks spanning 6 domains. The overall average accuracy (Overall Accuracy) improved by 4.99 points from the base model’s 55.52% to 60.51%. This performance improvement is explained to extend from fine-grained perception and spatial reasoning to long-context understanding, multimodal agents, and general visual reasoning.

Detailed numerical tables for each benchmark are not provided as text in the main model card body, but figures summarizing the representative 8 benchmark highlights and the overall results of all 25 benchmarks have been published. Evaluation tasks include “MMLongBench*" using visual cores consisting of a total of 25 non-count tasks such as V-RAG, Image MM-NIAH, and VH-Multi, showing results that consistently outperform the base model in domain-specific averages and overall averages.

These measurement results are figures published by the publisher inclusionAI itself and are not independent verification results by a third party. Furthermore, as for the training methodology, it is reported that the model used a multi-region question dataset of approximately 20,000 cases automatically generated from SA-1B images through the “EvidenceConnect" framework, and was optimized solely via reinforcement learning using GRPO (Group Relative Policy Optimization) without additional supervised fine-tuning (SFT). When running the GGUF format in a local environment, attention must be paid to the fact that some degradation or variation from the published accuracy of the original model may occur depending on the selected quantization precision (FP16, Q8_0, Q4_K_M, etc.).

Strengths and Use Cases

This model (and its original model) excels at comparing, aggregating, and collating visual evidence spanning multiple regions within an image to perform multi-step reasoning. Specifically, it is suited for the following tasks and uses:

  • Spatial Perception and Spatial Reasoning: The ability to capture positional relationships and spatial features among objects in an image.
  • Multimodal Long-Context Understanding: Understanding visual information with long contexts.
  • Multimodal Agents: Usage as an agent that executes tasks based on visual information.
  • General Visual Reasoning: From fine-grained perception to complex visual logic construction.

The model’s tags include vision-language, image-text-to-text, visual-reasoning, conversational, and others, assuming interactive tasks combining images and text. It is also designed to read information from the entire image without requiring external zoom tools during inference.

Hardware Requirements

Estimated requirements (calculated by Local Model Watch) — 27.4B parameters (taken from the base model inclusionAI/ZwZ2-27B)

Your VRAM Quantization File size Est. memory needed
24GB (RTX 4090 / 3090, etc.) Q4_K_M 15.4GB 18.5GB
32GB (RTX 5090, etc.) Q8_0 26.6GB 32.0GB
80GB class (A100 / H100) F16 50.1GB 60.1GB

Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model’s authors. Compare with other models in our VRAM quick reference. What the quantization names mean: glossary.

Can You Run It Locally?

Runs in Ollama, LM Studio and llama.cpp as-is.

It is distributed in GGUF, so no conversion is needed.

Compression: the Q4_K_M build measures 4.84 bits per weight — about 30% the size of the original 16-bit weights, calculated by this site from the actual file sizes.

Compiled by this site’s code from the published formats, converted builds we have found, and each engine’s own model registry. “Not found" means we have not seen such a build, not that none exists.

Our Own Measurements

Measurements We Did Not Take

This model does not state a license, so we cannot confirm permission to use it. Because this site carries advertising, we did not run the model (no CPU run, answers, quantization comparison, conversion or generation).

Recent Models in the Same Size Class

Models with 15–40B parameters that Local Model Watch covered recently, listed by code from our article log for comparison. VRAM tiers are this site’s estimates; licenses are as stated on the model cards.

→ Scroll horizontally to see all columns

Model Parameters Smallest VRAM tier License Our article
ggml-org/Muse-Glimmer-30B-GGUF 29.8B 24GB apache-2.0 Muse-Glimmer-30B-GGUF 30B Multimodal Local Agent Model: 24GB+ VRAM (2026-11-17)
Cloudflare/clef-omni 35.3B 80GB apache-2.0 clef-omni 30B Multimodal Decision Model: 80GB+ VRAM (2026-11-17)
ggml-org/vllm-d3-GGUF 26.1B 24GB apache-2.0 vllm-d3 GGUF Models Released: Decision Models for Local Run (2026-11-17)
Cloudflare/clef 27.4B 12GB apache-2.0 clef Structured Decision-Making Model: 12GB+ VRAM, GGUF Builds (2026-10-01)
ggml-org/OpenJev-GGUF 27.4B 24GB cc-by-nc-4.0 OpenJev-GGUF 27.4B Decision-Making Specialized Model: 24GB+ VRAM (2026-10-01)

How to Get It

This model is distributed in GGUF format and is available in the following formats:

  • Distribution Format: GGUF
  • Supported Components: The language model body (Language model) and the image processing projector (Vision component / mmproj) are provided as separate files. Depending on the use case, different precisions such as FP16, Q8_0, and Q4_K_M can be combined and used.
  • Supported Engines: Operation is recommended on relatively recent versions of llama.cpp that feature multimodal support for Qwen3.5.

CLI Inference Example

llama-mtmd-cli \
  -m ZwZ2-27B-Q8_0.gguf \
  --mmproj mmproj-ZwZ2-27B-Q8_0.gguf \
  --image /path/to/image.jpg \
  -p "Describe this image." \
  --temp 0 -n 2048

Local API Server Example

llama-server \
  -m ZwZ2-27B-Q8_0.gguf \
  --mmproj mmproj-ZwZ2-27B-Q8_0.gguf \
  --host 127.0.0.1 --port 8080

*Please read file names accordingly based on the precision you use (FP16, Q4_K_M, etc.). When performing image input, you must specify the corresponding mmproj component.

Related Articles

What to Read Next

Sources