Qwen3.8 Guide: VRAM Requirements, GGUF Builds

September 28, 2026

About This Model

Qwen3.8 is the series the Qwen team calls “the most capable generation in the Qwen open-model family to date." Its core model, Qwen3.8-27B, is a 27B dense model built as a native vision-language model (VLM) that understands images and video. Built on the Qwen3.5 architecture, it is said to bring substantial gains in coding, professional work, research and long-horizon agentic tasks.

It uses a hybrid layout: of its 64 layers, 48 use linear attention (Gated DeltaNet) and 16 use standard attention (Gated Attention). The native context is 262,144 tokens, extensible to one million tokens with YaRN. Thinking is on by default; it can be disabled per request, and reasoning_effort sets its depth to xhigh, medium or low.

What Makes It Stand Out

1. Agentic coding improved sharply over the previous model of the same size. An excerpt from the publisher’s comparison tables (bold marks the best value in each row):

→ Scroll horizontally to see all columns

Benchmark (category in the model card) Qwen3.8-27B Qwen3.6-27B (previous) Qwen3.7-Plus Opus4.6 Max
SWE-bench Pro (agentic coding) 61.7 53.5 57.6 53.4
DeepSWE 1.1 (agentic coding) 42.2 13.3 14.2 —
Terminal Bench 2.1 (agentic terminal coding) 73.0 63.4 64.0 78.2
LiveCodeBench v6 (competitive coding) 90.3 83.9 89.6 88.8
OSWorld-Verified (computer use) 84.3 63.9 73.3 72.7
WebArena-Verified (browser use) 64.8 48.8 55.3 —
GPQA Diamond (scientific reasoning) 89.2 87.8 90.3 91.3
HLE (multidisciplinary reasoning) 30.8 24.0 34.7 40.0
  • It beats the previous Qwen3.6-27B on every row in the model card. DeepSWE 1.1 more than tripled, from 13.3 to 42.2.
  • It is strongest at tasks where the model has to act and carry the work through to the end. It has the highest score among the compared models on SWE-bench Pro (resolving real GitHub issues), OSWorld-Verified (operating a real OS through its screen) and WebArena-Verified (browser use). On OSWorld-Verified it leads Qwen3.7-Plus and Opus4.6 Max by more than 11 points.

2. It also improved on tasks that involve working from images and video. Vision2Web (building web pages from visuals) rose to 62.9 (previous: 45.0) and SWE-MM (software engineering with images) to 38.6 (previous: 25.7), both the best among the compared models.

Caveats and Weaknesses

  • It does not reach the top models on hard knowledge and reasoning questions. It scores below Qwen3.7-Plus and Opus4.6 Max on GPQA Diamond, and trails Opus4.6 Max by 9.2 points on HLE. On Terminal Bench 2.1 it is also 5.2 points behind Opus4.6 Max.
  • On visual reading and perception, it is level with or slightly behind Qwen3.7-Plus. Document reading (OmniDocBench 1.5: 91.1 vs 91.4) and real-world perception (RealWorldQA: 85.9 vs 86.9) are within one point, but embodied reasoning (ERQA: 65.5 vs 69.8) is 4.3 points lower.
  • Not all scores were measured under the same conditions. For SWE-bench Pro, only Opus4.6 Max uses its officially reported score; the other models were re-evaluated with the Claude Code harness. QwenSWEBench, CoWorkBench and RecreationBench are Qwen’s in-house benchmarks and cannot be reproduced by third parties under the same conditions.

Running It Locally

  • The publisher releases the weights in Transformers format. The model card points to Transformers, vLLM, SGLang and TokenSpeed and does not mention llama.cpp, Ollama or LM Studio. GGUF and MLX builds for those tools come from third parties such as unsloth and lmstudio-community. See the memory requirements table below for which quantization fits which GPU.
  • Thinking is on by default, so outputs are long. For agentic work, the model card recommends allowing up to 262,144 tokens for reasoning and up to 131,072 tokens for the final response. It also warns that in multi-turn tasks, a lower reasoning_effort does not always finish sooner, because shallower analysis can lead to more failures and retries.
  • Enable the one-million-token extension (YaRN) only when you need it. Major engines implement static YaRN, whose scaling factor stays fixed, so leaving it on may hurt performance on shorter texts.
  • The license is Apache-2.0, which allows commercial use.
  • Articles in this family also cover third-party fine-tunes built on Qwen3.8-27B (Qwopus3.8, Signal-3.8, TWIN-TURBO, Salience and others) and Ternary-Bonsai-2, a ternary rebuild. Their weights differ from the official model, so they are separate models; the scores above are for the official Qwen3.8-27B.

Source: Qwen/Qwen3.8-27B model card, as of 2026-09-26. Benchmark figures are as published by the Qwen team.

Our Coverage and Data

Everything Local Model Watch has published about the Qwen3.8 family: 6 article(s) covering the base model and its fine-tunes, plus converted builds we tracked after publication. Memory requirements below are computed by this site from file sizes, not quoted from model cards. Part of our model family index.

At a Glance

Item Value
Base model(s) Qwen/Qwen3.8-27B
Publisher Alibaba (Qwen)
Parameters 27.8B
License (model card) apache-2.0
Smallest VRAM tier 8GB
Articles 6

Hardware Requirements

Estimated requirements (calculated by Local Model Watch) — 27.8B parameters

Your VRAM Quantization File size Est. memory needed
8GB (RTX 4060 / 3060 Ti, etc.) IQ1_M 6.3GB 7.5GB
12GB (RTX 4070 / 3060 12GB, etc.) Q2_K_XL 9.2GB 11.0GB
16GB (RTX 5060 Ti 16GB / 4060 Ti 16GB, etc.) IQ4_XS 13.3GB 15.9GB
24GB (RTX 4090 / 3090, etc.) Q5_K_XL 19.4GB 23.3GB
32GB (RTX 5090, etc.) Q8_K_L 26.1GB 31.3GB
48GB (RTX 6000 Ada / A6000, etc.) Q8_K_XL 29.3GB 35.2GB
80GB class (A100 / H100) BF16 50.9GB 61.1GB

Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model’s authors. File sizes are measured from the converted build unsloth/Qwen3.8-27B-GGUF. Compare with other models in our VRAM quick reference. What the quantization names mean: glossary.

Can You Run It Locally?

Runs in Ollama, LM Studio and llama.cpp via a converted build.

The publisher ships safetensors, but unsloth/Qwen3.8-27B-GGUF provides a GGUF build you can use.

License — apache-2.0 (Commercial use allowed): Permits commercial use, modification and redistribution. Redistribution requires including the license and stating changes; includes a patent grant.

Compression: the IQ4_XS build measures 4.11 bits per weight — about 26% the size of the original 16-bit weights, calculated by this site from the actual file sizes.

Compiled by this site’s code from the published formats, converted builds we have found, and each engine’s own model registry. “Not found" means we have not seen such a build, not that none exists. License summaries are not legal advice — check the publisher’s original terms before relying on them.

Quantized and Converted Variants

→ Scroll horizontally to see all columns

Added Publisher Format Repository Smallest VRAM tier (build, est. memory)
2026-09-26 unsloth GGUF (imatrix) unsloth/Qwen3.8-27B-GGUF IQ1_M 7.5GB (fits in 8GB VRAM)
2026-09-26 Qwen FP8 Qwen/Qwen3.8-27B-FP8 –
2026-09-26 lmstudio-community MLX lmstudio-community/Qwen3.8-27B-MLX-4bit MLX 4bit 17.9GB (fits in 24GB VRAM)
2026-09-26 lmstudio-community MLX lmstudio-community/Qwen3.8-27B-MLX-8bit MLX 8bit 33.0GB (fits in 48GB VRAM)
2026-09-26 unsloth NVFP4 unsloth/Qwen3.8-27B-NVFP4 NVFP4 25.2GB (fits in 32GB VRAM)
2026-09-26 lmstudio-community GGUF lmstudio-community/Qwen3.8-27B-GGUF Q4_K_M 18.8GB (fits in 24GB VRAM)
2026-09-24 prism-ml MLX prism-ml/Ternary-Bonsai-2-27B-mlx-2bit MLX 2bit 9.6GB (fits in 12GB VRAM)
2026-09-18 prism-ml GGUF prism-ml/Ternary-Bonsai-2-27B-gguf-dev Q2_0 8.5GB (fits in 12GB VRAM)

File sizes of each build:

  • Available builds in unsloth/Qwen3.8-27B-GGUF: IQ1_S 5.8GB / IQ1_M 6.3GB / IQ2_XXS 6.8GB / IQ2_S 7.8GB / Q2_K_XL 9.2GB / IQ3_XXS 10.2GB / IQ3_S 11.2GB / Q3_K_XL 12.2GB / IQ4_XS 13.3GB / Q4_K_S 14.3GB / Q4_0 15.0GB / Q4_K_M 15.3GB / Q4_1 16.3GB / Q4_K_XL 16.4GB / Q5_K_S 17.4GB / Q5_K_M 18.4GB / Q5_K_XL 19.4GB / Q6_K 20.5GB / Q6_K_M 21.5GB / Q6_K_L 22.5GB / Q6_K_XL 23.6GB / Q8_K_L 26.1GB / Q8_0 27.1GB / Q8_K_XL 29.3GB / BF16 50.9GB
  • Available builds in lmstudio-community/Qwen3.8-27B-MLX-4bit: MLX 4bit 15.0GB
  • Available builds in lmstudio-community/Qwen3.8-27B-MLX-8bit: MLX 8bit 27.5GB
  • Available builds in unsloth/Qwen3.8-27B-NVFP4: NVFP4 21.0GB
  • Available builds in lmstudio-community/Qwen3.8-27B-GGUF: Q4_K_M 15.7GB / Q6_K 20.9GB / Q8_0 27.1GB
  • Available builds in prism-ml/Ternary-Bonsai-2-27B-mlx-2bit: MLX 2bit 8.0GB
  • Available builds in prism-ml/Ternary-Bonsai-2-27B-gguf-dev: Q2_0 7.1GB

This section is appended automatically by Local Model Watch when a converted build of this model appears after publication. Memory figures are estimated from the size of the distributed files.

Articles (the family’s own models first, then newest)

Published Model Type Article
2026-09-26 Qwen/Qwen3.8-27B New Models Qwen3.8-27B Multimodal Vision-Language Model: 8GB+ VRAM, GGUF Builds
2026-09-18 prism-ml/Ternary-Bonsai-2-27B-gguf New Models Ternary-Bonsai-2-27B-gguf Text Generation Model: 8GB+ VRAM
2026-09-15 bartowski/vectionlabs_Salience-27B-R6-GGUF New Models vectionlabs_Salience-27B-R6-GGUF Vision-Language Model: 12GB+ VRAM
2026-09-13 DavidAU/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-NM-DAU-NEO-MTP-GGUF New Models Qwen3.8-27B TWIN-TURBO Uncensored GGUF Released
2026-09-12 agentionai/Signal-3.8-27B-GGUF New Models Signal-3.8-27B-GGUF Token-Efficient Optimized GGUF Model: 16GB+ VRAM

Repositories

Last updated 2026-09-28 (JST). The explanation at the top of this page was written with the help of AI from the primary sources it cites. The tables and lists under “Our Coverage and Data" are assembled by code from our article log.