{"id":17256,"date":"2026-11-17T11:04:59","date_gmt":"2026-11-17T02:04:59","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/model-qwen-qwen3-5-en\/"},"modified":"2026-11-17T11:04:59","modified_gmt":"2026-11-17T02:04:59","slug":"model-qwen-qwen3-5-en","status":"publish","type":"page","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/model-qwen-qwen3-5-en\/","title":{"rendered":"Qwen3.5 Guide: VRAM Requirements, GGUF Builds"},"content":{"rendered":"<p>Everything Local Model Watch has published about the <strong>Qwen3.5<\/strong> family: 8 article(s) covering the base model and its fine-tunes, plus converted builds we tracked after publication. Memory requirements below are computed by this site from file sizes, not quoted from model cards. Part of our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/models-en\/\">model family index<\/a>.<\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Base model(s)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/Qwen\/Qwen3.5-4B-Base\">Qwen\/Qwen3.5-4B-Base<\/a>, <a href=\"https:\/\/huggingface.co\/Qwen\/Qwen3.5-9B-Base\">Qwen\/Qwen3.5-9B-Base<\/a>, <a href=\"https:\/\/huggingface.co\/Qwen\/Qwen3.5-0.8B-Base\">Qwen\/Qwen3.5-0.8B-Base<\/a><\/td>\n<\/tr>\n<tr>\n<td>Publisher<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-alibaba-en\/\">Alibaba (Qwen)<\/a><\/td>\n<\/tr>\n<tr>\n<td>License (model card)<\/td>\n<td>apache-2.0, apple-amlr, mit<\/td>\n<\/tr>\n<tr>\n<td>Smallest VRAM tier<\/td>\n<td>4GB<\/td>\n<\/tr>\n<tr>\n<td>Articles<\/td>\n<td>8<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<h2>Hardware Requirements<\/h2>\n<p><strong>Estimated requirements (calculated by Local Model Watch)<\/strong> \u2014 4.7B parameters (taken from the base model Qwen\/Qwen3.5-4B)<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Your VRAM<\/th>\n<th>Quantization<\/th>\n<th>File size<\/th>\n<th>Est. memory needed<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>4GB (laptop iGPU \/ phone class)<\/td>\n<td>Q4_K_M<\/td>\n<td>2.8GB<\/td>\n<td>3.4GB<\/td>\n<\/tr>\n<tr>\n<td>8GB (RTX 4060 \/ 3060 Ti, etc.)<\/td>\n<td>Q8_0<\/td>\n<td>4.2GB<\/td>\n<td>5.0GB<\/td>\n<\/tr>\n<tr>\n<td>12GB (RTX 4070 \/ 3060 12GB, etc.)<\/td>\n<td>BF16<\/td>\n<td>7.8GB<\/td>\n<td>9.4GB<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model&#8217;s authors. Compare with other models in our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference<\/a>. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<p><em>Figures are for ggml-org\/Qwen3.5-4B-GGUF, the most recent model in this family with a hardware estimate.<\/em><\/p>\n<h2>Can You Run It Locally?<\/h2>\n<p><strong>Runs in Ollama, LM Studio and llama.cpp as-is.<\/strong><\/p>\n<p>It is distributed in GGUF, so no conversion is needed.<\/p>\n<p><strong>License \u2014 <code>apache-2.0<\/code> (Commercial use allowed):<\/strong> Permits commercial use, modification and redistribution. Redistribution requires including the license and stating changes; includes a patent grant.<\/p>\n<p><strong>Compression:<\/strong> the Q4_K_M build measures 5.16 bits per weight \u2014 about 32% the size of the original 16-bit weights, calculated by this site from the actual file sizes.<\/p>\n<p><em>Compiled by this site&#8217;s code from the published formats, converted builds we have found, and each engine&#8217;s own model registry. &#8220;Not found&#8221; means we have not seen such a build, not that none exists. License summaries are not legal advice \u2014 check the publisher&#8217;s original terms before relying on them.<\/em><\/p>\n<p><em>This assessment is for ggml-org\/Qwen3.5-4B-GGUF.<\/em><\/p>\n<h2>Quantized and Converted Variants<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Added<\/th>\n<th>Publisher<\/th>\n<th>Format<\/th>\n<th>Repository<\/th>\n<th>Smallest VRAM tier (build, est. memory)<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>2026-11-17<\/td>\n<td>bartowski<\/td>\n<td>GGUF (imatrix)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/bartowski\/UserRepGen-4B-GGUF\">bartowski\/UserRepGen-4B-GGUF<\/a><\/td>\n<td>Q6_K_S 4.0GB (fits in 4GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-11-17<\/td>\n<td>mradermacher<\/td>\n<td>GGUF<\/td>\n<td><a href=\"https:\/\/huggingface.co\/mradermacher\/UserRepGen-4B-GGUF\">mradermacher\/UserRepGen-4B-GGUF<\/a><\/td>\n<td>Q6_K 3.9GB (fits in 4GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-10-05<\/td>\n<td>ggml-org<\/td>\n<td>GGUF<\/td>\n<td><a href=\"https:\/\/huggingface.co\/ggml-org\/Clef-Flash-GGUF\">ggml-org\/Clef-Flash-GGUF<\/a><\/td>\n<td>Q4_K_M 7.2GB (fits in 8GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-10-03<\/td>\n<td>mlx-community<\/td>\n<td>MLX<\/td>\n<td><a href=\"https:\/\/huggingface.co\/mlx-community\/clef-flash-8bit\">mlx-community\/clef-flash-8bit<\/a><\/td>\n<td>MLX 8bit 11.7GB (fits in 12GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-10-01<\/td>\n<td>bartowski<\/td>\n<td>GGUF (imatrix)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/bartowski\/Cloudflare_clef-flash-GGUF\">bartowski\/Cloudflare_clef-flash-GGUF<\/a><\/td>\n<td>Q5_K_M 7.8GB (fits in 8GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-10-01<\/td>\n<td>mlx-community<\/td>\n<td>MLX<\/td>\n<td><a href=\"https:\/\/huggingface.co\/mlx-community\/clef-flash-4bit\">mlx-community\/clef-flash-4bit<\/a><\/td>\n<td>MLX 4bit 6.6GB (fits in 8GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-09-28<\/td>\n<td>bartowski<\/td>\n<td>GGUF (imatrix)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/bartowski\/LensVLM-9B-GGUF\">bartowski\/LensVLM-9B-GGUF<\/a><\/td>\n<td>IQ2_M 4.0GB (fits in 4GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-09-28<\/td>\n<td>mradermacher<\/td>\n<td>GGUF (imatrix)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/mradermacher\/LensVLM-9B-i1-GGUF\">mradermacher\/LensVLM-9B-i1-GGUF<\/a><\/td>\n<td>IQ2_M 4.0GB (fits in 4GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-09-28<\/td>\n<td>mlx-community<\/td>\n<td>MLX<\/td>\n<td><a href=\"https:\/\/huggingface.co\/mlx-community\/LensVLM-9B-OptiQ-4bit\">mlx-community\/LensVLM-9B-OptiQ-4bit<\/a><\/td>\n<td>MLX 4bit 7.9GB (fits in 8GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-09-26<\/td>\n<td>bartowski<\/td>\n<td>GGUF (imatrix)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/bartowski\/togethercomputer_Tev1-4B-experimental-GGUF\">bartowski\/togethercomputer_Tev1-4B-experimental-GGUF<\/a><\/td>\n<td>Q6_K_S 4.0GB (fits in 4GB VRAM)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>File sizes of each build:<\/p>\n<ul>\n<li>Available builds in bartowski\/UserRepGen-4B-GGUF: IQ2_M 1.5GB \/ Q2_K 1.6GB \/ IQ3_XXS 1.8GB \/ Q3_K_S 1.8GB \/ IQ3_XS 1.8GB \/ Q3_K_M 1.9GB \/ Q3_K_L 2.0GB \/ IQ3_M 2.1GB \/ IQ4_XS 2.3GB \/ Q4_K_S 2.4GB \/ Q4_0 2.5GB \/ IQ4_NL 2.5GB \/ Q4_K_M 2.5GB \/ Q4_1 2.7GB \/ Q4_K_L 2.7GB \/ Q5_K_S 2.9GB \/ Q5_K_M 3.1GB \/ Q6_K_S 3.3GB \/ Q6_K 3.4GB \/ Q6_K_L 3.6GB \/ Q8_0 4.2GB \/ BF16 7.8GB<\/li>\n<li>Available builds in mradermacher\/UserRepGen-4B-GGUF: Q2_K 1.8GB \/ Q3_K_S 1.9GB \/ Q3_K_M 2.1GB \/ Q3_K_L 2.3GB \/ IQ4_XS 2.4GB \/ Q4_K_S 2.4GB \/ Q4_K_M 2.5GB \/ Q5_K_S 2.8GB \/ Q5_K_M 2.9GB \/ Q6_K 3.2GB \/ Q8_0 4.2GB \/ F16 7.8GB<\/li>\n<li>Available builds in ggml-org\/Clef-Flash-GGUF: Q4_K_M 6.0GB \/ Q8_0 9.0GB \/ BF16 16.9GB<\/li>\n<li>Available builds in mlx-community\/clef-flash-8bit: MLX 8bit 9.7GB<\/li>\n<li>Available builds in bartowski\/Cloudflare_clef-flash-GGUF: Q2_K 3.9GB \/ Q3_K_S 4.5GB \/ IQ3_M 4.5GB \/ Q3_K_M 4.7GB \/ Q3_K_L 4.9GB \/ IQ4_XS 5.0GB \/ Q4_0 5.2GB \/ IQ4_NL 5.2GB \/ Q4_K_S 5.3GB \/ Q4_K_M 5.6GB \/ Q4_1 5.7GB \/ Q5_K_S 6.2GB \/ Q4_K_L 6.3GB \/ Q5_K_M 6.5GB \/ Q6_K 7.3GB \/ Q6_K_L 7.8GB \/ Q8_0 9.0GB \/ BF16 16.9GB<\/li>\n<li>Available builds in mlx-community\/clef-flash-4bit: MLX 4bit 5.5GB<\/li>\n<li>Available builds in bartowski\/LensVLM-9B-GGUF: IQ2_M 3.3GB \/ Q2_K 3.4GB \/ IQ3_XXS 3.9GB \/ Q3_K_S 4.0GB \/ IQ3_XS 4.0GB \/ Q3_K_M 4.2GB \/ Q3_K_L 4.3GB \/ IQ3_M 4.5GB \/ IQ4_XS 4.9GB \/ Q4_0 5.1GB \/ Q4_K_S 5.1GB \/ IQ4_NL 5.4GB \/ Q4_K_M 5.4GB \/ Q4_1 5.5GB \/ Q4_K_L 5.8GB \/ Q5_K_S 6.0GB \/ Q5_K_M 6.4GB \/ Q6_K_S 7.0GB \/ Q6_K 7.3GB \/ Q6_K_L 7.5GB \/ Q8_0 8.9GB \/ BF16 16.7GB<\/li>\n<li>Available builds in mradermacher\/LensVLM-9B-i1-GGUF: IQ1_S 2.6GB \/ IQ1_M 2.7GB \/ IQ2_XXS 2.9GB \/ IQ2_XS 3.1GB \/ IQ2_S 3.2GB \/ IQ2_M 3.4GB \/ Q2_K_S 3.4GB \/ Q2_K 3.6GB \/ IQ3_XXS 3.7GB \/ IQ3_XS 4.0GB \/ Q3_K_S 4.0GB \/ IQ3_S 4.1GB \/ IQ3_M 4.1GB \/ Q3_K_M 4.3GB \/ Q3_K_L 4.6GB \/ IQ4_XS 4.8GB \/ Q4_0 5.0GB \/ Q4_K_S 5.0GB \/ IQ4_NL 5.0GB \/ Q4_K_M 5.2GB \/ Q4_1 5.4GB \/ Q5_K_S 5.9GB \/ Q5_K_M 6.0GB \/ Q6_K 6.9GB<\/li>\n<li>Available builds in mlx-community\/LensVLM-9B-OptiQ-4bit: MLX 4bit 6.6GB<\/li>\n<li>Available builds in bartowski\/togethercomputer_Tev1-4B-experimental-GGUF: IQ2_M 1.5GB \/ Q2_K 1.7GB \/ IQ3_XXS 1.8GB \/ Q3_K_S 1.9GB \/ IQ3_XS 1.9GB \/ Q3_K_M 2.0GB \/ Q3_K_L 2.1GB \/ IQ3_M 2.2GB \/ IQ4_XS 2.3GB \/ Q4_K_S 2.4GB \/ Q4_0 2.5GB \/ IQ4_NL 2.6GB \/ Q4_K_M 2.6GB \/ Q4_1 2.7GB \/ Q4_K_L 2.8GB \/ Q5_K_S 2.9GB \/ Q5_K_M 3.1GB \/ Q6_K_S 3.4GB \/ Q6_K 3.5GB \/ Q6_K_L 3.6GB \/ Q8_0 4.3GB \/ BF16 8.1GB<\/li>\n<\/ul>\n<p><em>This section is appended automatically by Local Model Watch when a converted build of this model appears after publication. Memory figures are estimated from the size of the distributed files.<\/em><\/p>\n<h2>Articles (the family&#8217;s own models first, then newest)<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Published<\/th>\n<th>Model<\/th>\n<th>Type<\/th>\n<th>Article<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>2026-11-17<\/td>\n<td>ggml-org\/Qwen3.5-4B-GGUF<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/qwen3-5-4b-gguf-released\/\">Qwen3.5-4B-GGUF Vision-Language Model: 4GB+ VRAM<\/a><\/td>\n<\/tr>\n<tr>\n<td>2026-11-17<\/td>\n<td>inclusionAI\/ZwZ2-4B-GGUF<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/zwz2-4b-gguf-released\/\">ZwZ2-4B-GGUF Vision-Language Model: 4GB+ VRAM<\/a><\/td>\n<\/tr>\n<tr>\n<td>2026-11-17<\/td>\n<td>inclusionAI\/ZwZ2-9B-GGUF<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/zwz2-9b-gguf-released\/\">ZwZ2-9B-GGUF Vision-Language Model: 8GB+ VRAM<\/a><\/td>\n<\/tr>\n<tr>\n<td>2026-11-17<\/td>\n<td>microsoft\/UserRepGen-4B<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/userrepgen-4b\/\">UserRepGen-4B Text Generation Model: 4GB+ VRAM, GGUF Builds<\/a><\/td>\n<\/tr>\n<tr>\n<td>2026-10-02<\/td>\n<td>Cloudflare\/clef-flash<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/10\/02\/clef-flash-specs-performance-and-use-cases\/\">clef-flash Vision-Language Model: Our Test Answers, 4GB+ VRAM<\/a><\/td>\n<\/tr>\n<tr>\n<td>2026-09-28<\/td>\n<td>apple\/LensVLM-9B<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/28\/apple-lensvlm-9b-2\/\">LensVLM-9B Vision-Language Model: 4GB+ VRAM, GGUF Builds<\/a><\/td>\n<\/tr>\n<tr>\n<td>2026-09-26<\/td>\n<td>togethercomputer\/Tev1-0.8B-experimental<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/26\/tev1-08b-experimental-2\/\">Tev1-0.8B-experimental Text Generation Model: 4GB+ VRAM<\/a><\/td>\n<\/tr>\n<tr>\n<td>2026-09-24<\/td>\n<td>togethercomputer\/Tev1-4B-experimental<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/24\/tev1-4b-experimental-released\/\">Tev1-4B-experimental Text Generation Model: 4GB+ VRAM, GGUF Builds<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<h2>Repositories<\/h2>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/Qwen\/Qwen3.5-4B-Base\">Qwen\/Qwen3.5-4B-Base<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/Qwen\/Qwen3.5-9B-Base\">Qwen\/Qwen3.5-9B-Base<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/Qwen\/Qwen3.5-0.8B-Base\">Qwen\/Qwen3.5-0.8B-Base<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/ggml-org\/Qwen3.5-4B-GGUF\">ggml-org\/Qwen3.5-4B-GGUF<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/inclusionAI\/ZwZ2-4B-GGUF\">inclusionAI\/ZwZ2-4B-GGUF<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/inclusionAI\/ZwZ2-9B-GGUF\">inclusionAI\/ZwZ2-9B-GGUF<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/microsoft\/UserRepGen-4B\">microsoft\/UserRepGen-4B<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/Cloudflare\/clef-flash\">Cloudflare\/clef-flash<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/apple\/LensVLM-9B\">apple\/LensVLM-9B<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/togethercomputer\/Tev1-0.8B-experimental\">togethercomputer\/Tev1-0.8B-experimental<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/togethercomputer\/Tev1-4B-experimental\">togethercomputer\/Tev1-4B-experimental<\/a><\/li>\n<\/ul>\n<p><em>Last updated 2026-11-17 (JST). Assembled by code from our article log; no text on this page is written by an AI model.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Everything Local Model Watch has published about the Qwen3.5 family: 8 article(s) covering the base model and its fine-tunes, plus converted builds we tracked after publication. Memory requirements below are computed by this site from file sizes, not quoted from model cards. Part of our model family index. At a Glance Item Value Base model(s) [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-17256","page","type-page","status-publish","hentry"],"lang":"en","translations":{"en":17256,"ja":17255},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/17256","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=17256"}],"version-history":[{"count":0,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/17256\/revisions"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=17256"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}