{"id":17274,"date":"2026-11-17T11:05:03","date_gmt":"2026-11-17T02:05:03","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/model-inclusionai-ling-3-1-en\/"},"modified":"2026-11-17T11:05:03","modified_gmt":"2026-11-17T02:05:03","slug":"model-inclusionai-ling-3-1-en","status":"publish","type":"page","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/model-inclusionai-ling-3-1-en\/","title":{"rendered":"Ling-3.1 Guide: VRAM Requirements, GGUF Builds"},"content":{"rendered":"<p>Everything Local Model Watch has published about the <strong>Ling-3.1<\/strong> family: 3 article(s) covering the base model and its fine-tunes, plus converted builds we tracked after publication. Memory requirements below are computed by this site from file sizes, not quoted from model cards. Part of our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/models-en\/\">model family index<\/a>.<\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Base model(s)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/inclusionAI\/Ling-3.1-flash-base\">inclusionAI\/Ling-3.1-flash-base<\/a>, <a href=\"https:\/\/huggingface.co\/inclusionAI\/Ling-3.1-flash-1019\">inclusionAI\/Ling-3.1-flash-1019<\/a>, <a href=\"https:\/\/huggingface.co\/inclusionAI\/Ling-3.1-flash\">inclusionAI\/Ling-3.1-flash<\/a><\/td>\n<\/tr>\n<tr>\n<td>Publisher<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-inclusionai-en\/\">inclusionAI (Ant Group)<\/a><\/td>\n<\/tr>\n<tr>\n<td>License (model card)<\/td>\n<td>mit<\/td>\n<\/tr>\n<tr>\n<td>Articles<\/td>\n<td>3<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<h2>Hardware Requirements<\/h2>\n<p><strong>Estimated requirements (calculated by Local Model Watch)<\/strong> \u2014 572.1B parameters<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Your VRAM<\/th>\n<th>Quantization<\/th>\n<th>File size<\/th>\n<th>Est. memory needed<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>More than 1279GB of VRAM (multi-GPU or CPU offload required)<\/td>\n<td>F32<\/td>\n<td>1065.7GB<\/td>\n<td>1278.8GB<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model&#8217;s authors. The listed files are distributed in F32 (32-bit). Loading in a lower precision (BF16 or quantized) needs less memory, so treat this as the size of the files as distributed, not a minimum. This site has not measured the lower-precision figures. Compare with other models in our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference<\/a>. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<p><em>Figures are for inclusionAI\/Ling-3.1-flash-base. Other sizes in this family are covered in the articles below.<\/em><\/p>\n<h2>Can You Run It Locally?<\/h2>\n<p><strong>Not usable in Ollama, LM Studio and llama.cpp yet \u2014 we have found no GGUF build.<\/strong><\/p>\n<p>The publisher ships safetensors only. However, llama.cpp&#8217;s registry does list this architecture, so <strong>conversion to GGUF is possible<\/strong> and the model will run once someone publishes a converted build. Today it can be run with transformers or vLLM, using the memory figures in the table above.<\/p>\n<p><strong>License \u2014 <code>mit<\/code> (Commercial use allowed):<\/strong> Permits commercial use, modification and redistribution, provided the copyright notice and license text are retained.<\/p>\n<p><em>Compiled by this site&#8217;s code from the published formats, converted builds we have found, and each engine&#8217;s own model registry. &#8220;Not found&#8221; means we have not seen such a build, not that none exists. License summaries are not legal advice \u2014 check the publisher&#8217;s original terms before relying on them.<\/em><\/p>\n<p><em>This assessment is for inclusionAI\/Ling-3.1-flash-base.<\/em><\/p>\n<h2>Quantized and Converted Variants<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Added<\/th>\n<th>Publisher<\/th>\n<th>Format<\/th>\n<th>Repository<\/th>\n<th>Smallest VRAM tier (build, est. memory)<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>2026-11-17<\/td>\n<td>bartowski<\/td>\n<td>GGUF (imatrix)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/bartowski\/Ling-3.1-flash-1019-GGUF\">bartowski\/Ling-3.1-flash-1019-GGUF<\/a><\/td>\n<td>IQ1_S 146.4GB (does not fit a single consumer GPU)<\/td>\n<\/tr>\n<tr>\n<td>2026-11-17<\/td>\n<td>mlx-community<\/td>\n<td>MLX (imatrix)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/mlx-community\/Ling-3.1-flash-1019-oQ4e-mtp\">mlx-community\/Ling-3.1-flash-1019-oQ4e-mtp<\/a><\/td>\n<td>MLX 4bit 368.9GB (does not fit a single consumer GPU)<\/td>\n<\/tr>\n<tr>\n<td>2026-11-17<\/td>\n<td>mlx-community<\/td>\n<td>MLX (imatrix)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/mlx-community\/Ling-3.1-flash-1019-oQ2e-mtp\">mlx-community\/Ling-3.1-flash-1019-oQ2e-mtp<\/a><\/td>\n<td>MLX 2bit 215.9GB (does not fit a single consumer GPU)<\/td>\n<\/tr>\n<tr>\n<td>2026-11-17<\/td>\n<td>inclusionAI<\/td>\n<td>FP8<\/td>\n<td><a href=\"https:\/\/huggingface.co\/inclusionAI\/Ling-3.1-flash-1019\">inclusionAI\/Ling-3.1-flash-1019<\/a><\/td>\n<td>FP8 641.3GB (does not fit a single consumer GPU)<\/td>\n<\/tr>\n<tr>\n<td>2026-11-17<\/td>\n<td>bartowski<\/td>\n<td>GGUF (imatrix)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/bartowski\/Ling-3.1-flash-GGUF\">bartowski\/Ling-3.1-flash-GGUF<\/a><\/td>\n<td>IQ1_S 146.4GB (does not fit a single consumer GPU)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>File sizes of each build:<\/p>\n<ul>\n<li>Available builds in bartowski\/Ling-3.1-flash-1019-GGUF: IQ1_S 122.0GB \/ IQ1_M 135.1GB \/ IQ2_XXS 159.1GB \/ IQ2_XS 165.2GB \/ IQ2_S 175.5GB \/ IQ2_M 198.4GB \/ Q2_K 204.1GB \/ IQ3_XXS 230.4GB \/ IQ3_XS 242.5GB \/ Q3_K_S 243.6GB \/ Q3_K_M 256.2GB \/ Q3_K_L 268.2GB \/ IQ3_M 276.9GB \/ IQ4_XS 295.3GB \/ Q4_0 304.2GB \/ Q4_K_S 313.5GB \/ Q4_K_M 333.4GB \/ IQ4_NL 333.4GB \/ Q4_1 335.4GB \/ Q5_K_S 378.2GB \/ Q5_K_M 406.4GB \/ Q6_K_S 445.9GB \/ Q6_K 467.1GB \/ Q8_0 566.6GB<\/li>\n<li>Available builds in mlx-community\/Ling-3.1-flash-1019-oQ4e-mtp: MLX 4bit 307.4GB<\/li>\n<li>Available builds in mlx-community\/Ling-3.1-flash-1019-oQ2e-mtp: MLX 2bit 179.9GB<\/li>\n<li>Available builds in inclusionAI\/Ling-3.1-flash-1019: FP8 534.4GB<\/li>\n<li>Available builds in bartowski\/Ling-3.1-flash-GGUF: IQ1_S 122.0GB \/ IQ1_M 135.1GB \/ IQ2_XXS 159.1GB \/ IQ2_XS 165.2GB \/ IQ2_S 175.5GB \/ IQ2_M 198.4GB \/ Q2_K 204.1GB \/ IQ3_XXS 230.4GB \/ IQ3_XS 242.5GB \/ Q3_K_S 243.6GB \/ Q3_K_M 256.2GB \/ Q3_K_L 268.2GB \/ IQ3_M 276.9GB \/ IQ4_XS 295.3GB \/ Q4_0 304.2GB \/ Q4_K_S 313.5GB \/ Q4_K_M 333.4GB \/ IQ4_NL 333.4GB \/ Q4_1 335.4GB \/ Q5_K_S 378.2GB \/ Q5_K_M 406.4GB \/ Q6_K_S 445.9GB \/ Q6_K 467.1GB \/ Q8_0 566.6GB<\/li>\n<\/ul>\n<p><em>This section is appended automatically by Local Model Watch when a converted build of this model appears after publication. Memory figures are estimated from the size of the distributed files.<\/em><\/p>\n<h2>Articles (the family&#8217;s own models first, then newest)<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Published<\/th>\n<th>Model<\/th>\n<th>Type<\/th>\n<th>Article<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>2026-11-17<\/td>\n<td>inclusionAI\/Ling-3.1-flash-base<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/ling-3-1-flash-base-released\/\">Ling-3.1-flash-base Released: 560B Hybrid Linear MoE Model<\/a><\/td>\n<\/tr>\n<tr>\n<td>2026-11-17<\/td>\n<td>inclusionAI\/Ling-3.1-flash-1019<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/ling-3-1-flash-1019-released\/\">Ling-3.1-flash-1019 Text Generation Model: ~641GB Memory, GGUF Builds<\/a><\/td>\n<\/tr>\n<tr>\n<td>2026-11-17<\/td>\n<td>inclusionAI\/Ling-3.1-flash<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/ling-31-flash-released\/\">Ling-3.1-flash Hybrid Reasoning MoE Model: ~641GB Memory, GGUF Builds<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<h2>Repositories<\/h2>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/inclusionAI\/Ling-3.1-flash-base\">inclusionAI\/Ling-3.1-flash-base<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/inclusionAI\/Ling-3.1-flash-1019\">inclusionAI\/Ling-3.1-flash-1019<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/inclusionAI\/Ling-3.1-flash\">inclusionAI\/Ling-3.1-flash<\/a><\/li>\n<\/ul>\n<p><em>Last updated 2026-11-17 (JST). Assembled by code from our article log; no text on this page is written by an AI model.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Everything Local Model Watch has published about the Ling-3.1 family: 3 article(s) covering the base model and its fine-tunes, plus converted builds we tracked after publication. Memory requirements below are computed by this site from file sizes, not quoted from model cards. Part of our model family index. At a Glance Item Value Base model(s) [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-17274","page","type-page","status-publish","hentry"],"lang":"en","translations":{"en":17274,"ja":17273},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/17274","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=17274"}],"version-history":[{"count":0,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/17274\/revisions"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=17274"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}