{"id":17298,"date":"2026-11-17T11:05:09","date_gmt":"2026-11-17T02:05:09","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/model-recursivesi-flint-en\/"},"modified":"2026-11-17T11:05:09","modified_gmt":"2026-11-17T02:05:09","slug":"model-recursivesi-flint-en","status":"publish","type":"page","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/model-recursivesi-flint-en\/","title":{"rendered":"flint Guide: VRAM Requirements, GGUF Builds"},"content":{"rendered":"<p>Everything Local Model Watch has published about the <strong>flint<\/strong> family: 2 article(s) covering the base model and its fine-tunes, plus converted builds we tracked after publication. Memory requirements below are computed by this site from file sizes, not quoted from model cards. Part of our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/models-en\/\">model family index<\/a>.<\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Base model(s)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/RecursiveSI\/flint\">RecursiveSI\/flint<\/a><\/td>\n<\/tr>\n<tr>\n<td>Publisher<\/td>\n<td>RecursiveSI<\/td>\n<\/tr>\n<tr>\n<td>Parameters<\/td>\n<td>39.8B<\/td>\n<\/tr>\n<tr>\n<td>License (model card)<\/td>\n<td>apache-2.0<\/td>\n<\/tr>\n<tr>\n<td>Smallest VRAM tier<\/td>\n<td>16GB<\/td>\n<\/tr>\n<tr>\n<td>Articles<\/td>\n<td>2<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<h2>Hardware Requirements<\/h2>\n<p><strong>Estimated requirements (calculated by Local Model Watch)<\/strong> \u2014 39.8B parameters<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Your VRAM<\/th>\n<th>Quantization<\/th>\n<th>File size<\/th>\n<th>Est. memory needed<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>16GB (RTX 5060 Ti 16GB \/ 4060 Ti 16GB, etc.)<\/td>\n<td>Q2_K_XL<\/td>\n<td>12.6GB<\/td>\n<td>15.2GB<\/td>\n<\/tr>\n<tr>\n<td>24GB (RTX 4090 \/ 3090, etc.)<\/td>\n<td>Q3_K_XL<\/td>\n<td>17.2GB<\/td>\n<td>20.7GB<\/td>\n<\/tr>\n<tr>\n<td>32GB (RTX 5090, etc.)<\/td>\n<td>Q4_K_XL<\/td>\n<td>23.3GB<\/td>\n<td>28.0GB<\/td>\n<\/tr>\n<tr>\n<td>48GB (RTX 6000 Ada \/ A6000, etc.)<\/td>\n<td>Q8_0<\/td>\n<td>39.4GB<\/td>\n<td>47.3GB<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model&#8217;s authors. File sizes are measured from the converted build <a href=\"https:\/\/huggingface.co\/unsloth\/flint-GGUF\">unsloth\/flint-GGUF<\/a>. Compare with other models in our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference<\/a>. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<h2>Can You Run It Locally?<\/h2>\n<p><strong>Runs in Ollama, LM Studio and llama.cpp via a converted build.<\/strong><\/p>\n<p>The publisher ships safetensors, but <a href=\"https:\/\/huggingface.co\/bartowski\/RecursiveSI_flint-GGUF\">bartowski\/RecursiveSI_flint-GGUF<\/a> provides a GGUF build you can use.<\/p>\n<p><strong>License \u2014 <code>apache-2.0<\/code> (Commercial use allowed):<\/strong> Permits commercial use, modification and redistribution. Redistribution requires including the license and stating changes; includes a patent grant.<\/p>\n<p><strong>Compression:<\/strong> the Q8_0 build measures 8.51 bits per weight \u2014 about 53% the size of the original 16-bit weights, calculated by this site from the actual file sizes.<\/p>\n<p><em>Compiled by this site&#8217;s code from the published formats, converted builds we have found, and each engine&#8217;s own model registry. &#8220;Not found&#8221; means we have not seen such a build, not that none exists. License summaries are not legal advice \u2014 check the publisher&#8217;s original terms before relying on them.<\/em><\/p>\n<h2>Quantized and Converted Variants<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Added<\/th>\n<th>Publisher<\/th>\n<th>Format<\/th>\n<th>Repository<\/th>\n<th>Smallest VRAM tier (build, est. memory)<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>2026-11-17<\/td>\n<td>unsloth<\/td>\n<td>GGUF (imatrix)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/unsloth\/flint-GGUF\">unsloth\/flint-GGUF<\/a><\/td>\n<td>Q2_K_XL 15.2GB (fits in 16GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-11-17<\/td>\n<td>lmstudio-community<\/td>\n<td>GGUF<\/td>\n<td><a href=\"https:\/\/huggingface.co\/lmstudio-community\/flint-GGUF\">lmstudio-community\/flint-GGUF<\/a><\/td>\n<td>Q4_K_M 27.0GB (fits in 32GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-11-17<\/td>\n<td>RecursiveSI<\/td>\n<td>MLX<\/td>\n<td><a href=\"https:\/\/huggingface.co\/RecursiveSI\/flint-int4\">RecursiveSI\/flint-int4<\/a><\/td>\n<td>&#8211;<\/td>\n<\/tr>\n<tr>\n<td>2026-11-17<\/td>\n<td>mlx-community<\/td>\n<td>MLX<\/td>\n<td><a href=\"https:\/\/huggingface.co\/mlx-community\/flint-OptiQ-4bit\">mlx-community\/flint-OptiQ-4bit<\/a><\/td>\n<td>MLX 4bit 30.7GB (fits in 32GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-10-24<\/td>\n<td>bartowski<\/td>\n<td>GGUF (imatrix)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/bartowski\/RecursiveSI_flint-GGUF\">bartowski\/RecursiveSI_flint-GGUF<\/a><\/td>\n<td>IQ2_S 15.0GB (fits in 16GB VRAM)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>File sizes of each build:<\/p>\n<ul>\n<li>Available builds in unsloth\/flint-GGUF: IQ1_M 10.6GB \/ IQ2_XXS 11.0GB \/ Q2_K_XL 12.6GB \/ IQ3_XXS 13.5GB \/ Q3_K_XL 17.2GB \/ Q4_K_XL 23.3GB \/ Q5_K_XL 27.9GB \/ Q6_K_XL 33.8GB \/ Q8_0 39.4GB \/ BF16 74.1GB<\/li>\n<li>Available builds in lmstudio-community\/flint-GGUF: Q4_K_M 22.5GB \/ Q6_K 30.5GB \/ Q8_0 39.4GB<\/li>\n<li>Available builds in mlx-community\/flint-OptiQ-4bit: MLX 4bit 25.6GB<\/li>\n<li>Available builds in bartowski\/RecursiveSI_flint-GGUF: IQ2_XXS 11.2GB \/ IQ2_XS 11.9GB \/ IQ2_S 12.5GB \/ IQ2_M 13.9GB \/ Q2_K 14.4GB \/ IQ3_XXS 16.3GB \/ IQ3_XS 17.1GB \/ Q3_K_S 17.2GB \/ Q3_K_M 18.2GB \/ Q3_K_L 19.2GB \/ IQ3_M 19.6GB \/ IQ4_XS 20.9GB \/ Q4_0 21.3GB \/ Q4_K_S 22.2GB \/ Q4_1 23.5GB \/ IQ4_NL 23.6GB \/ Q4_K_M 23.6GB \/ Q4_K_L 25.4GB \/ Q5_K_S 26.6GB \/ Q5_K_M 28.7GB \/ Q6_K_S 31.3GB \/ Q6_K 32.8GB \/ Q6_K_L 34.4GB \/ Q8_0 39.4GB \/ BF16 74.2GB<\/li>\n<\/ul>\n<p><em>This section is appended automatically by Local Model Watch when a converted build of this model appears after publication. Memory figures are estimated from the size of the distributed files.<\/em><\/p>\n<h2>Articles (the family&#8217;s own models first, then newest)<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Published<\/th>\n<th>Model<\/th>\n<th>Type<\/th>\n<th>Article<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>2026-11-17<\/td>\n<td>RecursiveSI\/flint<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/flint-39-8b-moe-coding-agent\/\">flint MoE Language Model for Coding Agents: 16GB+ VRAM, GGUF Builds<\/a><\/td>\n<\/tr>\n<tr>\n<td>2026-11-17<\/td>\n<td>ggml-org\/Flint-GGUF<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/ggml-org-flint-gguf\/\">Flint-GGUF Coding MoE Language Model: 32GB+ VRAM<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<h2>Repositories<\/h2>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/RecursiveSI\/flint\">RecursiveSI\/flint<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/ggml-org\/Flint-GGUF\">ggml-org\/Flint-GGUF<\/a><\/li>\n<\/ul>\n<p><em>Last updated 2026-11-17 (JST). Assembled by code from our article log; no text on this page is written by an AI model.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Everything Local Model Watch has published about the flint family: 2 article(s) covering the base model and its fine-tunes, plus converted builds we tracked after publication. Memory requirements below are computed by this site from file sizes, not quoted from model cards. Part of our model family index. At a Glance Item Value Base model(s) [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-17298","page","type-page","status-publish","hentry"],"lang":"en","translations":{"en":17298,"ja":17297},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/17298","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=17298"}],"version-history":[{"count":0,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/17298\/revisions"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=17298"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}