{"id":4275,"date":"2026-09-25T17:59:45","date_gmt":"2026-09-25T08:59:45","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/model-deepseek-ai-deepseek-v4-1-en\/"},"modified":"2026-09-28T05:32:18","modified_gmt":"2026-09-27T20:32:18","slug":"model-deepseek-ai-deepseek-v4-1-en","status":"publish","type":"page","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/model-deepseek-ai-deepseek-v4-1-en\/","title":{"rendered":"DeepSeek-V4.1 Guide: VRAM Requirements"},"content":{"rendered":"<h2>About This Model<\/h2>\n<p><strong>DeepSeek-V4.1-Flash<\/strong> is a large MoE model from DeepSeek. It has <strong>552B backbone parameters<\/strong> and activates <strong>8B\u201316B per token<\/strong>. The model card lists additional components such as &#8220;Engram&#8221; memory (196B parameters, looked up sparsely depending on the token), and Hugging Face lists 763.2B parameters in total. It supports contexts of up to <strong>one million tokens<\/strong> and is <strong>natively multimodal<\/strong>, having learned images and text together from the start of pre-training. It was trained from scratch on 45T tokens.<\/p>\n<p>It also lets you set reasoning effort as an integer from 1 to 100, so you can trade speed and cost against accuracy for each use case.<\/p>\n<h2>What Makes It Stand Out<\/h2>\n<p><strong>1. It uses far less memory for long contexts.<\/strong> The memory needed to hold the context (the KV cache) is <strong>890 bytes per token<\/strong>\u2014about 1\/4 of the previous DeepSeek-V4-Flash and about 1\/437 of the first DeepSeek model. This comes from a new attention design (CSA2) that shares and reuses KV across layers, combined with storing the KV cache itself in 4 bits. It is aimed at handling million-token contexts with practical amounts of memory, which is why the model card is subtitled &#8220;Pushing the Limits of KV Cache Compression.&#8221;<\/p>\n<p><strong>2. On agentic tasks it stands alongside closed frontier models.<\/strong> An excerpt from the publisher&#8217;s comparison, at maximum reasoning effort:<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Benchmark (what it measures)<\/th>\n<th style=\"text-align: right;\">V4.1-Flash<\/th>\n<th style=\"text-align: right;\">V4-Flash (previous)<\/th>\n<th style=\"text-align: right;\">V4-Pro (previous flagship)<\/th>\n<th style=\"text-align: right;\">Claude Opus 5.0<\/th>\n<th style=\"text-align: right;\">GPT-5.6 Sol<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Terminal-Bench 2.1 (terminal use)<\/td>\n<td style=\"text-align: right;\"><strong>90.6<\/strong><\/td>\n<td style=\"text-align: right;\">82.7<\/td>\n<td style=\"text-align: right;\">87.9<\/td>\n<td style=\"text-align: right;\">89.1<\/td>\n<td style=\"text-align: right;\">88.8<\/td>\n<\/tr>\n<tr>\n<td>DeepSWE v1.1 (software fixes)<\/td>\n<td style=\"text-align: right;\"><strong>74.2<\/strong><\/td>\n<td style=\"text-align: right;\">54.4<\/td>\n<td style=\"text-align: right;\">62.7<\/td>\n<td style=\"text-align: right;\">74.0<\/td>\n<td style=\"text-align: right;\">73.0<\/td>\n<\/tr>\n<tr>\n<td>AutomationBench (workflow automation)<\/td>\n<td style=\"text-align: right;\"><strong>54.8<\/strong><\/td>\n<td style=\"text-align: right;\">37.7<\/td>\n<td style=\"text-align: right;\">43.2<\/td>\n<td style=\"text-align: right;\">50.3<\/td>\n<td style=\"text-align: right;\">45.8<\/td>\n<\/tr>\n<tr>\n<td>HLE w\/ tools (hard questions, with tools)<\/td>\n<td style=\"text-align: right;\"><strong>63.9<\/strong><\/td>\n<td style=\"text-align: right;\">51.5<\/td>\n<td style=\"text-align: right;\">60.0<\/td>\n<td style=\"text-align: right;\">63.6<\/td>\n<td style=\"text-align: right;\">\u2014<\/td>\n<\/tr>\n<tr>\n<td>Terminal-Bench 3.0 (harder terminal tasks)<\/td>\n<td style=\"text-align: right;\">30.0<\/td>\n<td style=\"text-align: right;\">7.6<\/td>\n<td style=\"text-align: right;\">11.8<\/td>\n<td style=\"text-align: right;\"><strong>43.3<\/strong><\/td>\n<td style=\"text-align: right;\">34.4<\/td>\n<\/tr>\n<tr>\n<td>Terminal-Bench 4.0 (even harder terminal tasks)<\/td>\n<td style=\"text-align: right;\">31.2<\/td>\n<td style=\"text-align: right;\">7.0<\/td>\n<td style=\"text-align: right;\">12.4<\/td>\n<td style=\"text-align: right;\"><strong>51.8<\/strong><\/td>\n<td style=\"text-align: right;\">39.9<\/td>\n<\/tr>\n<tr>\n<td>ProgramBench (building programs from scratch)<\/td>\n<td style=\"text-align: right;\">20.3<\/td>\n<td style=\"text-align: right;\">\u2014<\/td>\n<td style=\"text-align: right;\">15.5<\/td>\n<td style=\"text-align: right;\"><strong>37.0<\/strong><\/td>\n<td style=\"text-align: right;\">23.0<\/td>\n<\/tr>\n<tr>\n<td>GPQA Diamond (graduate-level science)<\/td>\n<td style=\"text-align: right;\">90.9<\/td>\n<td style=\"text-align: right;\">89.9<\/td>\n<td style=\"text-align: right;\">92.4<\/td>\n<td style=\"text-align: right;\">93.4<\/td>\n<td style=\"text-align: right;\"><strong>94.1<\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<ul>\n<li><strong>At roughly a third of the size, it beats the previous flagship V4-Pro (1.6T backbone) on most of these benchmarks.<\/strong><\/li>\n<li><strong>On Terminal-Bench 2.1, DeepSWE and AutomationBench, it matches or beats Claude Opus 5.0 and GPT-5.6 Sol.<\/strong><\/li>\n<li><strong>On harder tasks, though, the gap to Opus 5.0 is clear:<\/strong> 13 points on Terminal-Bench 3.0, 20 on 4.0, 17 on ProgramBench, 11 on NL2Repo-Bench, which builds whole repositories (64.0 vs 75.3), and nearly 20 on HLE without tools (36.8 vs 56.3). It is not the top model on the knowledge-heavy GPQA either. A fair reading: level with the frontier on well-known tasks, with a remaining gap on the hardest ones.<\/li>\n<\/ul>\n<h2>Running It Locally<\/h2>\n<ul>\n<li><strong>This is not a model for consumer GPUs.<\/strong> At 763.2B parameters in total, it needs hundreds of gigabytes of memory even when quantized. The KV-cache savings matter mainly when serving long contexts on large servers.<\/li>\n<li>This release <strong>does not include<\/strong> a Jinja-format chat template, which many tools rely on. Instead, the publisher provides a Python reference implementation (<code>encoding<\/code>) and a Rust library (deepseek-recipe); you will need those or wait for your inference engine to add support.<\/li>\n<li><strong>The license is MIT, which allows commercial use.<\/strong><\/li>\n<li>Articles in this family include an FP8 build from a third party (dealignai) with the safety tuning removed. Its weights differ from the official model; it is a separate model.<\/li>\n<\/ul>\n<p><em>Source: <a href=\"https:\/\/huggingface.co\/deepseek-ai\/DeepSeek-V4.1-Flash\">deepseek-ai\/DeepSeek-V4.1-Flash model card<\/a>, as of 2026-09-25. Benchmark figures are as published by DeepSeek.<\/em><\/p>\n<h2>Our Coverage and Data<\/h2>\n<p>Everything Local Model Watch has published about the <strong>DeepSeek-V4.1<\/strong> family: 2 article(s) covering the base model and its fine-tunes, plus converted builds we tracked after publication. Memory requirements below are computed by this site from file sizes, not quoted from model cards. Part of our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/models-en\/\">model family index<\/a>.<\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Base model(s)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/deepseek-ai\/DeepSeek-V4.1-Flash\">deepseek-ai\/DeepSeek-V4.1-Flash<\/a><\/td>\n<\/tr>\n<tr>\n<td>Publisher<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-deepseek-en\/\">DeepSeek<\/a><\/td>\n<\/tr>\n<tr>\n<td>Parameters<\/td>\n<td>763.2B<\/td>\n<\/tr>\n<tr>\n<td>License (model card)<\/td>\n<td>mit<\/td>\n<\/tr>\n<tr>\n<td>Articles<\/td>\n<td>2<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<h2>Hardware Requirements<\/h2>\n<p><strong>Estimated requirements (calculated by Local Model Watch)<\/strong> \u2014 763.2B parameters<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Your VRAM<\/th>\n<th>Quantization<\/th>\n<th>File size<\/th>\n<th>Est. memory needed<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>More than 570GB of VRAM (multi-GPU or CPU offload required)<\/td>\n<td>FP8<\/td>\n<td>475.3GB<\/td>\n<td>570.3GB<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model&#8217;s authors. Compare with other models in our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference<\/a>. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<h2>Can You Run It Locally?<\/h2>\n<p><strong>Not usable in Ollama, LM Studio and llama.cpp yet.<\/strong><\/p>\n<p>The publisher ships safetensors only, and llama.cpp&#8217;s registry does not list this architecture. llama.cpp would need to add support before these tools can run it. 46 converted build(s) from other uploaders exist. Today it can be run with transformers or vLLM, using the memory figures in the table above.<\/p>\n<p><strong>License \u2014 <code>mit<\/code> (Commercial use allowed):<\/strong> Permits commercial use, modification and redistribution, provided the copyright notice and license text are retained.<\/p>\n<p><em>Compiled by this site&#8217;s code from the published formats, converted builds we have found, and each engine&#8217;s own model registry. &#8220;Not found&#8221; means we have not seen such a build, not that none exists. License summaries are not legal advice \u2014 check the publisher&#8217;s original terms before relying on them.<\/em><\/p>\n<h2>Quantized and Converted Variants<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Added<\/th>\n<th>Publisher<\/th>\n<th>Format<\/th>\n<th>Repository<\/th>\n<th>Smallest VRAM tier (build, est. memory)<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>2026-09-17<\/td>\n<td>nvidia<\/td>\n<td>NVFP4<\/td>\n<td><a href=\"https:\/\/huggingface.co\/nvidia\/DeepSeek-V4.1-Flash-NVFP4\">nvidia\/DeepSeek-V4.1-Flash-NVFP4<\/a><\/td>\n<td>BF16 1690.8GB (does not fit a single consumer GPU)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>This section is appended automatically by Local Model Watch when a converted build of this model appears after publication. Memory figures are estimated from the size of the distributed files.<\/em><\/p>\n<h2>Articles (the family&#8217;s own models first, then newest)<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Published<\/th>\n<th>Model<\/th>\n<th>Type<\/th>\n<th>Article<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>2026-09-10<\/td>\n<td>deepseek-ai\/DeepSeek-V4.1-Flash<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/10\/deepseek-v4-1-flash-released\/\">DeepSeek-V4.1-Flash 552B Multimodal MoE Model: ~570GB Memory<\/a><\/td>\n<\/tr>\n<tr>\n<td>2026-09-13<\/td>\n<td>dealignai\/DeepSeek-V4.1-Flash-UNCENSORED-FP8<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/13\/deepseek-v4-1-flash-uncensored-fp8-2\/\">DeepSeek-V4.1-Flash-UNCENSORED-FP8: ~570GB Memory<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<h2>Repositories<\/h2>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/deepseek-ai\/DeepSeek-V4.1-Flash\">deepseek-ai\/DeepSeek-V4.1-Flash<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/dealignai\/DeepSeek-V4.1-Flash-UNCENSORED-FP8\">dealignai\/DeepSeek-V4.1-Flash-UNCENSORED-FP8<\/a><\/li>\n<\/ul>\n<p><em>Last updated 2026-09-28 (JST). The explanation at the top of this page was written with the help of AI from the primary sources it cites. The tables and lists under &#8220;Our Coverage and Data&#8221; are assembled by code from our article log.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>About This Model DeepSeek-V4.1-Flash is a large MoE model from DeepSeek. It has 552B backbone parameters and activates 8B\u201316B per token. The model card lists additional components such as &#8220;Engram&#8221; memory (196B parameters, looked up sparsely depending on the token), and Hugging Face lists 763.2B parameters in total. It supports contexts of up to one [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-4275","page","type-page","status-publish","hentry"],"lang":"en","translations":{"en":4275,"ja":4274},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/4275","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=4275"}],"version-history":[{"count":7,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/4275\/revisions"}],"predecessor-version":[{"id":5984,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/4275\/revisions\/5984"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=4275"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}