{"id":4636,"date":"2026-09-26T18:16:40","date_gmt":"2026-09-26T09:16:40","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/model-deepseek-ai-deepseek-v4-en\/"},"modified":"2026-09-28T05:32:19","modified_gmt":"2026-09-27T20:32:19","slug":"model-deepseek-ai-deepseek-v4-en","status":"publish","type":"page","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/model-deepseek-ai-deepseek-v4-en\/","title":{"rendered":"DeepSeek-V4 Guide: VRAM Requirements, GGUF Builds"},"content":{"rendered":"<h2>About This Model<\/h2>\n<p><strong>DeepSeek-V4<\/strong> is DeepSeek&#8217;s MoE model series, built to be &#8220;highly efficient&#8221; enough to handle million-token contexts routinely. The centerpiece of this page, <strong>DeepSeek-V4-Pro-0813<\/strong>, is the official release of the flagship DeepSeek-V4-Pro and replaces the earlier preview. It keeps the preview&#8217;s architecture and adds a <strong>DSpark<\/strong> module for speculative decoding.<\/p>\n<p>According to the technical report&#8217;s abstract, DeepSeek-V4-Pro is an MoE model with <strong>1.6T<\/strong> total parameters and <strong>49B<\/strong> active per token, pre-trained on more than 32T tokens. It combines two compressed attention mechanisms (CSA and HCA) for long-context efficiency. At a one-million-token context, it needs only 27% of the per-token inference FLOPs and 10% of the KV cache of the previous-generation DeepSeek-V3.2. Reasoning depth can be set to <code>low<\/code>, <code>high<\/code> or <code>max<\/code> with <code>reasoning_effort<\/code>.<\/p>\n<h2>What Makes It Stand Out<\/h2>\n<p><strong>1. Agentic performance improved sharply over the preview.<\/strong> An excerpt from the publisher&#8217;s comparison table (bold marks the best value in each row):<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Benchmark<\/th>\n<th style=\"text-align: right;\">V4-Pro-0813<\/th>\n<th style=\"text-align: right;\">V4-Pro (Preview)<\/th>\n<th style=\"text-align: right;\">GLM-5.2<\/th>\n<th style=\"text-align: right;\">Kimi K3<\/th>\n<th style=\"text-align: right;\">Opus-4.8<\/th>\n<th style=\"text-align: right;\">Fable-5 (w\/ fallback)<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Terminal Bench 2.1<\/td>\n<td style=\"text-align: right;\">87.9<\/td>\n<td style=\"text-align: right;\">72.1<\/td>\n<td style=\"text-align: right;\">81.0<\/td>\n<td style=\"text-align: right;\"><strong>88.3<\/strong><\/td>\n<td style=\"text-align: right;\">85.0<\/td>\n<td style=\"text-align: right;\">88.0<\/td>\n<\/tr>\n<tr>\n<td>DeepSWE<\/td>\n<td style=\"text-align: right;\">62.7<\/td>\n<td style=\"text-align: right;\">12.8<\/td>\n<td style=\"text-align: right;\">46.2<\/td>\n<td style=\"text-align: right;\">67.5<\/td>\n<td style=\"text-align: right;\">58.0<\/td>\n<td style=\"text-align: right;\"><strong>70.0<\/strong><\/td>\n<\/tr>\n<tr>\n<td>Cybergym<\/td>\n<td style=\"text-align: right;\"><strong>83.3<\/strong><\/td>\n<td style=\"text-align: right;\">52.7<\/td>\n<td style=\"text-align: right;\">\u2014<\/td>\n<td style=\"text-align: right;\">80.0<\/td>\n<td style=\"text-align: right;\">78.3<\/td>\n<td style=\"text-align: right;\">83.1<\/td>\n<\/tr>\n<tr>\n<td>AutomationBench (Public)<\/td>\n<td style=\"text-align: right;\"><strong>31.8<\/strong><\/td>\n<td style=\"text-align: right;\">12.8<\/td>\n<td style=\"text-align: right;\">12.9<\/td>\n<td style=\"text-align: right;\">30.8<\/td>\n<td style=\"text-align: right;\">27.2<\/td>\n<td style=\"text-align: right;\">29.1<\/td>\n<\/tr>\n<tr>\n<td>Toolathlon-Verified<\/td>\n<td style=\"text-align: right;\">74.1<\/td>\n<td style=\"text-align: right;\">55.9<\/td>\n<td style=\"text-align: right;\">59.9<\/td>\n<td style=\"text-align: right;\">76.5<\/td>\n<td style=\"text-align: right;\">76.2<\/td>\n<td style=\"text-align: right;\"><strong>77.9<\/strong><\/td>\n<\/tr>\n<tr>\n<td>NL2Repo<\/td>\n<td style=\"text-align: right;\">61.5<\/td>\n<td style=\"text-align: right;\">38.5<\/td>\n<td style=\"text-align: right;\">48.9<\/td>\n<td style=\"text-align: right;\">\u2014<\/td>\n<td style=\"text-align: right;\"><strong>69.7<\/strong><\/td>\n<td style=\"text-align: right;\">\u2014<\/td>\n<\/tr>\n<tr>\n<td>HLE (without \/ with tools)<\/td>\n<td style=\"text-align: right;\">42.7 \/ 60.0<\/td>\n<td style=\"text-align: right;\">37.7 \/ 48.2<\/td>\n<td style=\"text-align: right;\">40.5 \/ 54.7<\/td>\n<td style=\"text-align: right;\">43.5 \/ 56.0<\/td>\n<td style=\"text-align: right;\">49.8 \/ 57.9<\/td>\n<td style=\"text-align: right;\"><strong>53.3 \/ 63.0<\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<ul>\n<li><strong>It beats the preview on every row.<\/strong> DeepSWE rose from 12.8 to 62.7 and AutomationBench from 12.8 to 31.8.<\/li>\n<li><strong>On many agentic tasks it stands level with the top models.<\/strong> On Terminal Bench 2.1 (terminal work) it is within 0.4 points of Kimi K3 and Fable-5, and it has the highest scores in the table on Cybergym and AutomationBench.<\/li>\n<\/ul>\n<h3>Caveats and Weaknesses<\/h3>\n<ul>\n<li><strong>It still trails the top models on hard knowledge questions and repository generation.<\/strong> On HLE without tools it scores 42.7, 10.6 points behind Fable-5 (53.3). It is 8.2 points behind Opus-4.8 on NL2Repo and 7.3 points behind Fable-5 on DeepSWE.<\/li>\n<li><strong>Across the full table in the model card, it is lower than Kimi K3 on 6 of the 10 figures where both have a value.<\/strong> It cannot be called the best open-weight model outright.<\/li>\n<li><strong>Watch the evaluation conditions.<\/strong> The code-agent tasks were measured with DeepSeek&#8217;s own agent framework (DeepSeek Harness). DSBench-FullStack and DSBench-Hard (omitted above) are DeepSeek&#8217;s internal test sets and cannot be reproduced by third parties under the same conditions.<\/li>\n<\/ul>\n<h2>Running It Locally<\/h2>\n<ul>\n<li><strong>This is not a model for consumer GPUs.<\/strong> The model card&#8217;s vLLM example runs on a single node with four GB300s, and the memory requirements this site computes from the distributed files, shown in the table below, are data-center scale.<\/li>\n<li>This release <strong>does not include<\/strong> a Jinja-format chat template, which many tools rely on. Instead, the <code>encoding<\/code> folder in the repository provides Python scripts that build the input and parse the output.<\/li>\n<li>In vLLM and SGLang, DSpark speculative decoding is enabled with a single flag; no separate draft model is needed.<\/li>\n<li>For <code>high<\/code> and <code>max<\/code> reasoning, a maximum output length of <strong>384K tokens<\/strong> is recommended.<\/li>\n<li><strong>The license is MIT, which allows commercial use.<\/strong><\/li>\n<li>This family also covers NVIDIA&#8217;s NVFP4 build, DeepSeek-V4-Pro-0813-nvfp4-DSpark. The successor, DeepSeek-V4.1, has its own page.<\/li>\n<\/ul>\n<p><em>Sources: <a href=\"https:\/\/huggingface.co\/deepseek-ai\/DeepSeek-V4-Pro-0813\">deepseek-ai\/DeepSeek-V4-Pro-0813 model card<\/a> and the technical report&#8217;s abstract (arXiv:2606.19348), as of 2026-09-26. Benchmark figures are as published by DeepSeek.<\/em><\/p>\n<h2>Our Coverage and Data<\/h2>\n<p>Everything Local Model Watch has published about the <strong>DeepSeek-V4<\/strong> family: 2 article(s) covering the base model and its fine-tunes, plus converted builds we tracked after publication. Memory requirements below are computed by this site from file sizes, not quoted from model cards. Part of our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/models-en\/\">model family index<\/a>.<\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Base model(s)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/deepseek-ai\/DeepSeek-V4-Pro-0813\">deepseek-ai\/DeepSeek-V4-Pro-0813<\/a><\/td>\n<\/tr>\n<tr>\n<td>Publisher<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-deepseek-en\/\">DeepSeek<\/a><\/td>\n<\/tr>\n<tr>\n<td>Parameters<\/td>\n<td>1650.5B<\/td>\n<\/tr>\n<tr>\n<td>License (model card)<\/td>\n<td>mit<\/td>\n<\/tr>\n<tr>\n<td>Articles<\/td>\n<td>2<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<h2>Hardware Requirements<\/h2>\n<p><strong>Estimated requirements (calculated by Local Model Watch)<\/strong> \u2014 1650.5B parameters<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Your VRAM<\/th>\n<th>Quantization<\/th>\n<th>File size<\/th>\n<th>Est. memory needed<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>More than 998GB of VRAM (multi-GPU or CPU offload required)<\/td>\n<td>FP8<\/td>\n<td>831.4GB<\/td>\n<td>997.7GB<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model&#8217;s authors. Compare with other models in our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference<\/a>. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<h2>Can You Run It Locally?<\/h2>\n<p><strong>Runs in Ollama, LM Studio and llama.cpp via a converted build.<\/strong><\/p>\n<p>The publisher ships safetensors, but <a href=\"https:\/\/huggingface.co\/unsloth\/DeepSeek-V4-Pro-0813-GGUF\">unsloth\/DeepSeek-V4-Pro-0813-GGUF<\/a> provides a GGUF build you can use.<\/p>\n<p><strong>License \u2014 <code>mit<\/code> (Commercial use allowed):<\/strong> Permits commercial use, modification and redistribution, provided the copyright notice and license text are retained.<\/p>\n<p><em>Compiled by this site&#8217;s code from the published formats, converted builds we have found, and each engine&#8217;s own model registry. &#8220;Not found&#8221; means we have not seen such a build, not that none exists. License summaries are not legal advice \u2014 check the publisher&#8217;s original terms before relying on them.<\/em><\/p>\n<h2>Quantized and Converted Variants<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Added<\/th>\n<th>Publisher<\/th>\n<th>Format<\/th>\n<th>Repository<\/th>\n<th>Smallest VRAM tier (build, est. memory)<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>2026-09-26<\/td>\n<td>unsloth<\/td>\n<td>GGUF<\/td>\n<td><a href=\"https:\/\/huggingface.co\/unsloth\/DeepSeek-V4-Pro-0813-GGUF\">unsloth\/DeepSeek-V4-Pro-0813-GGUF<\/a><\/td>\n<td>Q4_K_XL 949.6GB (does not fit a single consumer GPU)<\/td>\n<\/tr>\n<tr>\n<td>2026-09-26<\/td>\n<td>unsloth<\/td>\n<td>FP8<\/td>\n<td><a href=\"https:\/\/huggingface.co\/unsloth\/DeepSeek-V4-Pro-0813\">unsloth\/DeepSeek-V4-Pro-0813<\/a><\/td>\n<td>FP8 997.7GB (does not fit a single consumer GPU)<\/td>\n<\/tr>\n<tr>\n<td>2026-09-26<\/td>\n<td>DevQuasar<\/td>\n<td>GGUF<\/td>\n<td><a href=\"https:\/\/huggingface.co\/DevQuasar\/deepseek-ai.DeepSeek-V4-Pro-0813-GGUF\">DevQuasar\/deepseek-ai.DeepSeek-V4-Pro-0813-GGUF<\/a><\/td>\n<td>Q2_K 636.4GB (does not fit a single consumer GPU)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>File sizes of each build:<\/p>\n<ul>\n<li>Available builds in unsloth\/DeepSeek-V4-Pro-0813-GGUF: Q4_K_XL 791.3GB \/ Q8_K_XL 813.5GB<\/li>\n<li>Available builds in unsloth\/DeepSeek-V4-Pro-0813: FP8 831.4GB<\/li>\n<li>Available builds in DevQuasar\/deepseek-ai.DeepSeek-V4-Pro-0813-GGUF: Q2_K 530.3GB \/ Q3_K_M 697.0GB \/ Q4_K_M 885.6GB<\/li>\n<\/ul>\n<p><em>This section is appended automatically by Local Model Watch when a converted build of this model appears after publication. Memory figures are estimated from the size of the distributed files.<\/em><\/p>\n<h2>Articles (the family&#8217;s own models first, then newest)<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Published<\/th>\n<th>Model<\/th>\n<th>Type<\/th>\n<th>Article<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>2026-09-26<\/td>\n<td>deepseek-ai\/DeepSeek-V4-Pro-0813<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/26\/deepseek-v4-pro-0813-released\/\">DeepSeek-V4-Pro-0813 Text Generation Model: ~998GB Memory, GGUF Builds<\/a><\/td>\n<\/tr>\n<tr>\n<td>2026-09-10<\/td>\n<td>nvidia\/DeepSeek-V4-Pro-0813-nvfp4-DSpark<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/10\/nvidia-releases-deepseek-v4-pro-nvfp4\/\">DeepSeek-V4-Pro-0813-nvfp4-DSpark: ~1005GB Memory<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<h2>Repositories<\/h2>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/deepseek-ai\/DeepSeek-V4-Pro-0813\">deepseek-ai\/DeepSeek-V4-Pro-0813<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/nvidia\/DeepSeek-V4-Pro-0813-nvfp4-DSpark\">nvidia\/DeepSeek-V4-Pro-0813-nvfp4-DSpark<\/a><\/li>\n<\/ul>\n<p><em>Last updated 2026-09-28 (JST). The explanation at the top of this page was written with the help of AI from the primary sources it cites. The tables and lists under &#8220;Our Coverage and Data&#8221; are assembled by code from our article log.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>About This Model DeepSeek-V4 is DeepSeek&#8217;s MoE model series, built to be &#8220;highly efficient&#8221; enough to handle million-token contexts routinely. The centerpiece of this page, DeepSeek-V4-Pro-0813, is the official release of the flagship DeepSeek-V4-Pro and replaces the earlier preview. It keeps the preview&#8217;s architecture and adds a DSpark module for speculative decoding. According to the [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-4636","page","type-page","status-publish","hentry"],"lang":"en","translations":{"en":4636,"ja":4635},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/4636","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=4636"}],"version-history":[{"count":5,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/4636\/revisions"}],"predecessor-version":[{"id":5986,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/4636\/revisions\/5986"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=4636"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}