{"id":14190,"date":"2026-11-17T11:02:56","date_gmt":"2026-11-17T02:02:56","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/?p=14190"},"modified":"2026-11-17T11:12:18","modified_gmt":"2026-11-17T02:12:18","slug":"mistral-large-4-1t-a52b-nvfp4-gguf","status":"publish","type":"post","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/mistral-large-4-1t-a52b-nvfp4-gguf\/","title":{"rendered":"Mistral-Large-4-1T-A52B-NVFP4-GGUF Vision-Language Model: 8GB+ VRAM"},"content":{"rendered":"<p><!-- lmw:facts --><\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Repository<\/td>\n<td><a href=\"https:\/\/huggingface.co\/ggml-org\/Mistral-Large-4-1T-A52B-NVFP4-GGUF\">ggml-org\/Mistral-Large-4-1T-A52B-NVFP4-GGUF<\/a><\/td>\n<\/tr>\n<tr>\n<td>Family guide<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/model-mistralai-mistral-large-4-1t-en\/\">Mistral-Large-4-1T guide (1 articles)<\/a><\/td>\n<\/tr>\n<tr>\n<td>Publisher guide<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-mistral-en\/\">Mistral AI: models and licenses<\/a><\/td>\n<\/tr>\n<tr>\n<td>Published<\/td>\n<td>2026-10-29<\/td>\n<\/tr>\n<tr>\n<td>License<\/td>\n<td>mistral-ecosystem-open-weight-license<\/td>\n<\/tr>\n<tr>\n<td>Formats<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-gguf-en\/\">GGUF<\/a><\/td>\n<\/tr>\n<tr>\n<td>Source type<\/td>\n<td>Primary source (the publisher itself)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Values determined by this site&#8217;s code when the information was collected. Dates are JST.<\/em><\/p>\n<p><!-- \/lmw:facts --><\/p>\n<h2>Overview<\/h2>\n<p><a href=\"https:\/\/huggingface.co\/ggml-org\/Mistral-Large-4-1T-A52B-NVFP4-GGUF\">ggml-org\/Mistral-Large-4-1T-A52B-NVFP4-GGUF<\/a> has been released by ggml-org, providing an NVFP4 quantized version of Mistral AI&#8217;s latest flagship model in GGUF format.<\/p>\n<p>This model is a multimodal image-text-to-text model that supports both text and image inputs. The source model is <a href=\"https:\/\/huggingface.co\/mistralai\/Mistral-Large-4-1T-A52B-NVFP4\">mistralai\/Mistral-Large-4-1T-A52B-NVFP4<\/a>, which is an NVFP4 quantized checkpoint of Mistral Large 4 trained from scratch using 3,800 NVIDIA Grace Blackwell GPUs in Mistral AI&#8217;s European data center.<\/p>\n<p>In the GGUF conversion process, the NVFP4 routed experts of the original model are preserved as-is without requantization. Additionally, FP8 layers such as the Attention layers, indexer query projections, shared experts, and the first Dense layer are stored losslessly in BF16, just like the layers that were originally BF16.<\/p>\n<h2>Specifications<\/h2>\n<ul>\n<li>Parameters: Total parameters of 1 trillion (1T), active parameters of approximately 52B (49B per token, 52B including embedding and output layers)<\/li>\n<li>Architecture: Mixture-of-Experts (MoE, 128 routed experts, 4 active experts per token, and 1 shared expert)<\/li>\n<li>Context Length: 1,000,000 (1M) tokens<\/li>\n<\/ul>\n<h2>Performance<\/h2>\n<p>Specific benchmark score numbers and comparison tables against third-party organizations or other models are not provided in the model cards for this model or the source model <code>mistralai\/Mistral-Large-4-1T-A52B-NVFP4<\/code>.<\/p>\n<p>According to an explanation from the publisher Mistral AI, it is reported that NVFP4 format checkpoints achieve significantly reduced effective memory footprints compared to FP8 format checkpoints while delivering performance comparable to FP8 and faster inference processing. It specifically targets leveraging dedicated hardware features available in the NVIDIA Blackwell architecture (such as B200 \/ B300 \/ GB200 \/ GB300).<\/p>\n<p>For response generation, the depth of thought can be controlled via the <code>reasoning_effort<\/code> parameter. Three setting values are available: <code>'low'<\/code>, <code>'medium'<\/code>, and <code>'high'<\/code>, with the default setting being <code>'high'<\/code>. Note that this thinking process feature itself cannot be completely disabled (turned off). Using <code>'high'<\/code> is recommended for complex prompts and agent use cases, while <code>'low'<\/code> is recommended for quick chat responses.<\/p>\n<p>Additionally, to further accelerate inference, a DSpark speculative decoding draft head consisting of 3 Multi-head Latent Attention (MLA) layers is integrated. This draft head is specified to propose 3 tokens at once from the target model&#8217;s hidden states using a 2,048-token sliding window.<\/p>\n<p>As for sampling settings, GGUF metadata records a <code>temperature<\/code> of 1.0 and <code>top_p<\/code> of 0.95 as the officially recommended configurations.<\/p>\n<h2>Strengths and Use Cases<\/h2>\n<p>Mistral Large 4, the base model for this release, is designed as a general-purpose multimodal model capable of handling diverse advanced tasks. The strengths and intended use cases of the original model are as follows:<\/p>\n<h3>Multimodal Image and Text Understanding<\/h3>\n<p>Supporting image inputs in addition to text inputs, it can be applied to image-text-to-text tasks such as image-based question answering and analysis of contexts where images and text are mixed. The output is in text format.<\/p>\n<h3>Large-Scale Long Context and Broad Multilingual Support<\/h3>\n<p>It supports an extremely wide context window of up to 1 million (1M) tokens, enabling the analysis of large documents and processing while maintaining long conversation histories. Furthermore, supported languages include Japanese (ja), English (en), French (fr), German (de), Spanish (es), Portuguese (pt), Italian (it), Korean (ko), Chinese (zh), Russian (ru), Arabic (ar), and many others.<\/p>\n<h3>Structured Output and Agent\/Tool Usage<\/h3>\n<p>It supports native function calling (tool use) and strict JSON Schema output. When operating as an agent system, it is recommended to define clear execution environments and use cases in the system prompts, and give instructions to utilize tools effectively. It is also effective to clearly define the set of tools provided and narrow them down to the minimum necessary for the use case.<\/p>\n<h3>Task-Specific Reasoning Control (<code>reasoning_effort<\/code>)<\/h3>\n<p>By setting the <code>reasoning_effort<\/code> parameter, the reasoning level during generation can be adjusted. It is possible to flexibly switch according to the nature of the task, such as selecting the default <code>'high'<\/code> for complex prompt interpretation and autonomous agent utilization, or <code>'low'<\/code> for quick chat responses.<\/p>\n<p><!-- lmw:hardware --><\/p>\n<h2>Hardware Requirements<\/h2>\n<p><strong>Estimated requirements (calculated by Local Model Watch)<\/strong><\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Your VRAM<\/th>\n<th>Quantization<\/th>\n<th>File size<\/th>\n<th>Est. memory needed<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>8GB (RTX 4060 \/ 3060 Ti, etc.)<\/td>\n<td>BF16<\/td>\n<td>3.9GB<\/td>\n<td>4.7GB<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model&#8217;s authors. Compare with other models in our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference<\/a>. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<p><!-- \/lmw:hardware --><\/p>\n<p><!-- lmw:runnability --><\/p>\n<h2>Can You Run It Locally?<\/h2>\n<p><strong>Runs in Ollama, LM Studio and llama.cpp as-is.<\/strong><\/p>\n<p>It is distributed in GGUF, so no conversion is needed.<\/p>\n<p><strong>License \u2014 <code>mistral-ecosystem-open-weight-license<\/code>:<\/strong> A custom license from the publisher. Check the original terms directly, including whether commercial use is permitted.<\/p>\n<p><em>Compiled by this site&#8217;s code from the published formats, converted builds we have found, and each engine&#8217;s own model registry. &#8220;Not found&#8221; means we have not seen such a build, not that none exists. License summaries are not legal advice \u2014 check the publisher&#8217;s original terms before relying on them.<\/em><\/p>\n<p><!-- \/lmw:runnability --><\/p>\n<p><!-- lmw:lab --><\/p>\n<h2>Our Own Measurements<\/h2>\n<h3>Measurements We Did Not Take<\/h3>\n<p>We have not confirmed that this site meets the commercial-use terms of this model&#8217;s license (<code>mistral-ecosystem-open-weight-license<\/code>). Because this site carries advertising, we did not run the model (no CPU run, answers, quantization comparison, conversion or generation).<\/p>\n<p><!-- \/lmw:lab --><\/p>\n<h2>How to Get It<\/h2>\n<p>This model is distributed in GGUF format and runs on compatible tools such as <code>llama.cpp<\/code> (<code>llama.app<\/code>).<\/p>\n<h3>Distribution Format and Acquisition Command<\/h3>\n<p>Provided in GGUF format, an example command for direct download and execution using the server feature of <code>llama.cpp<\/code> (<code>llama serve<\/code>) is as follows:<\/p>\n<pre><code class=\"language-bash\">llama serve -hf ggml-org\/Mistral-Large-4-1T-A52B-NVFP4-GGUF:NVFP4\n<\/code><\/pre>\n<p>Additionally, the source model <code>mistralai\/Mistral-Large-4-1T-A52B-NVFP4<\/code> is compatible with inference frameworks such as vLLM and SGLang.<\/p>\n<h3>License and Conditions<\/h3>\n<p>The license for this model is the &#8220;Mistral Ecosystem Open-Weight License&#8221;. This is modified based on the MIT license, and both commercial and non-commercial uses are permitted. However, operating this model as a &#8220;Model-as-a-Service&#8221; business targeting third parties requires entering into a separate individual commercial license agreement with Mistral AI.<\/p>\n<p>Note that this repository is not a gated model requiring a consent procedure, so it can be downloaded directly on Hugging Face without prior agreement to terms.<\/p>\n<p><!-- lmw:variants --><\/p>\n<h2>Quantized and Converted Variants<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Added<\/th>\n<th>Publisher<\/th>\n<th>Format<\/th>\n<th>Repository<\/th>\n<th>Smallest VRAM tier (build, est. memory)<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>2026-10-29<\/td>\n<td>ggml-org<\/td>\n<td>GGUF<\/td>\n<td><a href=\"https:\/\/huggingface.co\/ggml-org\/Mistral-Large-4-1T-A52B-GGUF\">ggml-org\/Mistral-Large-4-1T-A52B-GGUF<\/a><\/td>\n<td>IQ2_XXS 332.7GB (does not fit a single consumer GPU)<\/td>\n<\/tr>\n<tr>\n<td>2026-10-30<\/td>\n<td>unsloth<\/td>\n<td>GGUF<\/td>\n<td><a href=\"https:\/\/huggingface.co\/unsloth\/Mistral-Large-4-1T-A52B-GGUF\">unsloth\/Mistral-Large-4-1T-A52B-GGUF<\/a><\/td>\n<td>Q8_0 2.5GB (fits in 4GB VRAM)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>File sizes of each build:<\/p>\n<ul>\n<li>Available builds in ggml-org\/Mistral-Large-4-1T-A52B-GGUF: IQ2_XXS 277.2GB \/ Q2_K 354.6GB \/ Q4_K_M 591.2GB \/ Q8_0 1038.6GB \/ BF16 1954.7GB<\/li>\n<li>Available builds in unsloth\/Mistral-Large-4-1T-A52B-GGUF: Q8_0 2.1GB \/ BF16 3.9GB \/ IQ1_S 217.0GB \/ IQ1_M 241.8GB \/ IQ2_XXS 281.7GB \/ Q2_K_XL 352.3GB \/ IQ3_XXS 394.4GB \/ Q3_K_XL 458.9GB \/ Q4_K_XL 563.3GB \/ Q5_K_XL 729.9GB \/ Q6_K_XL 829.3GB<\/li>\n<\/ul>\n<p><em>This section is appended automatically by Local Model Watch when a converted build of this model appears after publication. Memory figures are estimated from the size of the distributed files. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<p><!-- \/lmw:variants --><\/p>\n<p><!-- lmw:related --><\/p>\n<h2>Related Articles<\/h2>\n<ul>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/ggml-org-vibevoice-asr-gguf\/\">VibeVoice-ASR-GGUF Speech Recognition and Diarization Model: 8GB+ VRAM<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/qwen3-5-4b-gguf-released\/\">Qwen3.5-4B-GGUF Vision-Language Model: 4GB+ VRAM<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/qwen3-coder-30b-a3b-instruct-gguf-2\/\">Qwen3-Coder-30B-A3B-Instruct-GGUF Text Generation Model: 24GB+ VRAM<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/vllm-d3-gguf-models-released\/\">vllm-d3 GGUF Models Released: Decision Models for Local Run<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:related --><\/p>\n<p><!-- lmw:next-steps --><\/p>\n<h2>What to Read Next<\/h2>\n<ul>\n<li><strong>Find models by VRAM<\/strong> (This model runs from the 8GB tier) \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-8gb-en\/\">Other models that run on a 8GB GPU<\/a><\/li>\n<li><strong>Explore the same model family<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/model-mistralai-mistral-large-4-1t-en\/\">Mistral-Large-4-1T family overview (1 articles, 2 converted builds)<\/a><\/li>\n<li><strong>Engines that run this model<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-llama-cpp-en\/\">llama.cpp<\/a> \/ <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-ollama-en\/\">Ollama<\/a><\/li>\n<li><strong>Formats this model is available in<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-gguf-en\/\">GGUF format guide and models<\/a><\/li>\n<li><strong>Learn about the publisher<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-mistral-en\/\">Mistral AI: models, licenses and articles<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:next-steps --><\/p>\n<h2>Sources<\/h2>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/ggml-org\/Mistral-Large-4-1T-A52B-NVFP4-GGUF\">https:\/\/huggingface.co\/ggml-org\/Mistral-Large-4-1T-A52B-NVFP4-GGUF<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/mistralai\/Mistral-Large-4-1T-A52B-NVFP4\">https:\/\/huggingface.co\/mistralai\/Mistral-Large-4-1T-A52B-NVFP4<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Explore the GGUF release of Mistral AI&#8217;s Mistral Large 4 NVFP4 quantized model, featuring a 1M context window and multi-modal capabilities.<\/p>\n","protected":false},"author":1,"featured_media":14189,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[310],"tags":[161,1970,163,3075,4358,165,813,1547,1952],"class_list":["post-14190","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-new-models","tag-ggml-en","tag-ggml-org-en","tag-gguf-en","tag-mistral-large-4-en","tag-mistral-large-4-1t-en","tag-moe-en","tag-nvfp4-en","tag-verified","tag-vlm-en"],"lang":"en","translations":{"en":14190,"ja":14188},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/14190","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=14190"}],"version-history":[{"count":3,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/14190\/revisions"}],"predecessor-version":[{"id":17996,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/14190\/revisions\/17996"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media\/14189"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=14190"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/categories?post=14190"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/tags?post=14190"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}