{"id":14186,"date":"2026-11-17T11:02:55","date_gmt":"2026-11-17T02:02:55","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/?p=14186"},"modified":"2026-11-17T11:12:16","modified_gmt":"2026-11-17T02:12:16","slug":"mistral-large-4-released-2","status":"publish","type":"post","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/mistral-large-4-released-2\/","title":{"rendered":"Mistral Large 4 Released: Multimodal MoE Model"},"content":{"rendered":"<p><!-- lmw:facts --><\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Publisher<\/td>\n<td>Hugging Face Blog<\/td>\n<\/tr>\n<tr>\n<td>Published<\/td>\n<td>2026-10-29<\/td>\n<\/tr>\n<tr>\n<td>Source type<\/td>\n<td>Primary source (the publisher itself)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Values determined by this site&#8217;s code when the information was collected. Dates are JST.<\/em><\/p>\n<p><!-- \/lmw:facts --><\/p>\n<h2>Overview<\/h2>\n<p>Mistral AI has released &#8220;Mistral Large 4&#8221; (also known as Le Chonk), a multimodal, multilingual Mixture-of-Experts (MoE) model. This model accepts text and image inputs and can generate text.<\/p>\n<p>Mistral Large 4 adopts an architecture that combines a large pool of experts with sparse attention and the Pixtral vision encoder. It features two distinct forms of sparsity: the language model selects a small number of experts for each token, while the attention indexer selects past token positions to reference.<\/p>\n<h2>Strengths and Use Cases<\/h2>\n<p>Mistral Large 4 performs exceptionally well in cybersecurity, coding agents, multimodal processing, and agentic workflows.<\/p>\n<p>In the cybersecurity domain, it is particularly suited for defensive security tasks. It scores 82% in the Artificial Analysis Cyber Index tests, which replicate real-world vulnerabilities in open-source software and apply patches, and solves 93% of the challenges in Cybench, which consists of tasks from security competitions. Furthermore, it is effective for malware analysis, vulnerability prioritization, and detection rule creation. Because it is provided as an open weight, users can control their own usage policies and deployment environments, avoiding the risk of service access being cut off during incident response. It can also be utilized for direct measurement of refusal behavior, building dedicated systems incorporating custom codebases and malware samples, and fine-tuning smaller models using TRL.<\/p>\n<p>For coding and business tasks, it achieves 61.7% on DeepSWE v1.1, 59.4% on SWE-Atlas-QnA, and 28.3% on Terminal-Bench 4 (a metric measuring whether a model can actually execute commands in a terminal and complete a given task to the end), with a Coding Agent Index score of 49.8%. It also scores 59.9% on AutomationBench, which evaluates business workflows and long-term professional tasks, and 1,393 Elo on AA-Briefcase.<\/p>\n<p>In addition, equipped with a 1.6B parameter Pixtral vision encoder, it supports multimodal tasks combining text and images. It demonstrates 93.3% attack resistance in Lakera&#8217;s B3 benchmark, which evaluates robustness against prompt injection attacks.<\/p>\n<h2>How to Get It<\/h2>\n<p>Mistral Large 4 is distributed under the Mistral Ecosystem Open-Weight License. This license is a derivative of the MIT license, but includes restrictions on providing it as a Model-as-a-Service (MaaS).<\/p>\n<p>As for distribution formats, official FP8 and NVFP4 versions are available. GGUF format quantized models (IQ2_XXS, Q2_K, Q4_K_M, NVFP4, Q8_0, BF16) created by Unsloth and the llama.cpp team are also available.<\/p>\n<p>Supported engines and libraries are as follows:<\/p>\n<p><strong>Transformers<\/strong> Use it by updating the <code>transformers<\/code> package to the latest version. Process text and image inputs using <code>AutoModelForMultimodalLM<\/code> and <code>AutoProcessor<\/code>. Reasoning effort (<code>reasoning_effort<\/code>) can be selected from <code>low<\/code>, <code>medium<\/code>, and <code>high<\/code> (default).<\/p>\n<pre><code class=\"language-bash\">pip install --upgrade transformers\n<\/code><\/pre>\n<p><strong>vLLM<\/strong> Supports NVFP4 checkpoints, which require NVIDIA Blackwell GPUs. DSpark drafters are also supported for acceleration.<\/p>\n<p><strong>llama.cpp \/ Llama App<\/strong> By installing Llama App, you can start a local server and use it via WebUI or API.<\/p>\n<pre><code class=\"language-bash\">curl -LsSf https:\/\/llama.app\/install.sh | sh\nllama serve -hf ggml-org\/Mistral-Large-4-1T-A52B-GGUF:Q2_K\n<\/code><\/pre>\n<p><strong>TRL (Fine-tuning)<\/strong> You can perform fine-tuning by combining <code>trl<\/code>, <code>transformers<\/code>, and <code>peft<\/code>.<\/p>\n<pre><code class=\"language-bash\">pip install --upgrade transformers trl peft\n<\/code><\/pre>\n<p><strong>Cloud and Enterprise Environments<\/strong> It also supports deployment using Hugging Face Inference Endpoints or the <code>dell-ai<\/code> CLI in the Dell Enterprise Hub.<\/p>\n<pre><code class=\"language-bash\">pip install dell-ai &amp;&amp; dell-ai login\n<\/code><\/pre>\n<p><!-- lmw:related --><\/p>\n<h2>Related Articles<\/h2>\n<ul>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/meta-muse-spark-open-2\/\">Meta Releases Muse Spark Open: Multimodal MoE Model<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/phonon-on-device-tts-model\/\">Phonon: A Lightweight, Fully On-Device Text-to-Speech Model<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/22\/transformers-llama-cpp-gguf-support\/\">Run GGUF Models Directly in Transformers with llama.cpp Support<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/botpsy-0-8b-agentic-model\/\">BotPsy: 0.8B On-Device Agentic Model by Tether AI Research<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:related --><\/p>\n<p><!-- lmw:next-steps --><\/p>\n<h2>What to Read Next<\/h2>\n<ul>\n<li><strong>How to read Terminal-Bench<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-benchmarks-en\/\">Benchmark glossary<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:next-steps --><\/p>\n<h2>Sources<\/h2>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/blog\/mistral-large4\">https:\/\/huggingface.co\/blog\/mistral-large4<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Learn about Mistral Large 4, a multimodal multilingual MoE model by Mistral AI, its capabilities, hardware requirements, and how to get it.<\/p>\n","protected":false},"author":1,"featured_media":14185,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[310],"tags":[163,1907,393,3075,165,759,1547,592],"class_list":["post-14186","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-new-models","tag-gguf-en","tag-hugging-face-blog-en","tag-mistral-ai-en","tag-mistral-large-4-en","tag-moe-en","tag-transformers-en","tag-verified","tag-vllm-en"],"lang":"en","translations":{"en":14186,"ja":14184},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/14186","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=14186"}],"version-history":[{"count":2,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/14186\/revisions"}],"predecessor-version":[{"id":17994,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/14186\/revisions\/17994"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media\/14185"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=14186"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/categories?post=14186"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/tags?post=14186"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}