{"id":12962,"date":"2026-11-17T11:01:49","date_gmt":"2026-11-17T02:01:49","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/?p=12962"},"modified":"2026-11-17T11:11:04","modified_gmt":"2026-11-17T02:11:04","slug":"krafton-ai-raon-1-mini-preview","status":"publish","type":"post","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/krafton-ai-raon-1-mini-preview\/","title":{"rendered":"Raon-1-mini-preview Reasoning-Enabled Language Model: 24GB+ VRAM"},"content":{"rendered":"<p><!-- lmw:facts --><\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Repository<\/td>\n<td><a href=\"https:\/\/huggingface.co\/KRAFTON\/Raon-1-mini-preview\">KRAFTON\/Raon-1-mini-preview<\/a><\/td>\n<\/tr>\n<tr>\n<td>Family guide<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/model-krafton-raon-1-en\/\">Raon-1 guide (1 articles)<\/a><\/td>\n<\/tr>\n<tr>\n<td>Published<\/td>\n<td>2026-10-21<\/td>\n<\/tr>\n<tr>\n<td>License<\/td>\n<td>apache-2.0<\/td>\n<\/tr>\n<tr>\n<td>Formats<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-safetensors-en\/\">safetensors<\/a><\/td>\n<\/tr>\n<tr>\n<td>Source type<\/td>\n<td>Primary source (the publisher itself)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Values determined by this site&#8217;s code when the information was collected. Dates are JST.<\/em><\/p>\n<p><!-- \/lmw:facts --><\/p>\n<h2>Overview<\/h2>\n<p>KRAFTON AI has released &#8220;Raon-1-mini-preview&#8221;, a Mixture-of-Experts (MoE) language model designed and trained from scratch. It features a total parameter count of 28.8B with 4.3B active parameters per token, and is reported to excel in Korean conversational capabilities and agent tasks. Positioned as a preview version rather than a final release, the model comes with a built-in thinking mode by default.<\/p>\n<h2>Specifications<\/h2>\n<p>The specifications listed in the model card are as follows:<\/p>\n<ul>\n<li>Total parameters: 28.8B<\/li>\n<li>Active parameters: 4.3B<\/li>\n<li>Architecture: Hybrid MoE (18 Raon Delta Attention layers and 7 Gated MLA layers)<\/li>\n<li>Number of layers: 25<\/li>\n<li>Number of experts: 128 (6 routed experts + 1 shared expert activated per token)<\/li>\n<li>Expert intermediate size: 1,088<\/li>\n<li>Hidden Size: 2,560<\/li>\n<li>Attention heads: 40 (common to RDA and Gated MLA)<\/li>\n<li>Attention head dimensions: 128 (RDA), 192 QK \/ 128 V (Gated MLA)<\/li>\n<li>Query \/ KV LoRA rank: 576 \/ 512 (Gated MLA)<\/li>\n<li>Positional encoding: NoPE (no positional encoding)<\/li>\n<li>Activation function: SiTU-GLU<\/li>\n<li>Residual connection: Raon-mHC (4 streams)<\/li>\n<li>Vocabulary size: 259,840<\/li>\n<li>Context length: 262,144 tokens<\/li>\n<\/ul>\n<h2>Performance<\/h2>\n<p>The model card publishes benchmark comparison results against same-scale MoE models (Qwen3.6-35B-A3B, Gemma 4 26B-A4B) and Dense models. In all evaluations, gpt-5.6-luna was used as the judge and user simulator.<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Category<\/th>\n<th>Benchmark<\/th>\n<th>MoE \/ Raon-1 mini preview (30B-A4B)<\/th>\n<th>MoE \/ Qwen3.6-35B-A3B<\/th>\n<th>MoE \/ Gemma 4 26B-A4B<\/th>\n<th>Dense \/ Qwen3.8-27B<\/th>\n<th>Dense \/ Muse Glimmer 30B<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Knowledge<\/td>\n<td>MMLU Pro<\/td>\n<td>76.5<\/td>\n<td>85.9<\/td>\n<td>82.9<\/td>\n<td>85.7<\/td>\n<td>84.0<\/td>\n<\/tr>\n<tr>\n<td>Knowledge<\/td>\n<td>AA-Omniscience<\/td>\n<td>3.5<\/td>\n<td>\u22127.2<\/td>\n<td>\u221246.6<\/td>\n<td>\u22120.5<\/td>\n<td>\u221234.7<\/td>\n<\/tr>\n<tr>\n<td>Reasoning<\/td>\n<td>GPQA Diamond<\/td>\n<td>84.3<\/td>\n<td>83.2<\/td>\n<td>80.7<\/td>\n<td>89.7<\/td>\n<td>82.6<\/td>\n<\/tr>\n<tr>\n<td>Reasoning<\/td>\n<td>AIME 2026<\/td>\n<td>93.3<\/td>\n<td>92.9<\/td>\n<td>87.1<\/td>\n<td>98.8<\/td>\n<td>92.9<\/td>\n<\/tr>\n<tr>\n<td>Reasoning<\/td>\n<td>HMMT Feb 2026<\/td>\n<td>84.1<\/td>\n<td>84.5<\/td>\n<td>79.9<\/td>\n<td>95.8<\/td>\n<td>74.6<\/td>\n<\/tr>\n<tr>\n<td>Instruction and multi-turn<\/td>\n<td>IFBench<\/td>\n<td>84.2<\/td>\n<td>66.6<\/td>\n<td>80.9<\/td>\n<td>82.4<\/td>\n<td>78.7<\/td>\n<\/tr>\n<tr>\n<td>Instruction and multi-turn<\/td>\n<td>MultiChallenge<\/td>\n<td>59.0<\/td>\n<td>58.2<\/td>\n<td>58.4<\/td>\n<td>63.6<\/td>\n<td>63.4<\/td>\n<\/tr>\n<tr>\n<td>Coding<\/td>\n<td>LiveCodeBench v6<\/td>\n<td>81.6<\/td>\n<td>81.2<\/td>\n<td>83.4<\/td>\n<td>79.3<\/td>\n<td>77.4<\/td>\n<\/tr>\n<tr>\n<td>Coding<\/td>\n<td>SciCode<\/td>\n<td>38.7<\/td>\n<td>35.6<\/td>\n<td>39.6<\/td>\n<td>44.6<\/td>\n<td>43.6<\/td>\n<\/tr>\n<tr>\n<td>Coding<\/td>\n<td>SWE-Verified\u00b9<\/td>\n<td>70.8<\/td>\n<td>63.2<\/td>\n<td>61.6<\/td>\n<td>74.6<\/td>\n<td>72.0<\/td>\n<\/tr>\n<tr>\n<td>Coding<\/td>\n<td>Terminal-Bench Lite<\/td>\n<td>47.0<\/td>\n<td>63.3<\/td>\n<td>52.0<\/td>\n<td>67.0<\/td>\n<td>70.7<\/td>\n<\/tr>\n<tr>\n<td>Agentic<\/td>\n<td>GDPVal\u00b2<\/td>\n<td>66.0<\/td>\n<td>67.4<\/td>\n<td>57.5<\/td>\n<td>63.5<\/td>\n<td>67.3<\/td>\n<\/tr>\n<tr>\n<td>Agentic<\/td>\n<td>AutomationBench\u00b3<\/td>\n<td>29.7<\/td>\n<td>24.9<\/td>\n<td>36.2<\/td>\n<td>58.7<\/td>\n<td>32.1<\/td>\n<\/tr>\n<tr>\n<td>Agentic<\/td>\n<td>BrowseComp Plus<\/td>\n<td>55.7<\/td>\n<td>34.8<\/td>\n<td>32.2<\/td>\n<td>58.0<\/td>\n<td>52.8<\/td>\n<\/tr>\n<tr>\n<td>Agentic<\/td>\n<td>BFCL v4 Overall<\/td>\n<td>59.8<\/td>\n<td>64.7<\/td>\n<td>65.8<\/td>\n<td>72.4<\/td>\n<td>51.8<\/td>\n<\/tr>\n<tr>\n<td>Long context<\/td>\n<td>AA-LCR<\/td>\n<td>67.3<\/td>\n<td>69.3<\/td>\n<td>67.0<\/td>\n<td>80.3<\/td>\n<td>81.3<\/td>\n<\/tr>\n<tr>\n<td>Long context<\/td>\n<td>GDP.pdf\u2074<\/td>\n<td>5.8<\/td>\n<td>6.6<\/td>\n<td>3.6<\/td>\n<td>11.2<\/td>\n<td>8.4<\/td>\n<\/tr>\n<tr>\n<td>Korean conversation<\/td>\n<td>Chatbot Korean (internal)\u2075<\/td>\n<td>92.9<\/td>\n<td>74.5<\/td>\n<td>90.6<\/td>\n<td>90.1<\/td>\n<td>87.0<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>Additionally, throughput measurement results using &#8220;DFlash2&#8221;, a speculative decoding draft model that accelerates inference, have been published (NVIDIA B300 single, vLLM environment).<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th style=\"text-align: left;\">Benchmark<\/th>\n<th style=\"text-align: right;\">AL<\/th>\n<th style=\"text-align: right;\">AR \u00b7 C=1<\/th>\n<th style=\"text-align: right;\">DFlash2 \u00b7 C=1<\/th>\n<th style=\"text-align: right;\">AR \u00b7 C=8<\/th>\n<th style=\"text-align: right;\">DFlash2 \u00b7 C=8<\/th>\n<th style=\"text-align: right;\">AR \u00b7 C=32<\/th>\n<th style=\"text-align: right;\">DFlash2 \u00b7 C=32<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td style=\"text-align: left;\">GSM8K<\/td>\n<td style=\"text-align: right;\">4.76<\/td>\n<td style=\"text-align: right;\">296.3<\/td>\n<td style=\"text-align: right;\"><strong>646.3 (2.18\u00d7)<\/strong><\/td>\n<td style=\"text-align: right;\">1,110.4<\/td>\n<td style=\"text-align: right;\"><strong>1,836.3 (1.65\u00d7)<\/strong><\/td>\n<td style=\"text-align: right;\">1,528.9<\/td>\n<td style=\"text-align: right;\"><strong>2,619.3 (1.71\u00d7)<\/strong><\/td>\n<\/tr>\n<tr>\n<td style=\"text-align: left;\">MATH-500<\/td>\n<td style=\"text-align: right;\">4.43<\/td>\n<td style=\"text-align: right;\">308.0<\/td>\n<td style=\"text-align: right;\"><strong>666.6 (2.16\u00d7)<\/strong><\/td>\n<td style=\"text-align: right;\">1,496.1<\/td>\n<td style=\"text-align: right;\"><strong>2,511.3 (1.68\u00d7)<\/strong><\/td>\n<td style=\"text-align: right;\">3,082.5<\/td>\n<td style=\"text-align: right;\"><strong>5,166.9 (1.68\u00d7)<\/strong><\/td>\n<\/tr>\n<tr>\n<td style=\"text-align: left;\">HumanEval<\/td>\n<td style=\"text-align: right;\">3.96<\/td>\n<td style=\"text-align: right;\">305.4<\/td>\n<td style=\"text-align: right;\"><strong>607.9 (1.99\u00d7)<\/strong><\/td>\n<td style=\"text-align: right;\">1,470.8<\/td>\n<td style=\"text-align: right;\"><strong>2,269.6 (1.54\u00d7)<\/strong><\/td>\n<td style=\"text-align: right;\">2,793.1<\/td>\n<td style=\"text-align: right;\"><strong>4,596.4 (1.65\u00d7)<\/strong><\/td>\n<\/tr>\n<tr>\n<td style=\"text-align: left;\">MBPP<\/td>\n<td style=\"text-align: right;\">3.85<\/td>\n<td style=\"text-align: right;\">307.0<\/td>\n<td style=\"text-align: right;\"><strong>604.1 (1.97\u00d7)<\/strong><\/td>\n<td style=\"text-align: right;\">1,450.6<\/td>\n<td style=\"text-align: right;\"><strong>2,197.2 (1.51\u00d7)<\/strong><\/td>\n<td style=\"text-align: right;\">2,956.2<\/td>\n<td style=\"text-align: right;\"><strong>5,017.9 (1.70\u00d7)<\/strong><\/td>\n<\/tr>\n<tr>\n<td style=\"text-align: left;\">MT-Bench<\/td>\n<td style=\"text-align: right;\">3.24<\/td>\n<td style=\"text-align: right;\">304.9<\/td>\n<td style=\"text-align: right;\"><strong>570.2 (1.87\u00d7)<\/strong><\/td>\n<td style=\"text-align: right;\">1,477.1<\/td>\n<td style=\"text-align: right;\"><strong>2,038.2 (1.38\u00d7)<\/strong><\/td>\n<td style=\"text-align: right;\">2,521.3<\/td>\n<td style=\"text-align: right;\"><strong>3,935.4 (1.56\u00d7)<\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>Based on the publisher&#8217;s measurement results, the following points can be gathered regarding the model&#8217;s strengths and weaknesses.<\/p>\n<p>First, in the reasoning and mathematics domains, it recorded 93.3 on AIME 2026, which measures US Math Olympiad qualifiers, and 84.3 on GPQA Diamond, which handles PhD-level difficult scientific questions, achieving the highest figures among the comparative MoE model group. It also showed good results with 84.2 on IFBench, which measures instruction-following, and 81.6 on LiveCodeBench v6 using new competitive programming tasks, while also recording a high score of 92.9 on the internal Chatbot Korean benchmark.<\/p>\n<p>On the other hand, it remained at 76.5 on MMLU Pro, which measures general knowledge and reasoning with higher difficulty across 10 choices, falling below other comparative models (82.9 to 85.9). Furthermore, it scored 47.0 on Terminal-Bench Lite, which measures the ability to execute commands on a terminal and complete tasks, and 59.8 on BFCL v4 Overall, which measures the accuracy of function selection and argument construction, falling short of other MoE baselines in some agent and tool-use tasks.<\/p>\n<p>Regarding speculative decoding, it is reported that using DFlash2 in combination improves throughput by up to 2.18x on GSM8K, which solves elementary school-level arithmetic problems, and up to 2.16x on MATH-500, which handles high school-to-competition level mathematics.<\/p>\n<h2>Strengths and Use Cases<\/h2>\n<p>Raon-1-mini-preview excels at logical reasoning assuming a thinking mode, autonomous agent workflows, and multilingual conversation centered around Korean.<\/p>\n<p>According to the model card, the model has been trained in Korean, English, Japanese, Chinese, Spanish, French, and Thai, featuring fluent conversational ability and practical English performance particularly in Korean. Because it natively supports a massive context length of 262,144 tokens, it is also suited for long-text reading comprehension referencing huge documents or tasks requiring the retention of long-term conversation history.<\/p>\n<p>Additionally, tool calling is built-in as a feature for agent tasks, and integration with agent execution environments such as Hermes Agent, Pi, and OpenCode is officially guided. It demonstrates solid performance in instruction-following, search, and coding fields, making it suitable for complex task processing that combines deep reasoning via thought processes, programming, and the automated execution of various tools.<\/p>\n<p>As recommended generation sampling parameters, it is suggested to enable the thinking mode and set temperature to 1.0, top_p to 0.95, and top_k to 20. It is also specified to set <code>presence_penalty<\/code> to 1.5 for chat, summarization, knowledge QA, and agent tasks, while setting <code>presence_penalty<\/code> to 0.0 for coding and math tasks.<\/p>\n<p><!-- lmw:hardware --><\/p>\n<h2>Hardware Requirements<\/h2>\n<p><strong>Estimated requirements (calculated by Local Model Watch)<\/strong> \u2014 28.8B parameters<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Your VRAM<\/th>\n<th>Quantization<\/th>\n<th>File size<\/th>\n<th>Est. memory needed<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>24GB (RTX 4090 \/ 3090, etc.)<\/td>\n<td>Q4_K_M<\/td>\n<td>18.3GB<\/td>\n<td>22.0GB<\/td>\n<\/tr>\n<tr>\n<td>32GB (RTX 5090, etc.)<\/td>\n<td>Q6_K<\/td>\n<td>24.1GB<\/td>\n<td>28.9GB<\/td>\n<\/tr>\n<tr>\n<td>48GB (RTX 6000 Ada \/ A6000, etc.)<\/td>\n<td>Q8_0<\/td>\n<td>28.6GB<\/td>\n<td>34.3GB<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><strong>Inference engine support<\/strong> (architecture name matched against each project&#8217;s own model registry in its source code, checked 2026-11-17): llama.cpp: not registered, vLLM: not registered, MLX (mlx-lm): not registered. &#8220;Not registered&#8221; means the name is absent from that registry today, not that the model cannot run.<\/p>\n<p><em>Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model&#8217;s authors. File sizes are measured from the converted build <a href=\"https:\/\/huggingface.co\/KRAFTON\/Raon-1-mini-preview-gguf\">KRAFTON\/Raon-1-mini-preview-gguf<\/a>. Compare with other models in our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference<\/a>. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<p><!-- \/lmw:hardware --><\/p>\n<p><!-- lmw:runnability --><\/p>\n<h2>Can You Run It Locally?<\/h2>\n<p><strong>Runs in Ollama, LM Studio and llama.cpp via a converted build.<\/strong><\/p>\n<p>The publisher ships safetensors, but <a href=\"https:\/\/huggingface.co\/KRAFTON\/Raon-1-mini-preview-gguf\">KRAFTON\/Raon-1-mini-preview-gguf<\/a> provides a GGUF build you can use.<\/p>\n<p><strong>License \u2014 <code>apache-2.0<\/code> (Commercial use allowed):<\/strong> Permits commercial use, modification and redistribution. Redistribution requires including the license and stating changes; includes a patent grant.<\/p>\n<p><strong>Compression:<\/strong> the Q4_K_M build measures 5.46 bits per weight \u2014 about 34% the size of the original 16-bit weights, calculated by this site from the actual file sizes.<\/p>\n<p><em>Compiled by this site&#8217;s code from the published formats, converted builds we have found, and each engine&#8217;s own model registry. &#8220;Not found&#8221; means we have not seen such a build, not that none exists. License summaries are not legal advice \u2014 check the publisher&#8217;s original terms before relying on them.<\/em><\/p>\n<p><!-- \/lmw:runnability --><\/p>\n<p><!-- lmw:peers --><\/p>\n<h2>Recent Models in the Same Size Class<\/h2>\n<p><em>Models with <\/em><em>15\u201340B<\/em><em> parameters that Local Model Watch covered recently, listed by code from our article log for comparison. VRAM tiers are this site&#8217;s estimates; licenses are as stated on the model cards.<\/em><\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Model<\/th>\n<th>Parameters<\/th>\n<th>Smallest VRAM tier<\/th>\n<th>License<\/th>\n<th>Our article<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>LiquidAI\/LFM2.5-24B-A2B-Base<\/td>\n<td>24.0B<\/td>\n<td>80GB<\/td>\n<td>lfm1.0<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/liquidai-lfm2-5-24b-a2b-2\/\">LiquidAI Releases LFM2.5-24B-A2B for On-Device Agents<\/a> (2026-11-17)<\/td>\n<\/tr>\n<tr>\n<td>LiquidAI\/LFM2.5-24B-A2B-FP8<\/td>\n<td>24.0B<\/td>\n<td>32GB<\/td>\n<td>lfm1.0<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/liquidai-lfm2-5-24b-a2b-fp8-released\/\">LFM2.5-24B-A2B-FP8 Text Generation Model: 32GB+ VRAM<\/a> (2026-11-17)<\/td>\n<\/tr>\n<tr>\n<td>LiquidAI\/LFM2.5-24B-A2B-MLX-bf16<\/td>\n<td>24.0B<\/td>\n<td>80GB<\/td>\n<td>lfm1.0<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/liquidai-lfm2-5-24b-a2b-mlx-bf16-2\/\">LFM2.5-24B-A2B-MLX-bf16 Reasoning Model for Apple Silicon: 80GB+ VRAM<\/a> (2026-11-17)<\/td>\n<\/tr>\n<tr>\n<td>LiquidAI\/LFM2.5-24B-A2B-MLX-8bit<\/td>\n<td>24.0B<\/td>\n<td>32GB<\/td>\n<td>lfm1.0<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/liquidai-lfm2-5-24b-a2b-mlx-8bit\/\">LFM2.5-24B-A2B-MLX-8bit Text Generation Model: 32GB+ VRAM<\/a> (2026-11-17)<\/td>\n<\/tr>\n<tr>\n<td>LiquidAI\/LFM2.5-24B-A2B<\/td>\n<td>24.0B<\/td>\n<td>12GB<\/td>\n<td>lfm1.0<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/liquidai-lfm25-24b-a2b\/\">LFM2.5-24B-A2B Agent-Optimized MoE Reasoning Model: 12GB+ VRAM<\/a> (2026-11-17)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><!-- \/lmw:peers --><\/p>\n<h2>How to Get It<\/h2>\n<p>Weights for Raon-1-mini-preview are released under the Apache 2.0 license. The base model is distributed in safetensors format (MXFP8), alongside a variety of formats such as NVFP4 format, GGUF format for llama.cpp, and MLX format for Apple Silicon. Note that the Hugging Face repository is gated, and you must request access on the model page (requests are approved automatically). Authentication using <code>huggingface-cli<\/code> or <code>hf auth login<\/code> must be completed before downloading.<\/p>\n<p>Usage methods for major inference environments are as follows:<\/p>\n<h3>Running with Transformers<\/h3>\n<p>To load and run directly from Hugging Face Transformers in a Python environment, install the dependency libraries as follows, allow remote code execution, and load the model.<\/p>\n<pre><code class=\"language-bash\">pip install &quot;transformers==5.16.1&quot; &quot;accelerate==1.15.0&quot;\n<\/code><\/pre>\n<pre><code class=\"language-python\">from transformers import AutoModelForCausalLM, AutoTokenizer\n\nmodel_id = &quot;KRAFTON\/Raon-1-mini-preview&quot;\n\ntokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)\nmodel = AutoModelForCausalLM.from_pretrained(\n    model_id,\n    dtype=&quot;auto&quot;,\n    device_map=&quot;auto&quot;,\n    trust_remote_code=True,\n)\n\nmessages = [{&quot;role&quot;: &quot;user&quot;, &quot;content&quot;: &quot;Tell me about KRAFTON AI.&quot;}]\ninputs = tokenizer.apply_chat_template(\n    messages,\n    add_generation_prompt=True,\n    tokenize=True,\n    return_dict=True,\n    return_tensors=&quot;pt&quot;,\n    enable_thinking=True,\n    truncate_history_thinking=False,\n).to(model.device)\n\noutputs = model.generate(\n    **inputs,\n    max_new_tokens=32768,\n    do_sample=True,\n    temperature=1.0,\n    top_p=0.95,\n    top_k=20,\n    min_p=0.0,\n    repetition_penalty=1.0,\n    presence_penalty=1.5,\n)\n<\/code><\/pre>\n<p>Since the thinking process is output separated by <code>&lt;\/think&gt;<\/code> tags within the generated text, the structure is designed to split and extract strings before and after the tags.<\/p>\n<h3>Serving with vLLM<\/h3>\n<p>When operating as an OpenAI-compatible API server, use the custom fork of vLLM provided by the publisher. It can be started with tool calling and speculative decoding via DFlash2 enabled.<\/p>\n<pre><code class=\"language-bash\">VLLM_REF=&quot;raon-1-mini-preview&quot;\npip install &quot;vllm @ git+https:\/\/github.com\/krafton-ai\/vllm.git@${VLLM_REF}&quot;\n\nvllm serve KRAFTON\/Raon-1-mini-preview \\\n    --host 127.0.0.1 \\\n    --port 8000 \\\n    --served-model-name Raon-1-mini-preview \\\n    --max-model-len 262144 \\\n    --max-num-batched-tokens 16384 \\\n    --max-num-seqs 128 \\\n    --gpu-memory-utilization 0.85 \\\n    --kv-cache-dtype fp8_e4m3 \\\n    --enable-prefix-caching \\\n    --spec-method dflash \\\n    --spec-model KRAFTON\/Raon-1-mini-preview-dflash2 \\\n    --spec-tokens 7 \\\n    --reasoning-parser raon_1 \\\n    --enable-auto-tool-choice \\\n    --tool-call-parser raon_1 \\\n    --default-chat-template-kwargs '{\n      &quot;enable_thinking&quot;: true,\n      &quot;truncate_history_thinking&quot;: false\n    }'\n<\/code><\/pre>\n<p>A profile targeting NVFP4 format checkpoints (<code>KRAFTON\/Raon-1-mini-preview-nvfp4<\/code>) is also provided.<\/p>\n<h3>Running with llama.cpp<\/h3>\n<p>When running the GGUF version using llama.cpp, build from the corresponding dedicated branch. Use <code>KRAFTON\/Raon-1-mini-preview-gguf<\/code> for the checkpoint.<\/p>\n<pre><code class=\"language-bash\">git clone -b raon-1-mini-preview https:\/\/github.com\/krafton-ai\/llama.cpp\ncd llama.cpp\ncmake -B build -DGGML_CUDA=ON\ncmake --build build --config Release -j\n<\/code><\/pre>\n<p>After building, it can be run as a CLI chat tool or an OpenAI-compatible server. Model files are downloaded automatically by specifying them as arguments.<\/p>\n<pre><code class=\"language-bash\">.\/build\/bin\/llama-cli \\\n    -hf KRAFTON\/Raon-1-mini-preview-gguf:Q4_K_M \\\n    --ctx-size 262144 \\\n    --n-predict 32768 \\\n    --temp 1.0 \\\n    --top-p 0.95 \\\n    --top-k 20 \\\n    --min-p 0.0 \\\n    --repeat-penalty 1.0 \\\n    --frequency-penalty 0.0 \\\n    --presence-penalty 1.5 \\\n    --reasoning on \\\n    --chat-template-kwargs '{\n      &quot;enable_thinking&quot;: true,\n      &quot;truncate_history_thinking&quot;: false\n    }'\n<\/code><\/pre>\n<h3>Running with MLX<\/h3>\n<p>On Apple Silicon Macs, by utilizing the specially converted <code>KRAFTON\/Raon-1-mini-preview-mlx<\/code>, it is possible to launch an OpenAI-compatible endpoint via Python scripts or <code>mlx_lm server<\/code>.<\/p>\n<p><!-- lmw:variants --><\/p>\n<h2>Quantized and Converted Variants<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Added<\/th>\n<th>Publisher<\/th>\n<th>Format<\/th>\n<th>Repository<\/th>\n<th>Smallest VRAM tier (build, est. memory)<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>2026-11-17<\/td>\n<td>KRAFTON<\/td>\n<td>GGUF (imatrix)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/KRAFTON\/Raon-1-mini-preview-gguf\">KRAFTON\/Raon-1-mini-preview-gguf<\/a><\/td>\n<td>Q4_K_M 22.0GB (fits in 24GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-11-17<\/td>\n<td>KRAFTON<\/td>\n<td>MLX<\/td>\n<td><a href=\"https:\/\/huggingface.co\/KRAFTON\/Raon-1-mini-preview-mlx\">KRAFTON\/Raon-1-mini-preview-mlx<\/a><\/td>\n<td>MLX 19.6GB (fits in 24GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-11-17<\/td>\n<td>KRAFTON<\/td>\n<td>NVFP4<\/td>\n<td><a href=\"https:\/\/huggingface.co\/KRAFTON\/Raon-1-mini-preview-nvfp4\">KRAFTON\/Raon-1-mini-preview-nvfp4<\/a><\/td>\n<td>&#8211;<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>File sizes of each build:<\/p>\n<ul>\n<li>Available builds in KRAFTON\/Raon-1-mini-preview-gguf: IQ4_XS 15.0GB \/ Q4_K_M 18.3GB \/ Q5_K_M 20.7GB \/ Q6_K 24.1GB \/ Q8_0 28.6GB<\/li>\n<li>Available builds in KRAFTON\/Raon-1-mini-preview-mlx: MLX 16.3GB<\/li>\n<\/ul>\n<p>In addition, 9 converted build(s) from other uploaders exist on Hugging Face; this site lists only builds from the model&#8217;s publisher or established quantization maintainers.<\/p>\n<p><em>This section is appended automatically by Local Model Watch when a converted build of this model appears after publication. Memory figures are estimated from the size of the distributed files. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<p><!-- \/lmw:variants --><\/p>\n<p><!-- lmw:same-task --><\/p>\n<h2>Other Models for the Same Task<\/h2>\n<p><em>Recent text generation models covered by Local Model Watch, newest first. Grouped by the task each publisher declares on Hugging Face (pipeline_tag); the smallest VRAM tier is this site&#8217;s estimate.<\/em><\/p>\n<ul>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/plamo-3-8b-fin-instruct-2\/\">plamo-3-8b-fin-instruct Text Generation Model: 4GB+ VRAM, GGUF Builds<\/a> (8.5B, 4GB)<\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/tencent-qwen3-8-27b-dspine-b16\/\">Qwen3.8-27B-DSpine-b16 Draft Model for Speculative Decoding: 8GB+ VRAM<\/a> (2.0B, 8GB)<\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/arete-27b-released\/\">Arete-27B Text Generation Model: 12GB+ VRAM, GGUF Builds<\/a> (27.4B, 12GB)<\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/bytedance-seed-releases-cola2-language-model\/\">ByteDance-Seed Releases Cola2 Language Model<\/a> (8.8B, 48GB)<\/li>\n<\/ul>\n<p><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/models-by-task-en\/#task-text\">See all text generation models \u2192<\/a><\/p>\n<p><!-- \/lmw:same-task --><\/p>\n<p><!-- lmw:next-steps --><\/p>\n<h2>What to Read Next<\/h2>\n<ul>\n<li><strong>Find models by VRAM<\/strong> (This model runs from the 24GB tier) \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-24gb-en\/\">Other models that run on a 24GB GPU<\/a><\/li>\n<li><strong>Explore the same model family<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/model-krafton-raon-1-en\/\">Raon-1 family overview (1 articles, 3 converted builds)<\/a><\/li>\n<li><strong>Engines that run this model<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-llama-cpp-en\/\">llama.cpp<\/a> \/ <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-ollama-en\/\">Ollama<\/a><\/li>\n<li><strong>What Q4_K_M, Q6_K, Q8_0 mean and where to get this model<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-gguf-en\/\">GGUF format guide and models<\/a> \/ <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-mlx-en\/\">MLX format guide and models<\/a> \/ <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-fp4-en\/\">NVFP4 \/ MXFP4 format guide and models<\/a> \/ <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">Quantization and model-format glossary<\/a><\/li>\n<li><strong>How to read MMLU-Pro, GPQA Diamond, AIME<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-benchmarks-en\/\">Benchmark glossary<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:next-steps --><\/p>\n<h2>Sources<\/h2>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/KRAFTON\/Raon-1-mini-preview\">KRAFTON\/Raon-1-mini-preview (Hugging Face)<\/a><\/li>\n<\/ul>\n<p><!-- lmw:updates --><\/p>\n<h2>Update History<\/h2>\n<ul>\n<li>2026-11-17: Added converted builds to \u201cQuantized and Converted Variants\u201d: KRAFTON\/Raon-1-mini-preview-gguf, KRAFTON\/Raon-1-mini-preview-mlx, KRAFTON\/Raon-1-mini-preview-nvfp4<\/li>\n<li>2026-11-17: Updated the hardware requirements table with the actual file sizes of KRAFTON\/Raon-1-mini-preview-gguf.<\/li>\n<li>2026-11-17: Changed the title to show what the article covers (VRAM requirements, file list, etc.).<\/li>\n<\/ul>\n<p><!-- \/lmw:updates --><\/p>\n","protected":false},"excerpt":{"rendered":"<p>KRAFTON AI has released Raon-1-mini-preview, a 28.8B mixture-of-experts model featuring native thinking mode and strong Korean language capabilities.<\/p>\n","protected":false},"author":1,"featured_media":16878,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[310],"tags":[163,3952,977,165,3954,3956,1547,1555],"class_list":["post-12962","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-new-models","tag-gguf-en","tag-krafton-en","tag-mlx-en","tag-moe-en","tag-raon-1-mini-en","tag-raon-1-mini-preview-en","tag-verified","tag--en"],"lang":"en","translations":{"en":12962,"ja":12960},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/12962","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=12962"}],"version-history":[{"count":5,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/12962\/revisions"}],"predecessor-version":[{"id":17903,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/12962\/revisions\/17903"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media\/16878"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=12962"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/categories?post=12962"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/tags?post=12962"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}