{"id":11854,"date":"2026-11-17T11:00:35","date_gmt":"2026-11-17T02:00:35","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/?p=11854"},"modified":"2026-11-17T11:09:46","modified_gmt":"2026-11-17T02:09:46","slug":"jais-3-mova-36b-a4b-gguf","status":"publish","type":"post","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/jais-3-mova-36b-a4b-gguf\/","title":{"rendered":"Jais-3-MoVA-36B-A4B-GGUF Text Generation Model: 32GB+ VRAM"},"content":{"rendered":"<p><!-- lmw:facts --><\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Repository<\/td>\n<td><a href=\"https:\/\/huggingface.co\/IFM\/Jais-3-MoVA-36B-A4B-GGUF\">IFM\/Jais-3-MoVA-36B-A4B-GGUF<\/a><\/td>\n<\/tr>\n<tr>\n<td>Publisher guide<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-ifm-en\/\">IFM (MBZUAI): models and licenses<\/a><\/td>\n<\/tr>\n<tr>\n<td>Published<\/td>\n<td>2026-10-12<\/td>\n<\/tr>\n<tr>\n<td>License<\/td>\n<td>apache-2.0<\/td>\n<\/tr>\n<tr>\n<td>Formats<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-gguf-en\/\">GGUF<\/a><\/td>\n<\/tr>\n<tr>\n<td>Source type<\/td>\n<td>Primary source (the publisher itself)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Values determined by this site&#8217;s code when the information was collected. Dates are JST.<\/em><\/p>\n<p><!-- \/lmw:facts --><\/p>\n<h2>Overview<\/h2>\n<p>IFM has released GGUF format models for &#8220;Jais-3-MoVA-36B-A4B&#8221;, a large language model for Arabic and English developed by inception42.<\/p>\n<p>Jais-3-MoVA-36B-A4B adopts a Mixture-of-Experts (MoE) architecture featuring Mixture-of-Values attention (MoVA), operating with 4B active parameters per token out of a total of 36B parameters. It also supports an extensive context length of 512K tokens.<\/p>\n<p>In this repository, various quantization variants from BF16 down to Q4_K_M are provided in GGUF format compatible with llama.cpp, allowing selection to match local hardware configurations.<\/p>\n<h2>Specifications<\/h2>\n<ul>\n<li>Total parameters: 36B<\/li>\n<li>Activated parameters: 4B (per token)<\/li>\n<li>Architecture: MoE (Mixture-of-Experts with Mixture-of-Values attention \/ K2HorizonForCausalLM)<\/li>\n<li>Context length: 512K<\/li>\n<\/ul>\n<h2>Performance<\/h2>\n<p>Performance data listed in the model card are measurement results from the publisher on the original BF16 checkpoint, rather than unique measured values of the quantized versions. The model card notes that individual evaluations for the quantization variants have not yet been conducted.<\/p>\n<p>Comparison tables with open-weight models of a similar scale published in the model card are shown below (some columns and rows are based on the model card descriptions).<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Domain \/ Benchmark Item<\/th>\n<th>Jais-3-MoVA-36B-A4B<\/th>\n<th>Falcon-H1-34B-Instruct<\/th>\n<th>Gemma-4-31B-it<\/th>\n<th>Muse-Glimmer-30B<\/th>\n<th>Qwen3.8-27B<\/th>\n<th>Fanar-2-27B<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td><strong>Architecture Information<\/strong><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Total parameters (# Params)<\/td>\n<td>36B<\/td>\n<td>34B<\/td>\n<td>31B<\/td>\n<td>30B<\/td>\n<td>27B<\/td>\n<td>27B<\/td>\n<\/tr>\n<tr>\n<td>Activated parameters (# Activated params)<\/td>\n<td>4B<\/td>\n<td>34B<\/td>\n<td>31B<\/td>\n<td>30B<\/td>\n<td>27B<\/td>\n<td>27B<\/td>\n<\/tr>\n<tr>\n<td>Architecture<\/td>\n<td>MoE<\/td>\n<td>Dense<\/td>\n<td>Dense<\/td>\n<td>Dense<\/td>\n<td>Dense<\/td>\n<td>Dense<\/td>\n<\/tr>\n<tr>\n<td><strong>Open-ended Generation<\/strong><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>AraGen v3 (3C3H) 09-2025<\/td>\n<td>68.6<\/td>\n<td>45.0<\/td>\n<td>73.4<\/td>\n<td>75.6<\/td>\n<td>66.7<\/td>\n<td>55.9<\/td>\n<\/tr>\n<tr>\n<td>Correctness<\/td>\n<td>79.7<\/td>\n<td>53.2<\/td>\n<td>85.4<\/td>\n<td>87.7<\/td>\n<td>77.1<\/td>\n<td>65.7<\/td>\n<\/tr>\n<tr>\n<td>Completeness<\/td>\n<td>78.3<\/td>\n<td>51.0<\/td>\n<td>84.9<\/td>\n<td>87.0<\/td>\n<td>76.2<\/td>\n<td>63.5<\/td>\n<\/tr>\n<tr>\n<td>Conciseness<\/td>\n<td>24.4<\/td>\n<td>19.7<\/td>\n<td>21.1<\/td>\n<td>23.0<\/td>\n<td>23.9<\/td>\n<td>21.6<\/td>\n<\/tr>\n<tr>\n<td>Helpfulness<\/td>\n<td>72.6<\/td>\n<td>45.4<\/td>\n<td>79.7<\/td>\n<td>81.2<\/td>\n<td>71.5<\/td>\n<td>59.0<\/td>\n<\/tr>\n<tr>\n<td>Honesty<\/td>\n<td>77.9<\/td>\n<td>49.0<\/td>\n<td>84.4<\/td>\n<td>86.7<\/td>\n<td>74.7<\/td>\n<td>61.3<\/td>\n<\/tr>\n<tr>\n<td>Harmlessness<\/td>\n<td>78.8<\/td>\n<td>51.4<\/td>\n<td>84.9<\/td>\n<td>87.7<\/td>\n<td>76.5<\/td>\n<td>64.4<\/td>\n<\/tr>\n<tr>\n<td><strong>Knowledge &amp; Reasoning<\/strong><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Arabic MMLU* Accuracy<\/td>\n<td>87.7<\/td>\n<td>73.7<\/td>\n<td>89.5<\/td>\n<td>87.0<\/td>\n<td>85.8<\/td>\n<td>66.3<\/td>\n<\/tr>\n<tr>\n<td>Belebele Accuracy<\/td>\n<td>94.4<\/td>\n<td>86.6<\/td>\n<td>95.9<\/td>\n<td>94.3<\/td>\n<td>94.4<\/td>\n<td>61.8<\/td>\n<\/tr>\n<tr>\n<td>AraSTEM* Accuracy<\/td>\n<td>94.7<\/td>\n<td>85.5<\/td>\n<td>96.3<\/td>\n<td>94.7<\/td>\n<td>95.3<\/td>\n<td>42.4<\/td>\n<\/tr>\n<tr>\n<td>Arabic GSM8K* Accuracy<\/td>\n<td>92.2<\/td>\n<td>90.2<\/td>\n<td>93.7<\/td>\n<td>95.2<\/td>\n<td>93.2<\/td>\n<td>87.7<\/td>\n<\/tr>\n<tr>\n<td>GATmath* Accuracy<\/td>\n<td>97.5<\/td>\n<td>63.4<\/td>\n<td>98.6<\/td>\n<td>98.5<\/td>\n<td>98.4<\/td>\n<td>87.8<\/td>\n<\/tr>\n<tr>\n<td>MedAraBench* Accuracy<\/td>\n<td>85.4<\/td>\n<td>60.7<\/td>\n<td>88.8<\/td>\n<td>86.1<\/td>\n<td>87.3<\/td>\n<td>50.9<\/td>\n<\/tr>\n<tr>\n<td>Arabic Legal (HELM)* Accuracy<\/td>\n<td>69.3<\/td>\n<td>63.1<\/td>\n<td>71.1<\/td>\n<td>73.1<\/td>\n<td>70.5<\/td>\n<td>45.7<\/td>\n<\/tr>\n<tr>\n<td><strong>Arabic Language &amp; Culture<\/strong><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>IslamicQA Accuracy<\/td>\n<td>89.7<\/td>\n<td>71.1<\/td>\n<td>89.7<\/td>\n<td>83.7<\/td>\n<td>77.1<\/td>\n<td>52.0<\/td>\n<\/tr>\n<tr>\n<td>QIAS-1* Accuracy<\/td>\n<td>95.7<\/td>\n<td>56.2<\/td>\n<td>93.2<\/td>\n<td>87.4<\/td>\n<td>81.6<\/td>\n<td>31.4<\/td>\n<\/tr>\n<tr>\n<td>Arab Culture Accuracy<\/td>\n<td>87.5<\/td>\n<td>76.5<\/td>\n<td>90.2<\/td>\n<td>84.6<\/td>\n<td>81.0<\/td>\n<td>41.4<\/td>\n<\/tr>\n<tr>\n<td>Dialectal Arabic MMLU* Accuracy<\/td>\n<td>87.3<\/td>\n<td>71.5<\/td>\n<td>89.4<\/td>\n<td>87.0<\/td>\n<td>87.0<\/td>\n<td>28.2<\/td>\n<\/tr>\n<tr>\n<td>Arabic Linguistics^ Accuracy<\/td>\n<td>94.0<\/td>\n<td>57.4<\/td>\n<td>96.7<\/td>\n<td>91.8<\/td>\n<td>89.7<\/td>\n<td>39.1<\/td>\n<\/tr>\n<tr>\n<td>FLORES200+ LLM-as-a-judge<\/td>\n<td>90.8<\/td>\n<td>70.6<\/td>\n<td>92.8<\/td>\n<td>84.8<\/td>\n<td>81.8<\/td>\n<td>71.2<\/td>\n<\/tr>\n<tr>\n<td><strong>Assistant Capabilities<\/strong><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Arabic IFBench^ Accuracy<\/td>\n<td>92.0<\/td>\n<td>32.2<\/td>\n<td>80.8<\/td>\n<td>84.2<\/td>\n<td>81.3<\/td>\n<td>40.0<\/td>\n<\/tr>\n<tr>\n<td>Arabic IFEval Accuracy<\/td>\n<td>80.0<\/td>\n<td>66.8<\/td>\n<td>78.7<\/td>\n<td>79.5<\/td>\n<td>77.0<\/td>\n<td>49.8<\/td>\n<\/tr>\n<tr>\n<td>AA-LCR (Ar) Accuracy<\/td>\n<td>73.0<\/td>\n<td>14.0<\/td>\n<td>66.0<\/td>\n<td>&#8211;<\/td>\n<td>79.0<\/td>\n<td>&#8211;<\/td>\n<\/tr>\n<tr>\n<td><strong>Factuality &amp; Hallucination<\/strong><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>HalluScore Accuracy<\/td>\n<td>66.0<\/td>\n<td>42.4<\/td>\n<td>69.7<\/td>\n<td>69.1<\/td>\n<td>54.6<\/td>\n<td>41.7<\/td>\n<\/tr>\n<tr>\n<td>SimpleQA Verified (Ar) Non-hallucination rate<\/td>\n<td>83.1<\/td>\n<td>9.4<\/td>\n<td>10.5<\/td>\n<td>3.7<\/td>\n<td>5.4<\/td>\n<td>12.2<\/td>\n<\/tr>\n<tr>\n<td>SimpleQA Verified (Ar) Aggregate<\/td>\n<td>31.5<\/td>\n<td>7.5<\/td>\n<td>10.6<\/td>\n<td>13.3<\/td>\n<td>8.0<\/td>\n<td>11.0<\/td>\n<\/tr>\n<tr>\n<td>SimpleQA Verified (Ar) F-score<\/td>\n<td>5.7<\/td>\n<td>6.6<\/td>\n<td>10.7<\/td>\n<td>18.2<\/td>\n<td>9.2<\/td>\n<td>10.4<\/td>\n<\/tr>\n<tr>\n<td><strong>Agentic<\/strong><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Terminal Bench 2.1 Accuracy (Avg@3)<\/td>\n<td>67.3<\/td>\n<td>1.1<\/td>\n<td>43.5<\/td>\n<td>51.7<\/td>\n<td>79.8<\/td>\n<td>1.1<\/td>\n<\/tr>\n<tr>\n<td>GDPVal Accuracy (@ 75% threshold)<\/td>\n<td>67.7<\/td>\n<td>0.0<\/td>\n<td>30.5<\/td>\n<td>48.2<\/td>\n<td>78.2<\/td>\n<td>0.0<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>From these comparison results, the following points regarding the strengths and weaknesses of the original model can be drawn:<\/p>\n<p>In &#8220;Arabic IFEval&#8221;, which measures instruction-following performance, it recorded 80.0, demonstrating top-tier levels surpassing Gemma-4-31B-it (78.7) and Qwen3.8-27B (77.0). Furthermore, it reaches 92.0 in &#8220;Arabic IFBench&#8221;, showing a significant advantage over the competing Dense models.<\/p>\n<p>In addition, the non-hallucination rate for &#8220;SimpleQA Verified (Ar)&#8221;, which indicates the degree to which fabricated stories are prevented against factual queries, is exceptionally high at 83.1, leaving a prominent result compared to other models which all remain around 10%. In tasks specific to the Arabic language, tendencies toward strong cultural and regional knowledge are exhibited, scoring 89.7 in IslamicQA and 95.7 in QIAS-1.<\/p>\n<p>On the other hand, in &#8220;Arabic GSM8K&#8221; for solving elementary school-level math problems, it stands at 92.2, slightly trailing Muse-Glimmer-30B (95.2) and Gemma-4-31B-it (93.7). Furthermore, it recorded 67.3 in &#8220;Terminal Bench 2.1&#8221;, which evaluates task execution capability for terminal operations; while it significantly outperforms some models like Falcon-H1-34B-Instruct (1.1), it falls far behind Qwen3.8-27B (79.8). Aspects where it falls short of competing powerful Dense models can be seen in agent tasks and certain mathematical domains.<\/p>\n<h2>Strengths and Use Cases<\/h2>\n<p>Jais-3-MoVA-36B-A4B is designed for assistant and agent use cases targeting Arabic and English. It is intended for use in reasoning tasks, complex workflows involving tool calling, as well as various research and experiments.<\/p>\n<p>Main strengths and features seen from the original model&#8217;s design and performance evaluations are as follows:<\/p>\n<ul>\n<li>\n<p><strong>Advanced reasoning and assistant functions in Arabic and English<\/strong><br \/>\n  It demonstrates accuracy exceeding competing models of a similar scale in instruction following (Arabic IFBench and Arabic IFEval), and responses that accurately follow a user&#8217;s detailed constraints and format specifications can be expected. It also features a reasoning capability that separates and outputs the thought process, making it suitable for solving complex problems requiring step-by-step thinking.<\/p>\n<\/li>\n<li>\n<p><strong>Flexible tool calling<\/strong><br \/>\n  It supports the tool calling functionality of the K2 Horizon architecture, allowing agent processing such as external function execution and API integration. In addition to the default XML format (<code>xml<\/code>), call formats correspond to <code>json<\/code> and <code>xml_typed<\/code> (which retains type information), enabling switching according to the usage environment or framework.<\/p>\n<\/li>\n<li>\n<p><strong>Regional, cultural, and linguistic knowledge of the Arabic-speaking sphere<\/strong><br \/>\n  It records extremely high scores in tasks specialized for the Arabic-speaking sphere, such as Islam-related knowledge (IslamicQA), Arab regional cultural understanding (Arab Culture), and regional dialects (Dialectal Arabic MMLU). It holds strengths in text generation reflecting regional-specific contexts and cultural nuances that cannot be fully covered by multilingual models.<\/p>\n<\/li>\n<li>\n<p><strong>High factuality and hallucination suppression<\/strong><br \/>\n  It achieves an outstanding non-hallucination rate (83.1) in &#8220;SimpleQA Verified (Ar)&#8221;, which is an index for avoiding fabricated stories against factual queries. The risk of carelessly generating answers contrary to facts regarding uncertain information is suppressed.<\/p>\n<\/li>\n<\/ul>\n<p>On the other hand, the official model card clearly specifies the following limitations and out-of-scope uses:<\/p>\n<ul>\n<li><strong>Use in unsupported languages<\/strong>: Reliable operation in languages other than Arabic and English is not supported.<\/li>\n<li><strong>High-risk decision-making<\/strong>: Relying on the model for critical judgments in medicine, law, finance, safety management, etc., without appropriate human oversight is not intended.<\/li>\n<li><strong>Harmful and illegal uses<\/strong>: The generation of discriminatory, extremist, or intentionally misleading content, as well as use promoting illegal acts, is prohibited.<\/li>\n<li><strong>Output accuracy and bias<\/strong>: Since incorrect information and biases resulting from training data may be included, prior verification and the application of safeguards are recommended for practical deployment.<\/li>\n<\/ul>\n<p><!-- lmw:hardware --><\/p>\n<h2>Hardware Requirements<\/h2>\n<p><strong>Estimated requirements (calculated by Local Model Watch)<\/strong> \u2014 37.4B parameters (taken from the base model inception42\/Jais-3-MoVA-36B-A4B)<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Your VRAM<\/th>\n<th>Quantization<\/th>\n<th>File size<\/th>\n<th>Est. memory needed<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>32GB (RTX 5090, etc.)<\/td>\n<td>Q5_K_M<\/td>\n<td>24.6GB<\/td>\n<td>29.5GB<\/td>\n<\/tr>\n<tr>\n<td>48GB (RTX 6000 Ada \/ A6000, etc.)<\/td>\n<td>Q8_0<\/td>\n<td>37.1GB<\/td>\n<td>44.5GB<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model&#8217;s authors. Compare with other models in our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference<\/a>. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<p><!-- \/lmw:hardware --><\/p>\n<p><!-- lmw:runnability --><\/p>\n<h2>Can You Run It Locally?<\/h2>\n<p><strong>Runs in Ollama, LM Studio and llama.cpp as-is.<\/strong><\/p>\n<p>It is distributed in GGUF, so no conversion is needed.<\/p>\n<p><strong>License \u2014 <code>apache-2.0<\/code> (Commercial use allowed):<\/strong> Permits commercial use, modification and redistribution. Redistribution requires including the license and stating changes; includes a patent grant.<\/p>\n<p><strong>Compression:<\/strong> the Q5_K_M build measures 5.64 bits per weight \u2014 about 35% the size of the original 16-bit weights, calculated by this site from the actual file sizes.<\/p>\n<p><em>Compiled by this site&#8217;s code from the published formats, converted builds we have found, and each engine&#8217;s own model registry. &#8220;Not found&#8221; means we have not seen such a build, not that none exists. License summaries are not legal advice \u2014 check the publisher&#8217;s original terms before relying on them.<\/em><\/p>\n<p><!-- \/lmw:runnability --><\/p>\n<p><!-- lmw:peers --><\/p>\n<h2>Recent Models in the Same Size Class<\/h2>\n<p><em>Models with <\/em><em>15\u201340B<\/em><em> parameters that Local Model Watch covered recently, listed by code from our article log for comparison. VRAM tiers are this site&#8217;s estimates; licenses are as stated on the model cards.<\/em><\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Model<\/th>\n<th>Parameters<\/th>\n<th>Smallest VRAM tier<\/th>\n<th>License<\/th>\n<th>Our article<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>LiquidAI\/LFM2.5-24B-A2B-Base<\/td>\n<td>24.0B<\/td>\n<td>80GB<\/td>\n<td>lfm1.0<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/liquidai-lfm2-5-24b-a2b-2\/\">LiquidAI Releases LFM2.5-24B-A2B for On-Device Agents<\/a> (2026-11-17)<\/td>\n<\/tr>\n<tr>\n<td>LiquidAI\/LFM2.5-24B-A2B-FP8<\/td>\n<td>24.0B<\/td>\n<td>32GB<\/td>\n<td>lfm1.0<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/liquidai-lfm2-5-24b-a2b-fp8-released\/\">LFM2.5-24B-A2B-FP8 Text Generation Model: 32GB+ VRAM<\/a> (2026-11-17)<\/td>\n<\/tr>\n<tr>\n<td>LiquidAI\/LFM2.5-24B-A2B-MLX-bf16<\/td>\n<td>24.0B<\/td>\n<td>80GB<\/td>\n<td>lfm1.0<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/liquidai-lfm2-5-24b-a2b-mlx-bf16-2\/\">LFM2.5-24B-A2B-MLX-bf16 Reasoning Model for Apple Silicon: 80GB+ VRAM<\/a> (2026-11-17)<\/td>\n<\/tr>\n<tr>\n<td>LiquidAI\/LFM2.5-24B-A2B-MLX-8bit<\/td>\n<td>24.0B<\/td>\n<td>32GB<\/td>\n<td>lfm1.0<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/liquidai-lfm2-5-24b-a2b-mlx-8bit\/\">LFM2.5-24B-A2B-MLX-8bit Text Generation Model: 32GB+ VRAM<\/a> (2026-11-17)<\/td>\n<\/tr>\n<tr>\n<td>LiquidAI\/LFM2.5-24B-A2B<\/td>\n<td>24.0B<\/td>\n<td>12GB<\/td>\n<td>lfm1.0<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/liquidai-lfm25-24b-a2b\/\">LFM2.5-24B-A2B Agent-Optimized MoE Reasoning Model: 12GB+ VRAM<\/a> (2026-11-17)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><!-- \/lmw:peers --><\/p>\n<h2>How to Get It<\/h2>\n<p>This model is available from the Hugging Face <a href=\"https:\/\/huggingface.co\/IFM\/Jais-3-MoVA-36B-A4B-GGUF\">IFM\/Jais-3-MoVA-36B-A4B-GGUF<\/a> repository. The Apache-2.0 license is applied, and it can be downloaded and used without requiring prior agreement to terms of use (gated application).<\/p>\n<p>The distribution format is GGUF, and the following quantization variants are provided:<br \/>\n&#8211; <code>BF16<\/code><br \/>\n&#8211; <code>Q8_0<\/code><br \/>\n&#8211; <code>Q6_K<\/code><br \/>\n&#8211; <code>Q5_K_M<\/code><br \/>\n&#8211; <code>Q5_0<\/code><br \/>\n&#8211; <code>Q4_K_M<\/code><\/p>\n<h3>Running with llama.cpp<\/h3>\n<p>Support for the K2 Horizon architecture adopted by this model has been merged into <code>llama.cpp<\/code> via pull request <a href=\"https:\/\/github.com\/ggml-org\/llama.cpp\/pull\/29535\">ggml-org\/llama.cpp#29535<\/a>. Execution requires the latest <code>llama.cpp<\/code> build or a binary built from the master branch.<\/p>\n<p>Example build and inference server (<code>llama-server<\/code>) startup commands are as follows:<\/p>\n<pre><code class=\"language-shell\">cmake -B build -DGGML_CUDA=ON\ncmake --build build -j --target llama-server\n.\/build\/bin\/llama-server -hf IFM\/Jais-3-MoVA-36B-A4B-GGUF:Q8_0 --jinja -ngl 99 -c 32768 -np 1\n<\/code><\/pre>\n<p>Passing the <code>--jinja<\/code> option at server startup enables the chat template embedded in the model. This automatically parses the control of reasoning depth (<code>reasoning_effort<\/code>) and tool calling in K2 Horizon format, returning the thought content (<code>reasoning_content<\/code>) and final answer (<code>content<\/code>) separately.<\/p>\n<h3>Recommended Sampling Parameters<\/h3>\n<p>Setting parameters recommended by the publisher are as follows. All reported scores are measured with the <code>reasoning_effort=\"high\"<\/code> setting.<\/p>\n<ul>\n<li><strong>Reasoning depth (reasoning_effort)<\/strong>: Specify <code>high<\/code> in principle (<code>{\"reasoning_effort\": \"high\"}<\/code>)<\/li>\n<li><strong>Temperature (temperature)<\/strong>:<\/li>\n<li>Default: <code>0.2<\/code> &#8211; Thinking mode (English): <code>1.0<\/code> &#8211; Thinking mode (Arabic): <code>0.7<\/code><\/li>\n<li><strong>Top-P \/ Top-K<\/strong>: <code>top_p=0.95<\/code>, <code>top_k=20<\/code><\/li>\n<li><strong>Penalty related<\/strong>: <code>min_p=0.0<\/code>, <code>presence_penalty=0.0<\/code>, <code>repetition_penalty=1.0<\/code><\/li>\n<li><strong>Maximum output tokens<\/strong>: 32,768 tokens or more<\/li>\n<\/ul>\n<h3>Other Distribution Formats<\/h3>\n<p>In IFM&#8217;s Hugging Face collection, formats other than GGUF are also published:<br \/>\n&#8211; FP8 quantized version: <a href=\"https:\/\/huggingface.co\/IFM\/Jais-3-MoVA-36B-A4B-FP8\">IFM\/Jais-3-MoVA-36B-A4B-FP8<\/a><br \/>\n&#8211; For Apple Silicon (MLX):<br \/>\n  &#8211; <a href=\"https:\/\/huggingface.co\/IFM\/Jais-3-MoVA-36B-A4B-MLX-4bit\">IFM\/Jais-3-MoVA-36B-A4B-MLX-4bit<\/a> &#8211; <a href=\"https:\/\/huggingface.co\/IFM\/Jais-3-MoVA-36B-A4B-MLX-8bit\">IFM\/Jais-3-MoVA-36B-A4B-MLX-8bit<\/a> &#8211; <a href=\"https:\/\/huggingface.co\/IFM\/Jais-3-MoVA-36B-A4B-MLX-bf16\">IFM\/Jais-3-MoVA-36B-A4B-MLX-bf16<\/a><\/p>\n<p><!-- lmw:related --><\/p>\n<h2>Related Articles<\/h2>\n<ul>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/jais-3-0-9b-gguf-released\/\">Jais-3-0.9B-GGUF Bilingual Dense Model: 4GB+ VRAM<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/ifm-jais-3-37b-gguf\/\">Jais-3-3.7B-GGUF 512K Context Language Model: 4GB+ VRAM<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/jais-3-7b-gguf-local-inference\/\">Jais-3-7B-GGUF Arabic and English 7B Reasoning Model: 8GB+ VRAM<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/jais-3-32b-gguf-released\/\">Jais-3-32B-GGUF Arabic and English 32B Dense Model: 24GB+ VRAM<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:related --><\/p>\n<p><!-- lmw:next-steps --><\/p>\n<h2>What to Read Next<\/h2>\n<ul>\n<li><strong>Find models by VRAM<\/strong> (This model needs at least 32GB) \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference<\/a><\/li>\n<li><strong>Engines that run this model<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-llama-cpp-en\/\">llama.cpp<\/a> \/ <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/engine-ollama-en\/\">Ollama<\/a><\/li>\n<li><strong>What Q5_K_M, Q8_0 mean and where to get this model<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-gguf-en\/\">GGUF format guide and models<\/a> \/ <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">Quantization and model-format glossary<\/a><\/li>\n<li><strong>Learn about the publisher<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-ifm-en\/\">IFM (MBZUAI): models, licenses and articles<\/a><\/li>\n<li><strong>Other models for the same task<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/models-by-task-en\/#task-text\">Other text generation models<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:next-steps --><\/p>\n<h2>Sources<\/h2>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/IFM\/Jais-3-MoVA-36B-A4B-GGUF\">IFM\/Jais-3-MoVA-36B-A4B-GGUF (Hugging Face)<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/inception42\/Jais-3-MoVA-36B-A4B\">inception42\/Jais-3-MoVA-36B-A4B (Hugging Face)<\/a><\/li>\n<li><a href=\"https:\/\/github.com\/ggml-org\/llama.cpp\/pull\/29535\">llama.cpp PR #29535: Support K2 Horizon architecture<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Explore the GGUF release of Jais-3-MoVA-36B-A4B, an Arabic and English MoE language model with 512K context, running locally via llama.cpp.<\/p>\n","protected":false},"author":1,"featured_media":11853,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[310],"tags":[163,2051,3439,3441,1073,165,1547,1555],"class_list":["post-11854","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-new-models","tag-gguf-en","tag-ifm-en","tag-jais-3-mova-en","tag-jais-3-mova-36b-a4b-en","tag-llama-cpp-en","tag-moe-en","tag-verified","tag--en"],"lang":"en","translations":{"en":11854,"ja":11852},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/11854","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=11854"}],"version-history":[{"count":2,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/11854\/revisions"}],"predecessor-version":[{"id":17797,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/11854\/revisions\/17797"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media\/11853"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=11854"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/categories?post=11854"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/tags?post=11854"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}