{"id":4271,"date":"2026-09-25T17:59:44","date_gmt":"2026-09-25T08:59:44","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/model-openbmb-minicpm5-en\/"},"modified":"2026-09-28T05:32:17","modified_gmt":"2026-09-27T20:32:17","slug":"model-openbmb-minicpm5-en","status":"publish","type":"page","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/model-openbmb-minicpm5-en\/","title":{"rendered":"MiniCPM5 Guide: VRAM Requirements, GGUF Builds"},"content":{"rendered":"<h2>About This Model<\/h2>\n<p><strong>MiniCPM5<\/strong> is OpenBMB&#8217;s series of small language models, designed from the start to <strong>run on-device<\/strong>\u2014on phones and laptops. Following the 1B model, the second release is <strong>MiniCPM5-2B<\/strong>, a dense model with about 2.5B parameters.<\/p>\n<p>The architecture is a plain Llama-style model (<code>LlamaForCausalLM<\/code>) with a 131,072-token context window. Because it needs no special implementation, common tools such as llama.cpp, Ollama and LM Studio handle it as-is. The publisher itself distributes <strong>GGUF, MLX (for Apple Silicon) and GPTQ (4-bit)<\/strong> builds, plus a draft model for faster inference (DSpark) and intermediate training checkpoints (Base, Midtrain, SFT).<\/p>\n<h2>What Makes It Stand Out<\/h2>\n<p>The publisher bills it as the best open model in the 2B class, with an average score of <strong>53.9<\/strong> across its comparison table. That is far ahead of the 2B-class LFM2.5-2.6B (33.2) and Qwen3.5-2B (28.0), and <strong>higher than Qwen3.5-4B (51.1), a model twice its size.<\/strong> Broken down by benchmark, its strengths and weaknesses are clear:<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Benchmark (what it measures)<\/th>\n<th style=\"text-align: right;\">MiniCPM5-2B<\/th>\n<th style=\"text-align: right;\">Qwen3.5-2B<\/th>\n<th style=\"text-align: right;\">LFM2.5-2.6B<\/th>\n<th style=\"text-align: right;\">Qwen3.5-4B (reference)<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>LiveCodeBench v6 (programming)<\/td>\n<td style=\"text-align: right;\"><strong>69.1<\/strong><\/td>\n<td style=\"text-align: right;\">20.2<\/td>\n<td style=\"text-align: right;\">42.1<\/td>\n<td style=\"text-align: right;\">56.4<\/td>\n<\/tr>\n<tr>\n<td>AIME 2026 (math)<\/td>\n<td style=\"text-align: right;\"><strong>86.5<\/strong><\/td>\n<td style=\"text-align: right;\">29.0<\/td>\n<td style=\"text-align: right;\">45.2<\/td>\n<td style=\"text-align: right;\">82.7<\/td>\n<\/tr>\n<tr>\n<td>SWE-bench Verified (fixing real bugs)<\/td>\n<td style=\"text-align: right;\"><strong>46.4<\/strong><\/td>\n<td style=\"text-align: right;\">5.0<\/td>\n<td style=\"text-align: right;\">6.0<\/td>\n<td style=\"text-align: right;\">33.6<\/td>\n<\/tr>\n<tr>\n<td>NoLiMa (long-document comprehension)<\/td>\n<td style=\"text-align: right;\"><strong>68.1<\/strong><\/td>\n<td style=\"text-align: right;\">17.1<\/td>\n<td style=\"text-align: right;\">0.7<\/td>\n<td style=\"text-align: right;\">43.5<\/td>\n<\/tr>\n<tr>\n<td>BFCL v4 (tool calling)<\/td>\n<td style=\"text-align: right;\"><strong>66.6<\/strong><\/td>\n<td style=\"text-align: right;\">43.6<\/td>\n<td style=\"text-align: right;\">61.1<\/td>\n<td style=\"text-align: right;\">56.8<\/td>\n<\/tr>\n<tr>\n<td>IFEval (instruction following)<\/td>\n<td style=\"text-align: right;\">86.7<\/td>\n<td style=\"text-align: right;\">77.5<\/td>\n<td style=\"text-align: right;\"><strong>93.4<\/strong><\/td>\n<td style=\"text-align: right;\">90.2<\/td>\n<\/tr>\n<tr>\n<td>MMLU-Pro (broad knowledge)<\/td>\n<td style=\"text-align: right;\">70.8<\/td>\n<td style=\"text-align: right;\">64.3<\/td>\n<td style=\"text-align: right;\">65.2<\/td>\n<td style=\"text-align: right;\"><strong>78.0<\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<ul>\n<li><strong>On programming, math and tool calling, it beats Qwen3.5-4B, a model twice its size.<\/strong> Its 46.4 on SWE-bench Verified, which asks the model to fix bugs in real repositories, is also far ahead of the other 2B-class models (2\u20136).<\/li>\n<li><strong>Long-context and agentic results are mixed.<\/strong> It beats the 4B model on the long-context NoLiMa, but the 4B model is ahead on AA-LCR, LongBenchPro and LongBench v2, and on the harder SWE-bench Pro (14.4 vs 28.2) and Terminal-Bench (8.6 vs 25.8).<\/li>\n<li><strong>On the other hand, it trails the 4B model on breadth of knowledge (MMLU-Pro) and on following detailed instructions (IFEval).<\/strong> With fewer parameters, it can only memorize so much. It is better suited to working with code and documents you give it than to answering general-knowledge questions.<\/li>\n<\/ul>\n<p>All figures are as published on the model card.<\/p>\n<h2>Running It Locally<\/h2>\n<ul>\n<li><strong>At about 2.5B parameters, it is small enough for a 4GB-class GPU or even a laptop without a discrete GPU.<\/strong> With the official GGUF build you can try it right away in llama.cpp, Ollama or LM Studio. Mac users can use the official MLX build.<\/li>\n<li>The 131K-token context lets you pass in long documents or whole codebases (memory use grows with context length).<\/li>\n<li><strong>The license is Apache-2.0, which allows commercial use.<\/strong><\/li>\n<\/ul>\n<p><em>Source: <a href=\"https:\/\/huggingface.co\/openbmb\/MiniCPM5-2B\">openbmb\/MiniCPM5-2B model card<\/a>, as of 2026-09-25. Benchmark figures are as published by OpenBMB.<\/em><\/p>\n<h2>Our Coverage and Data<\/h2>\n<p>Everything Local Model Watch has published about the <strong>MiniCPM5<\/strong> family: 1 article(s) covering the base model and its fine-tunes, plus converted builds we tracked after publication. Memory requirements below are computed by this site from file sizes, not quoted from model cards. Part of our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/models-en\/\">model family index<\/a>.<\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Base model(s)<\/td>\n<td><a href=\"https:\/\/huggingface.co\/openbmb\/MiniCPM5-2B\">openbmb\/MiniCPM5-2B<\/a><\/td>\n<\/tr>\n<tr>\n<td>Publisher<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-openbmb-en\/\">OpenBMB<\/a><\/td>\n<\/tr>\n<tr>\n<td>Parameters<\/td>\n<td>2.5B<\/td>\n<\/tr>\n<tr>\n<td>License (model card)<\/td>\n<td>apache-2.0<\/td>\n<\/tr>\n<tr>\n<td>Smallest VRAM tier<\/td>\n<td>4GB<\/td>\n<\/tr>\n<tr>\n<td>Articles<\/td>\n<td>1<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<h2>Hardware Requirements<\/h2>\n<p><strong>Estimated requirements (calculated by Local Model Watch)<\/strong> \u2014 2.5B parameters<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Your VRAM<\/th>\n<th>Quantization<\/th>\n<th>File size<\/th>\n<th>Est. memory needed<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>4GB (laptop iGPU \/ phone class)<\/td>\n<td>Q8_0<\/td>\n<td>2.5GB<\/td>\n<td>3.0GB<\/td>\n<\/tr>\n<tr>\n<td>8GB (RTX 4060 \/ 3060 Ti, etc.)<\/td>\n<td>F16<\/td>\n<td>4.7GB<\/td>\n<td>5.6GB<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model&#8217;s authors. File sizes are measured from the converted build <a href=\"https:\/\/huggingface.co\/openbmb\/MiniCPM5-2B-GGUF\">openbmb\/MiniCPM5-2B-GGUF<\/a>. Compare with other models in our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference<\/a>. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<h2>Can You Run It Locally?<\/h2>\n<p><strong>Runs in Ollama, LM Studio and llama.cpp via a converted build.<\/strong><\/p>\n<p>The publisher ships safetensors, but <a href=\"https:\/\/huggingface.co\/openbmb\/MiniCPM5-2B-GGUF\">openbmb\/MiniCPM5-2B-GGUF<\/a> provides a GGUF build you can use.<\/p>\n<p><strong>License \u2014 <code>apache-2.0<\/code> (Commercial use allowed):<\/strong> Permits commercial use, modification and redistribution. Redistribution requires including the license and stating changes; includes a patent grant.<\/p>\n<p><strong>Compression:<\/strong> the Q8_0 build measures 8.53 bits per weight \u2014 about 53% the size of the original 16-bit weights, calculated by this site from the actual file sizes.<\/p>\n<p><em>Compiled by this site&#8217;s code from the published formats, converted builds we have found, and each engine&#8217;s own model registry. &#8220;Not found&#8221; means we have not seen such a build, not that none exists. License summaries are not legal advice \u2014 check the publisher&#8217;s original terms before relying on them.<\/em><\/p>\n<h2>Quantized and Converted Variants<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Added<\/th>\n<th>Publisher<\/th>\n<th>Format<\/th>\n<th>Repository<\/th>\n<th>Smallest VRAM tier (build, est. memory)<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>2026-09-18<\/td>\n<td>openbmb<\/td>\n<td>GGUF<\/td>\n<td><a href=\"https:\/\/huggingface.co\/openbmb\/MiniCPM5-2B-GGUF\">openbmb\/MiniCPM5-2B-GGUF<\/a><\/td>\n<td>Q8_0 3.0GB (fits in 4GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-09-18<\/td>\n<td>openbmb<\/td>\n<td>MLX<\/td>\n<td><a href=\"https:\/\/huggingface.co\/openbmb\/MiniCPM5-2B-MLX\">openbmb\/MiniCPM5-2B-MLX<\/a><\/td>\n<td>MLX 1.6GB (fits in 4GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-09-18<\/td>\n<td>bartowski<\/td>\n<td>GGUF<\/td>\n<td><a href=\"https:\/\/huggingface.co\/bartowski\/MiniCPM5-2B-GGUF\">bartowski\/MiniCPM5-2B-GGUF<\/a><\/td>\n<td>Q8_0 3.0GB (fits in 4GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-09-18<\/td>\n<td>openbmb<\/td>\n<td>GPTQ<\/td>\n<td><a href=\"https:\/\/huggingface.co\/openbmb\/MiniCPM5-2B-GPTQ\">openbmb\/MiniCPM5-2B-GPTQ<\/a><\/td>\n<td>GPTQ 2.3GB (fits in 4GB VRAM)<\/td>\n<\/tr>\n<tr>\n<td>2026-09-18<\/td>\n<td>mlx-community<\/td>\n<td>MLX<\/td>\n<td><a href=\"https:\/\/huggingface.co\/mlx-community\/MiniCPM5-2B-8bit\">mlx-community\/MiniCPM5-2B-8bit<\/a><\/td>\n<td>MLX 8bit 3.0GB (fits in 4GB VRAM)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>This section is appended automatically by Local Model Watch when a converted build of this model appears after publication. Memory figures are estimated from the size of the distributed files.<\/em><\/p>\n<h2>Articles (the family&#8217;s own models first, then newest)<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Published<\/th>\n<th>Model<\/th>\n<th>Type<\/th>\n<th>Article<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>2026-09-08<\/td>\n<td>openbmb\/MiniCPM5-2B<\/td>\n<td>New Models<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/09\/08\/minicpm5-2b-released\/\">MiniCPM5-2B On-Device Model Strong in Code and Math: 4GB+ VRAM<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<h2>Repositories<\/h2>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/openbmb\/MiniCPM5-2B\">openbmb\/MiniCPM5-2B<\/a><\/li>\n<\/ul>\n<p><em>Last updated 2026-09-28 (JST). The explanation at the top of this page was written with the help of AI from the primary sources it cites. The tables and lists under &#8220;Our Coverage and Data&#8221; are assembled by code from our article log.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>About This Model MiniCPM5 is OpenBMB&#8217;s series of small language models, designed from the start to run on-device\u2014on phones and laptops. Following the 1B model, the second release is MiniCPM5-2B, a dense model with about 2.5B parameters. The architecture is a plain Llama-style model (LlamaForCausalLM) with a 131,072-token context window. Because it needs no special [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-4271","page","type-page","status-publish","hentry"],"lang":"en","translations":{"en":4271,"ja":4270},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/4271","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=4271"}],"version-history":[{"count":5,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/4271\/revisions"}],"predecessor-version":[{"id":5980,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/4271\/revisions\/5980"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=4271"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}