{"id":20378,"date":"2026-11-19T17:37:22","date_gmt":"2026-11-19T08:37:22","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/2026\/11\/19\/microsoft-aion-1-0-instruct-2-3b\/"},"modified":"2026-11-20T12:13:53","modified_gmt":"2026-11-20T03:13:53","slug":"microsoft-aion-1-0-instruct-2-3b","status":"publish","type":"post","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/19\/microsoft-aion-1-0-instruct-2-3b\/","title":{"rendered":"Aion-1.0-Instruct-2.3B 2.3B Text Generation Model: 8GB+ VRAM"},"content":{"rendered":"<p><!-- lmw:facts --><\/p>\n<h2>At a Glance<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Item<\/th>\n<th>Value<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Repository<\/td>\n<td><a href=\"https:\/\/huggingface.co\/microsoft\/Aion-1.0-Instruct-2.3B\">microsoft\/Aion-1.0-Instruct-2.3B<\/a><\/td>\n<\/tr>\n<tr>\n<td>Family guide<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/model-microsoft-aion-1-0-en\/\">Aion-1.0 guide (2 articles)<\/a><\/td>\n<\/tr>\n<tr>\n<td>Publisher guide<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-microsoft-en\/\">Microsoft: models and licenses<\/a><\/td>\n<\/tr>\n<tr>\n<td>Published<\/td>\n<td>2026-11-19<\/td>\n<\/tr>\n<tr>\n<td>License<\/td>\n<td>mit<\/td>\n<\/tr>\n<tr>\n<td>Formats<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-safetensors-en\/\">safetensors<\/a><\/td>\n<\/tr>\n<tr>\n<td>Source type<\/td>\n<td>Primary source (the publisher itself)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><em>Values determined by this site&#8217;s code when the information was collected. Dates are JST.<\/em><\/p>\n<p><!-- \/lmw:facts --><\/p>\n<p><!-- lmw:lab-summary --><\/p>\n<p><strong>What we checked ourselves<\/strong><\/p>\n<ul>\n<li>It needs about 16% more tokens than the Qwen3 tokenizer for the same Japanese text, so only about 0.87\u00d7 as much Japanese fits in the same context length.<\/li>\n<\/ul>\n<p>Details and conditions are in \u201cOur Own Measurements\u201d below.<\/p>\n<p><!-- \/lmw:lab-summary --><\/p>\n<h2>Overview<\/h2>\n<p>Microsoft&#8217;s Windows Applied Sciences Group has released &#8220;Aion-1.0-Instruct-2.3B&#8221;, a small language model (SLM) designed for on-device environments.<\/p>\n<p>This model is positioned as a foundational SLM within the Windows ecosystem, optimized specifically for use cases such as text processing and OS integration that respond safely and quickly on the device without requiring constant cloud connectivity. An optimized version combined with Microsoft&#8217;s content moderation model is scheduled to be introduced as a Windows OS SLM by the end of January 2027, and this release on Hugging Face aims to ensure transparency and gather user feedback ahead of the upcoming feature rollout. Initially, the unquantized version of the model has been published, with quantized versions planned for the future.<\/p>\n<h2>Specifications<\/h2>\n<p>The specifications listed in the model card are as follows:<\/p>\n<ul>\n<li>Number of parameters: Approx. 2.29 billion (~2.29B, tied input\/output embeddings)<\/li>\n<li>Architecture: Causal language model (instruction-tuned)<\/li>\n<li>Number of layers: 28<\/li>\n<li>Hidden size: 2048<\/li>\n<li>MLP intermediate size: 8192 (SiLU)<\/li>\n<li>Attention: GQA (24 query heads, 8 key\/value heads, head dim 128)<\/li>\n<li>Attention pattern: Hybrid configuration (21 sliding-window layers [window 2048] + 7 full-attention layers)<\/li>\n<li>Position encoding: RoPE (\u03b8 = 32000), YaRN scaling (factor 16) in full-attention layers<\/li>\n<li>Context length: 32,768 tokens<\/li>\n<li>Vocabulary size: 200,029<\/li>\n<li>Precision: bfloat16<\/li>\n<\/ul>\n<h2>Performance<\/h2>\n<p>The evaluation scores measured by Microsoft itself and published in the model card are as follows. EleutherAI&#8217;s lm-evaluation-harness was primarily used for benchmark measurements, and GPT-4o was used as the judge model for tasks requiring LLM-based evaluation.<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Category<\/th>\n<th>Benchmark<\/th>\n<th style=\"text-align: right;\">Score<\/th>\n<th>Notes<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Knowledge<\/td>\n<td>MMLU<\/td>\n<td style=\"text-align: right;\">55.15<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Knowledge<\/td>\n<td>MMLU-Pro<\/td>\n<td style=\"text-align: right;\">33.35<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Knowledge<\/td>\n<td>MMMLU<\/td>\n<td style=\"text-align: right;\">45.51<\/td>\n<td>Multilingual MMLU<\/td>\n<\/tr>\n<tr>\n<td>Knowledge<\/td>\n<td>GPQA<\/td>\n<td style=\"text-align: right;\">28.18<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Math<\/td>\n<td>GSM8K<\/td>\n<td style=\"text-align: right;\">74.91<\/td>\n<td>Loose matching<\/td>\n<\/tr>\n<tr>\n<td>Math<\/td>\n<td>GSMPlus<\/td>\n<td style=\"text-align: right;\">49.56<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Math<\/td>\n<td>MATH-500<\/td>\n<td style=\"text-align: right;\">48.00<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Instruction following<\/td>\n<td>IFEval<\/td>\n<td style=\"text-align: right;\">83.90<\/td>\n<td>Mean of prompt-level strict and instruction-level strict<\/td>\n<\/tr>\n<tr>\n<td>Instruction following<\/td>\n<td>IFBench<\/td>\n<td style=\"text-align: right;\">32.00<\/td>\n<td>Prompt-level loose<\/td>\n<\/tr>\n<tr>\n<td>Instruction following<\/td>\n<td>Multi-IF<\/td>\n<td style=\"text-align: right;\">64.70<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Translation<\/td>\n<td>chrF++<\/td>\n<td style=\"text-align: right;\">43.18<\/td>\n<td><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>These measurement results show good scores in instruction-following capabilities that adhere to formal constraints and basic calculation processing. In particular, it recorded a high score of 83.90 on IFEval, which measures whether it can follow formatting instructions such as &#8220;within 300 words&#8221; or &#8220;in JSON format&#8221;, possessing practical accuracy for daily text processing and instruction execution. It also recorded 74.91 on GSM8K, which measures the ability to solve elementary school-level math word problems step-by-step.<\/p>\n<p>On the other hand, scores lag behind in areas requiring knowledge or advanced reasoning. It stays at 55.15 on MMLU covering a broad range of knowledge, and remains at low levels such as 33.35 on MMLU-Pro, a more difficult reasoning-focused version, and 28.18 on GPQA, which handles PhD-level difficult science questions. As the publisher itself mentions, due to its small size of 2.3 billion parameters, there are limitations in retaining vast factual knowledge and complex multi-stage reasoning, making its performance tendency more suited for text processing and summarization tasks based on clear instructions rather than uses covering general world knowledge.<\/p>\n<h2>Strengths and Use Cases<\/h2>\n<p>According to the model card, Aion Instruct is trained with a focus on general-purpose text use cases such as document reading, content analysis, question answering, and natural language understanding. The tags include summarization, rewriting, and chat, with summarization, rewriting, and dialogue designated as expected use cases. The context length is 32K tokens, making it capable of processing multi-page documents, long email threads, and complex technical specifications entirely on-device.<\/p>\n<p>Supported languages include 8 languages: English, German, Spanish, Portuguese, Italian, French, Chinese, and Japanese. However, multilingual data accounts for only about 6% of the total training data, and the publisher states that output quality may vary depending on the language.<\/p>\n<p>Tool calling is also supported. Passing tool definitions via <code>apply_chat_template(..., tools=tools)<\/code> causes the model to output calls in the <code>&lt;|tool_call|&gt;<\/code> format.<\/p>\n<p>There are also points to note. The card explicitly states that this model has not been trained to excel in world knowledge. Because it is a small model with 2.3 billion parameters, details may be missed, erroneous descriptions may occur, and complex multi-stage reasoning may fail. It may also be susceptible to adversarial attacks, with XPIA, DIC, and ECI cited as key safety metrics to be improved in the future. Users are asked not to use it for automated decision-making in critical scenarios such as medical diagnosis or legal judgment.<\/p>\n<h2>How It Differs from Similar Models<\/h2>\n<p>Our site&#8217;s <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/2026\/11\/19\/aion-10-instruct-23b-gguf\/\">&#8220;Aion-1.0-Instruct-2.3B-GGUF&#8221; 2.3B Text Generation Model: Required VRAM 4GB+<\/a> covers a version where the same model is reported to have been converted into GGUF format by AtomicChat. In that article, the source is unverified and it is treated as an unofficial converted version. This time, it is the unquantized safetensors version released by Microsoft itself, based on official primary information. Converted versions serve as an option when you want to run things easily in a lighter format. However, the quality of quantized versions needs to be verified separately from the official scores in this article.<\/p>\n<p><!-- lmw:hardware --><\/p>\n<h2>Hardware Requirements<\/h2>\n<p><strong>Estimated requirements (calculated by Local Model Watch)<\/strong> \u2014 2.3B parameters<\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Your VRAM<\/th>\n<th>Quantization<\/th>\n<th>File size<\/th>\n<th>Est. memory needed<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>8GB (RTX 4060 \/ 3060 Ti, etc.)<\/td>\n<td>BF16<\/td>\n<td>4.3GB<\/td>\n<td>5.1GB<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><strong>Inference engine support<\/strong> (architecture name matched against each project&#8217;s own model registry in its source code, checked 2026-11-20): llama.cpp: not registered, vLLM: not registered, MLX (mlx-lm): not registered. &#8220;Not registered&#8221; means the name is absent from that registry today, not that the model cannot run.<\/p>\n<p><em>Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model&#8217;s authors. Compare with other models in our <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-en\/\">VRAM quick reference<\/a>. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<p><!-- \/lmw:hardware --><\/p>\n<p><!-- lmw:runnability --><\/p>\n<h2>Can You Run It Locally?<\/h2>\n<p><strong>Not usable in Ollama, LM Studio and llama.cpp yet.<\/strong><\/p>\n<p>The publisher ships safetensors only, and llama.cpp&#8217;s registry does not list this architecture. llama.cpp would need to add support before these tools can run it. 2 converted build(s) from other uploaders exist. Today it can be run with transformers, using the memory figures in the table above.<\/p>\n<p><strong>License \u2014 <code>mit<\/code> (Commercial use allowed):<\/strong> Permits commercial use, modification and redistribution, provided the copyright notice and license text are retained.<\/p>\n<p><em>Compiled by this site&#8217;s code from the published formats, converted builds we have found, and each engine&#8217;s own model registry. &#8220;Not found&#8221; means we have not seen such a build, not that none exists. License summaries are not legal advice \u2014 check the publisher&#8217;s original terms before relying on them.<\/em><\/p>\n<p><!-- \/lmw:runnability --><\/p>\n<p><!-- lmw:lab --><\/p>\n<h2>Our Own Measurements<\/h2>\n<p>Values we measured ourselves on our server (no GPU) by actually reading and running this model&#8217;s files \u2014 not figures copied from the model card. How we measure, and the results for every model: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/observations-en\/\">Our Measurements<\/a>.<\/p>\n<h3>Japanese Token Efficiency<\/h3>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Tokenizer<\/th>\n<th>Tokens per 1,000 Japanese characters<\/th>\n<th>Ratio to the same text in English<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td><strong>This model<\/strong><\/td>\n<td><strong>795<\/strong><\/td>\n<td><strong>1.45\u00d7<\/strong><\/td>\n<\/tr>\n<tr>\n<td>Qwen3<\/td>\n<td>688<\/td>\n<td>1.26\u00d7<\/td>\n<\/tr>\n<tr>\n<td>Llama 3.2<\/td>\n<td>744<\/td>\n<td>1.36\u00d7<\/td>\n<\/tr>\n<tr>\n<td>Gemma 3<\/td>\n<td>564<\/td>\n<td>1.03\u00d7<\/td>\n<\/tr>\n<tr>\n<td>gpt-oss<\/td>\n<td>795<\/td>\n<td>1.45\u00d7<\/td>\n<\/tr>\n<tr>\n<td>LLM-jp-3<\/td>\n<td>497<\/td>\n<td>0.85\u00d7<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>It needs about 16% more tokens than the Qwen3 tokenizer for the same Japanese text, so only about 0.87\u00d7 as much Japanese fits in the same context length.<\/p>\n<p>Counted with the <code>tokenizer.json<\/code> of <a href=\"https:\/\/huggingface.co\/microsoft\/Aion-1.0-Instruct-2.3B\">microsoft\/Aion-1.0-Instruct-2.3B<\/a> on a fixed text we wrote ourselves (876 Japanese characters across news, conversation, technical docs, a formal email, travel writing and a recipe) and its English translation. Fewer tokens mean more Japanese fits in the context window.<\/p>\n<p><!-- \/lmw:lab --><\/p>\n<p><!-- lmw:peers --><\/p>\n<h2>Recent Models in the Same Size Class<\/h2>\n<p><em>Models with <\/em><em>up to 4B<\/em><em> parameters that Local Model Watch covered recently, listed by code from our article log for comparison. VRAM tiers are this site&#8217;s estimates; licenses are as stated on the model cards.<\/em><\/p>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Model<\/th>\n<th>Parameters<\/th>\n<th>Smallest VRAM tier<\/th>\n<th>License<\/th>\n<th>Our article<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>ggml-org\/LFM3-1.7B-GGUF<\/td>\n<td>1.7B<\/td>\n<td>4GB<\/td>\n<td>lfm1.0<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/19\/lfm3-1-7b-gguf-release\/\">LFM3-1.7B-GGUF Text Generation Model: Our Test Answers, 4GB+ VRAM<\/a> (2026-11-18)<\/td>\n<\/tr>\n<tr>\n<td>openbmb\/MiniCPM-V-4.7-35B-A3B-DSpark-gguf<\/td>\n<td>389M<\/td>\n<td>4GB<\/td>\n<td>apache-2.0<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/minicpm-v-4-7-35b-a3b-dspark-gguf-2\/\">MiniCPM-V-4.7-35B-A3B-DSpark-gguf Draft Model for Speedup: 4GB+ VRAM<\/a> (2026-11-17)<\/td>\n<\/tr>\n<tr>\n<td>openbmb\/MiniCPM-V-4.7-1B-DSpark-gguf<\/td>\n<td>214M<\/td>\n<td>4GB<\/td>\n<td>apache-2.0<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/minicpm-v-4-7-1b-dspark-gguf-released\/\">MiniCPM-V-4.7-1B-DSpark-gguf Text Generation Model: 4GB+ VRAM<\/a> (2026-11-17)<\/td>\n<\/tr>\n<tr>\n<td>IFM\/Jais-3-0.9B-GGUF<\/td>\n<td>1.1B<\/td>\n<td>4GB<\/td>\n<td>apache-2.0<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/jais-3-0-9b-gguf-released\/\">Jais-3-0.9B-GGUF Bilingual Dense Model: Our Test Answers, 4GB+ VRAM<\/a> (2026-11-17)<\/td>\n<\/tr>\n<tr>\n<td>nvidia\/NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16<\/td>\n<td>4.0B<\/td>\n<td>4GB<\/td>\n<td>openmdw-1.1<\/td>\n<td><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/nvidia-dory-1-0-4b-recurrent-llm\/\">NVIDIA Releases Dory1.0-4B: A Recurrent 4B LLM with Dynamic Loops<\/a> (2026-11-17)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p><!-- \/lmw:peers --><\/p>\n<h2>How to Get It<\/h2>\n<p>The distribution format is safetensors (bfloat16), and the license is MIT. Gates (consent to terms of use) are not set, and it can be downloaded without consent. The card lists PyTorch, ONNX, and GGUF as library formats, but Microsoft states it has released the unquantized version first and plans to release quantized versions later. What is currently in the repository is safetensors.<\/p>\n<p>Because it uses custom modeling code, <code>trust_remote_code=True<\/code> is required. It is written for <code>transformers<\/code> 5.x.<\/p>\n<pre><code class=\"language-python\">from transformers import AutoModelForCausalLM, AutoTokenizer\n\nmodel_id = &quot;microsoft\/Aion-1.0-Instruct-2.3B&quot;\n\ntokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)\nmodel = AutoModelForCausalLM.from_pretrained(\n    model_id,\n    dtype=&quot;auto&quot;,\n    device_map=&quot;auto&quot;,\n    trust_remote_code=True,\n)\n<\/code><\/pre>\n<p>The chat template uses <code>&lt;|system|&gt;<\/code>, <code>&lt;|user|&gt;<\/code>, and <code>&lt;|assistant|&gt;<\/code>, and each turn ends with <code>&lt;|end|&gt;<\/code>. <code>&lt;|end|&gt;<\/code> is also the EOS token. The card contains no description regarding operation in llama.cpp, Ollama, or vLLM. Therefore, compatibility with these engines is unverified. microsoft\/Aion-Instruct-Preview-Sample is listed in the card as a related GitHub repository.<\/p>\n<p><!-- lmw:variants --><\/p>\n<h2>Quantized and Converted Variants<\/h2>\n<div class=\"lmw-table-scroll\" tabindex=\"0\" style=\"overflow-x:auto;-webkit-overflow-scrolling:touch;max-width:100%;\">\n<p class=\"lmw-table-hint\" style=\"margin:0 0 4px;font-size:0.85em;opacity:0.7;\">\u2192 Scroll horizontally to see all columns<\/p>\n<table style=\"width:max-content;min-width:100%;border-collapse:collapse;\">\n<thead>\n<tr>\n<th>Added<\/th>\n<th>Publisher<\/th>\n<th>Format<\/th>\n<th>Repository<\/th>\n<th>Smallest VRAM tier (build, est. memory)<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>2026-11-19<\/td>\n<td>microsoft<\/td>\n<td>INT4<\/td>\n<td><a href=\"https:\/\/huggingface.co\/microsoft\/Aion-1.0-Instruct-2.3B-ONNX-WebGPU\">microsoft\/Aion-1.0-Instruct-2.3B-ONNX-WebGPU<\/a><\/td>\n<td>&#8211;<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>In addition, 2 converted build(s) from other uploaders exist on Hugging Face; this site lists only builds from the model&#8217;s publisher or established quantization maintainers.<\/p>\n<p><em>This section is appended automatically by Local Model Watch when a converted build of this model appears after publication. Memory figures are estimated from the size of the distributed files. What the quantization names mean: <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/glossary-quantization-en\/\">glossary<\/a>.<\/em><\/p>\n<p><!-- \/lmw:variants --><\/p>\n<p><!-- lmw:related --><\/p>\n<h2>Related Articles<\/h2>\n<ul>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/19\/aion-1-0-instruct-2-3b-gguf-released\/\">Aion-1.0-Instruct-2.3B-GGUF 2.3B Text Generation Model: 4GB+ VRAM<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/microsoft-mage-vl-cowork-hybrid-agent\/\">Mage-VL-Cowork Vision-Language Model: 12GB+ VRAM, GGUF Builds<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/userrepgen-4b\/\">UserRepGen-4B Text Generation Model: Our Test Answers, 4GB+ VRAM<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/2026\/11\/17\/singvl-s1-4b-qwen3-5-multimodal-decision-model\/\">SingVL_S1_4B Multimodal Decision Model with Image Support: 4GB+ VRAM<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:related --><\/p>\n<p><!-- lmw:next-steps --><\/p>\n<h2>What to Read Next<\/h2>\n<ul>\n<li><strong>Find models by VRAM<\/strong> (This model runs from the 8GB tier) \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-8gb-en\/\">Other models that run on a 8GB GPU<\/a><\/li>\n<li><strong>Explore the same model family<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/model-microsoft-aion-1-0-en\/\">Aion-1.0 family overview (2 articles, 1 converted builds)<\/a><\/li>\n<li><strong>Formats this model is available in<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/format-safetensors-en\/\">Safetensors format guide and models<\/a><\/li>\n<li><strong>Learn about the publisher<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/publisher-microsoft-en\/\">Microsoft: models, licenses and articles<\/a><\/li>\n<li><strong>Other models for the same task<\/strong> \u2192 <a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/models-by-task-en\/#task-text\">Other text generation models<\/a><\/li>\n<\/ul>\n<p><!-- \/lmw:next-steps --><\/p>\n<h2>Sources<\/h2>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/microsoft\/Aion-1.0-Instruct-2.3B\">microsoft\/Aion-1.0-Instruct-2.3B (Hugging Face)<\/a><\/li>\n<li><a href=\"https:\/\/localmodelwatch.tsuchitsuchi.com\/2026\/11\/19\/aion-10-instruct-23b-gguf\/\">&#8220;Aion-1.0-Instruct-2.3B-GGUF&#8221; 2.3B Text Generation Model: Required VRAM 4GB+ (Local Model Watch)<\/a><\/li>\n<\/ul>\n<p><!-- lmw:updates --><\/p>\n<h2>Update History<\/h2>\n<ul>\n<li>2026-11-19: Added converted builds to \u201cQuantized and Converted Variants\u201d: microsoft\/Aion-1.0-Instruct-2.3B-ONNX-WebGPU<\/li>\n<li>2026-11-20: Added our own measurements: Japanese token efficiency.<\/li>\n<\/ul>\n<p><!-- \/lmw:updates --><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Microsoft has released Aion-1.0-Instruct-2.3B, a 2.29B parameter on-device small language model for Windows, on Hugging Face.<\/p>\n","protected":false},"author":1,"featured_media":20377,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[310],"tags":[5403,5405,3398,209,5407,759,1547,1555],"class_list":["post-20378","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-new-models","tag-aion-1-0-instruct-2-3b-en","tag-aion-1-0-en","tag-microsoft-en","tag-safetensors-en","tag-slm-en","tag-transformers-en","tag-verified","tag--en"],"lang":"en","translations":{"en":20378,"ja":20376},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/20378","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=20378"}],"version-history":[{"count":5,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/20378\/revisions"}],"predecessor-version":[{"id":21046,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/posts\/20378\/revisions\/21046"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media\/20377"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=20378"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/categories?post=20378"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/tags?post=20378"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}