Aion-1.0 Guide: VRAM Requirements, GGUF Builds

November 20, 2026

Everything Local Model Watch has published about the Aion-1.0 family: 2 article(s) covering the base model and its fine-tunes, plus converted builds we tracked after publication. Memory requirements below are computed by this site from file sizes, not quoted from model cards. Part of our model family index.

At a Glance

Item Value
Base model(s) microsoft/Aion-1.0-Instruct-2.3B
Publisher Microsoft
Parameters 2.3B
License (model card) mit
Smallest VRAM tier 8GB
Articles 2

Hardware Requirements

Estimated requirements (calculated by Local Model Watch) — 2.3B parameters

Your VRAM Quantization File size Est. memory needed
8GB (RTX 4060 / 3060 Ti, etc.) BF16 4.3GB 5.1GB

Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model’s authors. Compare with other models in our VRAM quick reference. What the quantization names mean: glossary.

Can You Run It Locally?

Not usable in Ollama, LM Studio and llama.cpp yet.

The publisher ships safetensors only, and llama.cpp’s registry does not list this architecture. llama.cpp would need to add support before these tools can run it. 2 converted build(s) from other uploaders exist. Today it can be run with transformers, using the memory figures in the table above.

License — mit (Commercial use allowed): Permits commercial use, modification and redistribution, provided the copyright notice and license text are retained.

Compiled by this site’s code from the published formats, converted builds we have found, and each engine’s own model registry. “Not found" means we have not seen such a build, not that none exists. License summaries are not legal advice — check the publisher’s original terms before relying on them.

Quantized and Converted Variants

→ Scroll horizontally to see all columns

Added Publisher Format Repository Smallest VRAM tier (build, est. memory)
2026-11-19 microsoft INT4 microsoft/Aion-1.0-Instruct-2.3B-ONNX-WebGPU –

This section is appended automatically by Local Model Watch when a converted build of this model appears after publication. Memory figures are estimated from the size of the distributed files.

Articles (the family’s own models first, then newest)

Published Model Type Article
2026-11-19 microsoft/Aion-1.0-Instruct-2.3B New Models Aion-1.0-Instruct-2.3B 2.3B Text Generation Model: 8GB+ VRAM
2026-11-19 AtomicChat/Aion-1.0-Instruct-2.3B-GGUF New Models Aion-1.0-Instruct-2.3B-GGUF 2.3B Text Generation Model: 4GB+ VRAM

Repositories

Last updated 2026-11-20 (JST). Assembled by code from our article log; no text on this page is written by an AI model.