Inkling-2 Guide: VRAM Requirements, GGUF Builds

November 22, 2026

Everything Local Model Watch has published about the Inkling-2 family: 1 article(s) covering the base model and its fine-tunes, plus converted builds we tracked after publication. Memory requirements below are computed by this site from file sizes, not quoted from model cards. Part of our model family index.

At a Glance

Item Value
Base model(s) thinkingmachines/Inkling-2-Mini
Publisher thinkingmachines
Smallest VRAM tier 24GB
Articles 1

Hardware Requirements

Estimated requirements (calculated by Local Model Watch)

Your VRAM Quantization File size Est. memory needed
24GB (RTX 4090 / 3090, etc.) IQ4_NL 16.4GB 19.7GB
32GB (RTX 5090, etc.) Q8_0 25.9GB 31.1GB
80GB class (A100 / H100) BF16 48.6GB 58.4GB

Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model’s authors. Compare with other models in our VRAM quick reference. What the quantization names mean: glossary.

Figures are for ggml-org/Inkling-2-Mini-GGUF, the most recent model in this family with a hardware estimate.

Can You Run It Locally?

Runs in Ollama, LM Studio and llama.cpp as-is.

It is distributed in GGUF, so no conversion is needed.

Compiled by this site’s code from the published formats, converted builds we have found, and each engine’s own model registry. “Not found" means we have not seen such a build, not that none exists.

Quantized and Converted Variants

→ Scroll horizontally to see all columns

Added Publisher Format Repository Smallest VRAM tier (build, est. memory)
2026-11-21 lmstudio-community GGUF lmstudio-community/Inkling-2-Mini-GGUF Q4_K_M 19.5GB (fits in 24GB VRAM)

File sizes of each build:

  • Available builds in lmstudio-community/Inkling-2-Mini-GGUF: Q4_K_M 16.3GB / Q6_K 21.9GB / Q8_0 25.9GB

This section is appended automatically by Local Model Watch when a converted build of this model appears after publication. Memory figures are estimated from the size of the distributed files.

Articles (the family’s own models first, then newest)

Published Model Type Article
2026-11-21 ggml-org/Inkling-2-Mini-GGUF New Models Inkling 2 Mini GGUF Released: Looped MoE Multimodal Model

Repositories

Last updated 2026-11-22 (JST). Assembled by code from our article log; no text on this page is written by an AI model.