Local Models That Run in 16GB of VRAM (RTX 5060 Ti 16GB / 4060 Ti 16GB, etc.)

October 5, 2026

Every model covered by Local Model Watch that fits in 16GB of GPU memory, with the best build that fits. The “Best build for 16GB" column is the largest (highest-quality) quantization or precision whose estimated memory stays within 16GB — often better than the smallest build listed in the VRAM quick reference. Estimates are computed by this site from actual file sizes plus runtime overhead (method); long contexts need more.

31 models listed.

Everything that fits your GPU: 8GB / 12GB / 16GB / 24GB

Text Generation (Chat and Code)

→ Scroll horizontally to see all columns

Model Parameters Best build for 16GB Est. memory Smallest tier Runs on Article
nex-agi/Nex-N2.5-mini 35.1B Q2_K (12.9GB) 15.5GB 16GB Ollama / LM Studio, vLLM, MLX Read
orcarouter/OrcaSAQ-2-27B 27.8B EXL3 (11.4GB) 13.7GB 16GB vLLM Read
prism-ml/Ternary-Bonsai-2-27B-gguf 27.8B Q2_0 (6.7GB) 8.1GB 8GB Ollama / LM Studio, MLX Read
Altworld/Hemmingway-1 26.9B Q3_K_L (13.2GB) 15.8GB 12GB Ollama / LM Studio, vLLM, MLX Read
bartowski/Gryphe_Pantheon-Reasoning-26B-A4B-1.1-V2-GGUF 26.5B IQ3_XS (12.7GB) 15.2GB 12GB Ollama / LM Studio Read
togethercomputer/Tev1-4B-experimental 4.7B BF16 (8.1GB) 9.7GB 4GB Ollama / LM Studio, vLLM Read
tencent/Simple-Attention-Sparsification 4.0B BF16 (7.5GB) 9.0GB 12GB – Read
openbmb/MiniCPM5-2B 2.5B F16 (4.7GB) 5.6GB 4GB Ollama / LM Studio, vLLM, MLX Read
harshatheg/Qwen-2.5-1B-RLCD 1.5B BF16 (2.9GB) 3.5GB 4GB MLX Read
pfnet/plamo-3-610m-fin-instruct 890M F16 (1.7GB) 2.0GB 4GB Ollama / LM Studio, vLLM Read
togethercomputer/Tev1-0.8B-experimental 873M F32 (1.6GB) 2.0GB 4GB vLLM Read
LiquidAI/LFM2.5-350M-Diffusion-Exp 425M BF16 (0.8GB) 0.9GB 4GB – Read
Cactus-Compute/needle3 – Original precision (0.2GB) 0.3GB 4GB – Read

Vision-Language and Multimodal Models

→ Scroll horizontally to see all columns

Model Parameters Best build for 16GB Est. memory Smallest tier Runs on Article
Qwen/Qwen3.8-27B 27.8B IQ4_XS (13.3GB) 15.9GB 8GB Ollama / LM Studio, vLLM, MLX Read
bartowski/vectionlabs_Salience-27B-R6-GGUF 27.8B Q3_K_L (13.2GB) 15.8GB 12GB Ollama / LM Studio Read
agentionai/Signal-3.8-27B-GGUF 27.8B IQ4_XS (13.3GB) 15.9GB 16GB Ollama / LM Studio Read
Jackrong/Qwopus3.8-27B-Flash-GGUF 27.8B Q3_K_M (12.6GB) 15.1GB 16GB Ollama / LM Studio Read (Japanese)
Cloudflare/clef 27.4B Q3_K_L (12.9GB) 15.5GB 12GB Ollama / LM Studio, vLLM, MLX Read
bartowski/TheDrummer_Orion-26B-A4B-v1.1-GGUF 25.8B IQ3_M (13.4GB) 16.0GB 12GB Ollama / LM Studio Read
Cloudflare/clef-flash 9.4B Q8_0 (8.9GB) 10.7GB 4GB Ollama / LM Studio, vLLM, MLX Read
apple/LensVLM-9B 9.4B Q8_0 (8.9GB) 10.7GB 4GB Ollama / LM Studio, vLLM, MLX Read
ggml-org/MiMo-V2.6-Distill-Qwen-9B-GGUF 9.4B Q8_0 (8.9GB) 10.6GB 12GB Ollama / LM Studio Read
google/DiarizationLM-Gemma-4-E4B-v1 8.0B Q4_K_M (4.9GB) 5.9GB 8GB Ollama / LM Studio, vLLM Read
LiquidAI/LFM2.5-VL-3B-DSpark 279M F16 (0.5GB) 0.6GB 4GB – Read

Audio: Speech Synthesis, Music and Speech Recognition

→ Scroll horizontally to see all columns

Model Parameters Best build for 16GB Est. memory Smallest tier Runs on Article
Edge0/Audio8-ASR-Infinite 4.1B BF16 (7.6GB) 9.1GB 12GB – Read
m-a-p/YuE2-3B 3.6B BF16 (6.8GB) 8.1GB 12GB – Read
phasefield-audio/Irodori-TTS-v4.1-Anime 766M F32 (2.9GB) 3.4GB 4GB – Read
FermionResearch/Phonon-2 627M Q8_0 (0.7GB) 0.8GB 4GB – Read

Task not declared

→ Scroll horizontally to see all columns

Model Parameters Best build for 16GB Est. memory Smallest tier Runs on Article
tencent/WeVisDoc-4B 4.4B F16 (8.2GB) 9.9GB 4GB – Read
Comfy-Org/YuE2 3.6B BF16 (6.8GB) 8.1GB 12GB – Read
Efficient-Large-Model/H3-to-LTX-Latent-Adapter 195M BF16 (0.4GB) 0.4GB 4GB – Read