{"id":3543,"date":"2026-09-25T11:21:29","date_gmt":"2026-09-25T02:21:29","guid":{"rendered":"https:\/\/localmodelwatch.tsuchitsuchi.com\/vram-guide-8gb-en\/"},"modified":"2026-09-26T04:11:18","modified_gmt":"2026-09-25T19:11:18","slug":"vram-guide-8gb-en","status":"publish","type":"page","link":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/vram-guide-8gb-en\/","title":{"rendered":"Local Models That Run in 8GB of VRAM (RTX 4060 \/ 3060 Ti, etc.)"},"content":{"rendered":"

Every model covered by Local Model Watch that fits in 8GB<\/strong> of GPU memory, with the best build that fits. The “Best build for 8GB” column is the largest (highest-quality) quantization or precision whose estimated memory stays within 8GB \u2014 often better than the smallest build listed in the VRAM quick reference<\/a>. Estimates are computed by this site from actual file sizes plus runtime overhead (method<\/a>); long contexts need more.<\/p>\n

11 models listed.<\/em><\/p>\n

Everything that fits your GPU: 8GB<\/strong> \/ 12GB<\/a> \/ 16GB<\/a> \/ 24GB<\/a><\/p>\n

Text Generation (Chat and Code)<\/h2>\n
\n

\u2192 Scroll horizontally to see all columns<\/p>\n\n\n\n\n\n\n\n\n\n\n
Model<\/th>\nParameters<\/th>\nBest build for 8GB<\/th>\nEst. memory<\/th>\nSmallest tier<\/th>\nRuns on<\/th>\nArticle<\/th>\n<\/tr>\n<\/thead>\n
prism-ml\/Ternary-Bonsai-2-27B-gguf<\/td>\n27.8B<\/td>\nQ1_0 (5.5GB)<\/td>\n6.6GB<\/td>\n8GB<\/td>\nOllama \/ LM Studio, MLX<\/td>\nRead<\/a><\/td>\n<\/tr>\n
openbmb\/MiniCPM5-2B<\/td>\n2.5B<\/td>\nF16 (4.7GB)<\/td>\n5.6GB<\/td>\n4GB<\/td>\nOllama \/ LM Studio, vLLM, MLX<\/td>\nRead<\/a><\/td>\n<\/tr>\n
harshatheg\/Qwen-2.5-1B-RLCD<\/td>\n1.5B<\/td>\nBF16 (2.9GB)<\/td>\n3.5GB<\/td>\n4GB<\/td>\nMLX<\/td>\nRead<\/a><\/td>\n<\/tr>\n
pfnet\/plamo-3-610m-fin-instruct<\/td>\n890M<\/td>\nBF16 (1.7GB)<\/td>\n2.0GB<\/td>\n4GB<\/td>\nvLLM<\/td>\nRead<\/a><\/td>\n<\/tr>\n
togethercomputer\/Tev1-0.8B-experimental<\/td>\n873M<\/td>\nF32 (1.6GB)<\/td>\n2.0GB<\/td>\n4GB<\/td>\nvLLM<\/td>\nRead<\/a><\/td>\n<\/tr>\n
Cactus-Compute\/needle3<\/td>\n–<\/td>\nOriginal precision (0.2GB)<\/td>\n0.3GB<\/td>\n4GB<\/td>\n–<\/td>\nRead<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n

Vision-Language and Multimodal Models<\/h2>\n
\n

\u2192 Scroll horizontally to see all columns<\/p>\n\n\n\n\n\n
Model<\/th>\nParameters<\/th>\nBest build for 8GB<\/th>\nEst. memory<\/th>\nSmallest tier<\/th>\nRuns on<\/th>\nArticle<\/th>\n<\/tr>\n<\/thead>\n
LiquidAI\/LFM2.5-VL-3B-DSpark<\/td>\n279M<\/td>\nF16 (0.5GB)<\/td>\n0.6GB<\/td>\n4GB<\/td>\n–<\/td>\nRead<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n

Image Generation and Editing<\/h2>\n
\n

\u2192 Scroll horizontally to see all columns<\/p>\n\n\n\n\n\n
Model<\/th>\nParameters<\/th>\nBest build for 8GB<\/th>\nEst. memory<\/th>\nSmallest tier<\/th>\nRuns on<\/th>\nArticle<\/th>\n<\/tr>\n<\/thead>\n
abenzerps\/Qwen-Image-2.1-Uncensored-GGUF<\/td>\n7.1B<\/td>\nQ6_K (5.5GB)<\/td>\n6.6GB<\/td>\n8GB<\/td>\n–<\/td>\nRead<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n

Audio: Speech Synthesis, Music and Speech Recognition<\/h2>\n
\n

\u2192 Scroll horizontally to see all columns<\/p>\n\n\n\n\n\n
Model<\/th>\nParameters<\/th>\nBest build for 8GB<\/th>\nEst. memory<\/th>\nSmallest tier<\/th>\nRuns on<\/th>\nArticle<\/th>\n<\/tr>\n<\/thead>\n
phasefield-audio\/Irodori-TTS-v4.1-Anime<\/td>\n766M<\/td>\nF32 (2.9GB)<\/td>\n3.4GB<\/td>\n4GB<\/td>\n–<\/td>\nRead<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n

Task not declared<\/h2>\n
\n

\u2192 Scroll horizontally to see all columns<\/p>\n\n\n\n\n\n\n
Model<\/th>\nParameters<\/th>\nBest build for 8GB<\/th>\nEst. memory<\/th>\nSmallest tier<\/th>\nRuns on<\/th>\nArticle<\/th>\n<\/tr>\n<\/thead>\n
tencent\/WeVisDoc-4B<\/td>\n4.4B<\/td>\nQ8_0 (4.4GB)<\/td>\n5.2GB<\/td>\n4GB<\/td>\n–<\/td>\nRead<\/a><\/td>\n<\/tr>\n
Efficient-Large-Model\/H3-to-LTX-Latent-Adapter<\/td>\n195M<\/td>\nBF16 (0.4GB)<\/td>\n0.4GB<\/td>\n4GB<\/td>\n–<\/td>\nRead<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Every model covered by Local Model Watch that fits in 8GB of GPU memory, with the best build that fits. The “Best build for 8GB” column is the largest (highest-quality) quantization or precision whose estimated memory stays within 8GB \u2014 often better than the smallest build listed in the VRAM quick reference. Estimates are computed […]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-3543","page","type-page","status-publish","hentry"],"lang":"en","translations":{"en":3543,"ja":3542},"_links":{"self":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/3543","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/comments?post=3543"}],"version-history":[{"count":2,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/3543\/revisions"}],"predecessor-version":[{"id":4452,"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/pages\/3543\/revisions\/4452"}],"wp:attachment":[{"href":"https:\/\/localmodelwatch.tsuchitsuchi.com\/en\/wp-json\/wp\/v2\/media?parent=3543"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}