Arete Guide: VRAM Requirements, GGUF Builds

Everything Local Model Watch has published about the Arete family: 1 article(s) covering the base model and its fine-tunes, plus converted builds we tracked after publication. Memory requirements below are computed by this site from file sizes, not quoted from model cards. Part of our model family index.

At a Glance

Item Value
Base model(s) NousResearch/Arete-27B
Publisher Nous Research
Parameters 27.4B
License (model card) apache-2.0
Smallest VRAM tier 12GB
Articles 1

Hardware Requirements

Estimated requirements (calculated by Local Model Watch) — 27.4B parameters

Your VRAM Quantization File size Est. memory needed
12GB (RTX 4070 / 3060 12GB, etc.) Q2_K 9.9GB 11.8GB
16GB (RTX 5060 Ti 16GB / 4060 Ti 16GB, etc.) Q3_K_L 12.9GB 15.5GB
24GB (RTX 4090 / 3090, etc.) Q5_K_M 19.3GB 23.1GB
32GB (RTX 5090, etc.) Q8_0 26.7GB 32.0GB
80GB class (A100 / H100) BF16 50.1GB 60.1GB

Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model’s authors. File sizes are measured from the converted build bartowski/NousResearch_Arete-27B-GGUF. Compare with other models in our VRAM quick reference. What the quantization names mean: glossary.

Can You Run It Locally?

Runs in Ollama, LM Studio and llama.cpp via a converted build.

The publisher ships safetensors, but bartowski/NousResearch_Arete-27B-GGUF provides a GGUF build you can use.

License — apache-2.0 (Commercial use allowed): Permits commercial use, modification and redistribution. Redistribution requires including the license and stating changes; includes a patent grant.

Compression: the Q2_K build measures 3.11 bits per weight — about 19% the size of the original 16-bit weights, calculated by this site from the actual file sizes.

Compiled by this site’s code from the published formats, converted builds we have found, and each engine’s own model registry. “Not found" means we have not seen such a build, not that none exists. License summaries are not legal advice — check the publisher’s original terms before relying on them.

Quantized and Converted Variants

→ Scroll horizontally to see all columns

Added Publisher Format Repository Smallest VRAM tier (build, est. memory)
2026-11-17 mradermacher GGUF mradermacher/Arete-27B-GGUF Q2_K 12.0GB (fits in 12GB VRAM)
2026-11-17 mlx-community MLX mlx-community/Arete-27B-OptiQ-4bit MLX 4bit 21.7GB (fits in 24GB VRAM)
2026-11-07 bartowski GGUF (imatrix) bartowski/NousResearch_Arete-27B-GGUF Q2_K 11.8GB (fits in 12GB VRAM)

File sizes of each build:

  • Available builds in mradermacher/Arete-27B-GGUF: Q2_K 10.0GB / Q3_K_S 11.2GB / Q3_K_M 12.4GB / Q3_K_L 13.4GB / IQ4_XS 14.2GB / Q4_K_S 14.5GB / Q4_K_M 15.4GB / Q5_K_S 17.4GB / Q5_K_M 17.9GB / Q6_K 20.6GB / Q8_0 26.6GB
  • Available builds in mlx-community/Arete-27B-OptiQ-4bit: MLX 4bit 18.1GB
  • Available builds in bartowski/NousResearch_Arete-27B-GGUF: IQ2_XXS 8.0GB / IQ2_XS 8.2GB / IQ2_S 8.8GB / IQ2_M 9.6GB / Q2_K 9.9GB / IQ3_XXS 11.3GB / Q3_K_S 11.6GB / IQ3_XS 11.7GB / Q3_K_M 12.3GB / Q3_K_L 12.9GB / IQ3_M 13.6GB / IQ4_XS 14.2GB / Q4_0 15.0GB / Q4_K_S 15.0GB / IQ4_NL 16.0GB / Q4_K_M 16.0GB / Q4_1 16.4GB / Q4_K_L 17.3GB / Q5_K_S 18.0GB / Q5_K_M 19.3GB / Q6_K_S 21.1GB / Q6_K 22.0GB / Q6_K_L 23.0GB / Q8_0 26.7GB / BF16 50.1GB

This section is appended automatically by Local Model Watch when a converted build of this model appears after publication. Memory figures are estimated from the size of the distributed files.

Articles (the family’s own models first, then newest)

Published Model Type Article
2026-11-17 NousResearch/Arete-27B New Models Arete-27B Text Generation Model: 12GB+ VRAM, GGUF Builds

Repositories

Last updated 2026-11-17 (JST). Assembled by code from our article log; no text on this page is written by an AI model.