Safetensors Model Format Explained: Supported Engines and Models

What Is Safetensors?

Safetensors is a file format for storing model weights (tensors), developed by Hugging Face. Most models published on Hugging Face ship the weights their publisher trained in this format (.safetensors files). In other words, it is the format that holds the “original" of a model.

Why It Matters

  • Loading it does not execute code. The older PyTorch .bin (pickle) format could run arbitrary code when loaded. Safetensors holds only the numbers and a minimal header, so that risk does not exist.
  • Fast loading, and you can read only what you need. Files are memory-mapped, so even large models start quickly, and a multi-GPU setup can read just the tensors each GPU needs.
  • The common entry point for most tools. Transformers, Diffusers, vLLM and SGLang load it directly, and conversions to GGUF, MLX, AWQ and the rest almost always start from it.

Tips for Running It Locally

  • At the original precision (BF16 / FP16) it needs a lot of memory. Plan for roughly two bytes per parameter (about 16 GB for an 8B model). To run a large model on a consumer GPU, look for a quantized build such as GGUF or AWQ.
  • Low-precision Safetensors such as FP8 and NVFP4 also exist. They are mainly served with vLLM, SGLang and similar engines on NVIDIA GPUs of a supporting generation.
  • Ollama and LM Studio (llama.cpp-based) cannot load it as is. Use a build converted to GGUF.
  • Most image and video generation models also use it. For where each file goes in ComfyUI or Diffusers, see the “Files" section of each article.
  • MLX, AWQ, GPTQ and EXL repositories also use .safetensors files, but they are listed on their own format pages rather than below.

Sources: Safetensors documentation (Hugging Face) and the huggingface/safetensors README (both as of 2026-09-27).

Our Coverage and Data

Local Model Watch has published 29 article(s) on models available in Safetensors: 29 where the repository itself is in Safetensors, and 0 where we found a Safetensors build of the model. The lists below only include builds we have checked (the publisher’s organization and well-known quantizers); a model missing here may still have a Safetensors build elsewhere. Part of our model format index.

Main Engines That Load This Format

Engine Overview
vLLM High-throughput LLM serving engine built around PagedAttention. Handles concurrent requests and quantized weights (AWQ / GPTQ / FP8) and is widely used on server-class GPUs.
SGLang LLM serving framework known for RadixAttention prefix caching and structured output. A common alternative to vLLM for serving.
Diffusers Hugging Face’s Python library for diffusion models; the standard way to run image, video and audio generators from code.

Models Available in Safetensors

→ Scroll horizontally to see all columns

Published Model Where to get it Quantizations Smallest VRAM tier Article
2026-09-27 XiaomiMiMo/MiMo-V2.6-Pro-RL This repository — — Xiaomi Releases MiMo-V2.6-Pro-RL: 1.02T MoE Flagship
2026-09-26 MiniMaxAI/MiniMax-H3 This repository — 32GB MiniMax-H3 Audio-Visual Video Generation Model: 32GB+ VRAM, File List
2026-09-26 deepseek-ai/DeepSeek-V4-Pro-0813 This repository — — DeepSeek-V4-Pro-0813 Text Generation Model: ~998GB Memory, GGUF Builds
2026-09-26 Qwen/Qwen3.8-27B This repository — 8GB Qwen3.8-27B Multimodal Vision-Language Model: 8GB+ VRAM, GGUF Builds
2026-09-26 togethercomputer/Tev1-0.8B-experimental This repository — 4GB Tev1-0.8B-experimental Text Generation Model: 4GB+ VRAM
2026-09-25 LiquidAI/LFM2.5-VL-3B-DSpark This repository — 4GB LFM2.5-VL-3B-DSpark Draft Model for Vision-Language Models: 4GB+ VRAM
2026-09-24 pfnet/plamo-3-610m-fin-instruct This repository — 4GB plamo-3-610m-fin-instruct Text Generation Model: 4GB+ VRAM
2026-09-24 Comfy-Org/Ming-Image This repository — — Ming-Image UI Design-Specialized Image Generation Model: ComfyUI Paths
2026-09-24 togethercomputer/Tev1-4B-experimental This repository — 4GB Tev1-4B-experimental Text Generation Model: 4GB+ VRAM, GGUF Builds
2026-09-24 Edge0/Audio8-ASR-Infinite This repository — 12GB Audio8-ASR-Infinite Speech Recognition Model: 12GB+ VRAM, File List
2026-09-23 Viggle/Qwen-Image-2.1-viggle-turbo This repository — 48GB Qwen-Image-2.1-viggle-turbo Image Generation Model: 48GB+ VRAM
2026-09-21 abenzerps/Qwen-Image-2.1-Uncensored-GGUF This repository — 16GB Qwen-Image-2.1-Uncensored-GGUF Image Generation Model: 16GB+ VRAM
2026-09-20 Qwen/Qwen-Image-2.1-PE-I2I This repository — — Qwen-Image-2.1 Released: Open-Weight Image Gen & Editing
2026-09-19 inclusionAI/Realtime-Venus This repository — 24GB Realtime-Venus Full-Duplex Audio-Video Dialog Model: 24GB+ VRAM
2026-09-19 Cactus-Compute/needle3 This repository — 4GB needle3 Text Generation Model: 4GB+ VRAM
2026-09-18 tencent/WeVisDoc-4B This repository — 4GB Tencent Releases WeVisDoc-2B and WeVisDoc-4B Document Parsing Models
2026-09-16 EleutherAI/olmo3-7b-sdf-sft-clean150 This repository — 24GB EleutherAI Releases OLMo-3-7B Models for Reward-Hacking Research
2026-09-15 EleutherAI/bergson-wikitext-gpt2-leaderboard This repository — — EleutherAI Releases Bergson Leaderboard Baseline GPT-2 Model
2026-09-15 Mothersuperior/yue2-mothersuperior-realaudio-tokenizer-v4 This repository — 12GB yue2-mothersuperior-realaudio-tokenizer-v4: 12GB+ VRAM, File List
2026-09-13 Comfy-Org/YuE2 This repository — 12GB YuE2: 12GB+ VRAM, ComfyUI Paths
2026-09-11 Lightricks/LTX-2.5-22b-IC-LoRA-Ingredients This repository — — Lightricks Releases Multiple LoRA and IC-LoRA Adapters for LTX-2.5
2026-09-10 m-a-p/YuE2-3B This repository — 12GB YuE2-3B Music Generation Model for Lyrics and Style: 12GB+ VRAM
2026-09-10 deepseek-ai/DeepSeek-V4.1-Flash This repository — — DeepSeek-V4.1-Flash 552B Multimodal MoE Model: ~570GB Memory
2026-09-10 Efficient-Large-Model/H3-to-LTX-Latent-Adapter This repository — 4GB H3-to-LTX-Latent-Adapter: 4GB+ VRAM, File List
2026-09-09 nex-agi/Nex-N2.5-Pro This repository — — Nex-N2.5-Pro Long-Horizon Agent Model: ~98GB Memory, GGUF Builds
2026-09-09 nex-agi/Nex-N2.5-mini This repository — 16GB Nex-N2.5-mini Agent Model for Long-Horizon Tasks: 16GB+ VRAM
2026-09-08 openbmb/MiniCPM5-2B This repository — 4GB MiniCPM5-2B On-Device Model Strong in Code and Math: 4GB+ VRAM
2026-09-07 phasefield-audio/Irodori-TTS-v4.1-Anime This repository — 4GB Irodori-TTS-v4.1-Anime Anime-Style TTS Model: 4GB+ VRAM, File List

“Smallest VRAM tier" is the smallest tier in the requirements table of each article (for other builds, of those builds; for image, video and audio models, always the article’s own table, which counts every component). Leave headroom for context length.

Last updated 2026-09-27 (JST). The explanation at the top of this page was written with the help of AI from the primary sources it cites. The tables under “Our Coverage and Data" are assembled by code from our article log.