Safetensors Model Format Explained: Supported Engines and Models
What Is Safetensors?
Safetensors is a file format for storing model weights (tensors), developed by Hugging Face. Most models published on Hugging Face ship the weights their publisher trained in this format (.safetensors files). In other words, it is the format that holds the “original" of a model.
Why It Matters
- Loading it does not execute code. The older PyTorch
.bin(pickle) format could run arbitrary code when loaded. Safetensors holds only the numbers and a minimal header, so that risk does not exist. - Fast loading, and you can read only what you need. Files are memory-mapped, so even large models start quickly, and a multi-GPU setup can read just the tensors each GPU needs.
- The common entry point for most tools. Transformers, Diffusers, vLLM and SGLang load it directly, and conversions to GGUF, MLX, AWQ and the rest almost always start from it.
Tips for Running It Locally
- At the original precision (BF16 / FP16) it needs a lot of memory. Plan for roughly two bytes per parameter (about 16 GB for an 8B model). To run a large model on a consumer GPU, look for a quantized build such as GGUF or AWQ.
- Low-precision Safetensors such as FP8 and NVFP4 also exist. They are mainly served with vLLM, SGLang and similar engines on NVIDIA GPUs of a supporting generation.
- Ollama and LM Studio (llama.cpp-based) cannot load it as is. Use a build converted to GGUF.
- Most image and video generation models also use it. For where each file goes in ComfyUI or Diffusers, see the “Files" section of each article.
- MLX, AWQ, GPTQ and EXL repositories also use
.safetensorsfiles, but they are listed on their own format pages rather than below.
Sources: Safetensors documentation (Hugging Face) and the huggingface/safetensors README (both as of 2026-09-27).
Our Coverage and Data
Local Model Watch has published 29 article(s) on models available in Safetensors: 29 where the repository itself is in Safetensors, and 0 where we found a Safetensors build of the model. The lists below only include builds we have checked (the publisher’s organization and well-known quantizers); a model missing here may still have a Safetensors build elsewhere. Part of our model format index.
Main Engines That Load This Format
| Engine | Overview |
|---|---|
| vLLM | High-throughput LLM serving engine built around PagedAttention. Handles concurrent requests and quantized weights (AWQ / GPTQ / FP8) and is widely used on server-class GPUs. |
| SGLang | LLM serving framework known for RadixAttention prefix caching and structured output. A common alternative to vLLM for serving. |
| Diffusers | Hugging Face’s Python library for diffusion models; the standard way to run image, video and audio generators from code. |
Models Available in Safetensors
→ Scroll horizontally to see all columns
| Published | Model | Where to get it | Quantizations | Smallest VRAM tier | Article |
|---|---|---|---|---|---|
| 2026-09-27 | XiaomiMiMo/MiMo-V2.6-Pro-RL | This repository | — | — | Xiaomi Releases MiMo-V2.6-Pro-RL: 1.02T MoE Flagship |
| 2026-09-26 | MiniMaxAI/MiniMax-H3 | This repository | — | 32GB | MiniMax-H3 Audio-Visual Video Generation Model: 32GB+ VRAM, File List |
| 2026-09-26 | deepseek-ai/DeepSeek-V4-Pro-0813 | This repository | — | — | DeepSeek-V4-Pro-0813 Text Generation Model: ~998GB Memory, GGUF Builds |
| 2026-09-26 | Qwen/Qwen3.8-27B | This repository | — | 8GB | Qwen3.8-27B Multimodal Vision-Language Model: 8GB+ VRAM, GGUF Builds |
| 2026-09-26 | togethercomputer/Tev1-0.8B-experimental | This repository | — | 4GB | Tev1-0.8B-experimental Text Generation Model: 4GB+ VRAM |
| 2026-09-25 | LiquidAI/LFM2.5-VL-3B-DSpark | This repository | — | 4GB | LFM2.5-VL-3B-DSpark Draft Model for Vision-Language Models: 4GB+ VRAM |
| 2026-09-24 | pfnet/plamo-3-610m-fin-instruct | This repository | — | 4GB | plamo-3-610m-fin-instruct Text Generation Model: 4GB+ VRAM |
| 2026-09-24 | Comfy-Org/Ming-Image | This repository | — | — | Ming-Image UI Design-Specialized Image Generation Model: ComfyUI Paths |
| 2026-09-24 | togethercomputer/Tev1-4B-experimental | This repository | — | 4GB | Tev1-4B-experimental Text Generation Model: 4GB+ VRAM, GGUF Builds |
| 2026-09-24 | Edge0/Audio8-ASR-Infinite | This repository | — | 12GB | Audio8-ASR-Infinite Speech Recognition Model: 12GB+ VRAM, File List |
| 2026-09-23 | Viggle/Qwen-Image-2.1-viggle-turbo | This repository | — | 48GB | Qwen-Image-2.1-viggle-turbo Image Generation Model: 48GB+ VRAM |
| 2026-09-21 | abenzerps/Qwen-Image-2.1-Uncensored-GGUF | This repository | — | 16GB | Qwen-Image-2.1-Uncensored-GGUF Image Generation Model: 16GB+ VRAM |
| 2026-09-20 | Qwen/Qwen-Image-2.1-PE-I2I | This repository | — | — | Qwen-Image-2.1 Released: Open-Weight Image Gen & Editing |
| 2026-09-19 | inclusionAI/Realtime-Venus | This repository | — | 24GB | Realtime-Venus Full-Duplex Audio-Video Dialog Model: 24GB+ VRAM |
| 2026-09-19 | Cactus-Compute/needle3 | This repository | — | 4GB | needle3 Text Generation Model: 4GB+ VRAM |
| 2026-09-18 | tencent/WeVisDoc-4B | This repository | — | 4GB | Tencent Releases WeVisDoc-2B and WeVisDoc-4B Document Parsing Models |
| 2026-09-16 | EleutherAI/olmo3-7b-sdf-sft-clean150 | This repository | — | 24GB | EleutherAI Releases OLMo-3-7B Models for Reward-Hacking Research |
| 2026-09-15 | EleutherAI/bergson-wikitext-gpt2-leaderboard | This repository | — | — | EleutherAI Releases Bergson Leaderboard Baseline GPT-2 Model |
| 2026-09-15 | Mothersuperior/yue2-mothersuperior-realaudio-tokenizer-v4 | This repository | — | 12GB | yue2-mothersuperior-realaudio-tokenizer-v4: 12GB+ VRAM, File List |
| 2026-09-13 | Comfy-Org/YuE2 | This repository | — | 12GB | YuE2: 12GB+ VRAM, ComfyUI Paths |
| 2026-09-11 | Lightricks/LTX-2.5-22b-IC-LoRA-Ingredients | This repository | — | — | Lightricks Releases Multiple LoRA and IC-LoRA Adapters for LTX-2.5 |
| 2026-09-10 | m-a-p/YuE2-3B | This repository | — | 12GB | YuE2-3B Music Generation Model for Lyrics and Style: 12GB+ VRAM |
| 2026-09-10 | deepseek-ai/DeepSeek-V4.1-Flash | This repository | — | — | DeepSeek-V4.1-Flash 552B Multimodal MoE Model: ~570GB Memory |
| 2026-09-10 | Efficient-Large-Model/H3-to-LTX-Latent-Adapter | This repository | — | 4GB | H3-to-LTX-Latent-Adapter: 4GB+ VRAM, File List |
| 2026-09-09 | nex-agi/Nex-N2.5-Pro | This repository | — | — | Nex-N2.5-Pro Long-Horizon Agent Model: ~98GB Memory, GGUF Builds |
| 2026-09-09 | nex-agi/Nex-N2.5-mini | This repository | — | 16GB | Nex-N2.5-mini Agent Model for Long-Horizon Tasks: 16GB+ VRAM |
| 2026-09-08 | openbmb/MiniCPM5-2B | This repository | — | 4GB | MiniCPM5-2B On-Device Model Strong in Code and Math: 4GB+ VRAM |
| 2026-09-07 | phasefield-audio/Irodori-TTS-v4.1-Anime | This repository | — | 4GB | Irodori-TTS-v4.1-Anime Anime-Style TTS Model: 4GB+ VRAM, File List |
“Smallest VRAM tier" is the smallest tier in the requirements table of each article (for other builds, of those builds; for image, video and audio models, always the article’s own table, which counts every component). Leave headroom for context length.
Last updated 2026-09-27 (JST). The explanation at the top of this page was written with the help of AI from the primary sources it cites. The tables under “Our Coverage and Data" are assembled by code from our article log.