Hy-Memory Guide: VRAM Requirements, GGUF Builds
Everything Local Model Watch has published about the Hy-Memory family: 1 article(s) covering the base model and its fine-tunes, plus converted builds we tracked after publication. Memory requirements below are computed by this site from file sizes, not quoted from model cards. Part of our model family index.
At a Glance
| Item | Value |
|---|---|
| Base model(s) | tencent/Hy-Memory-30B-A3B |
| Publisher | Tencent |
| Parameters | 30.1B |
| License (model card) | apache-2.0 |
| Smallest VRAM tier | 12GB |
| Articles | 1 |
Hardware Requirements
Estimated requirements (calculated by Local Model Watch) — 30.1B parameters
| Your VRAM | Quantization | File size | Est. memory needed |
|---|---|---|---|
| 12GB (RTX 4070 / 3060 12GB, etc.) | IQ2_XXS | 8.5GB | 10.2GB |
| 24GB (RTX 4090 / 3090, etc.) | Q4_K_M | 17.0GB | 20.4GB |
| 32GB (RTX 5090, etc.) | Q6_K | 23.0GB | 27.6GB |
| 48GB (RTX 6000 Ada / A6000, etc.) | Q8_0 | 29.8GB | 35.7GB |
Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model’s authors. File sizes are measured from the converted build tencent/Hy-Memory-30B-A3B-GGUF. Compare with other models in our VRAM quick reference. What the quantization names mean: glossary.
Can You Run It Locally?
Runs in Ollama, LM Studio and llama.cpp via a converted build.
The publisher ships safetensors, but tencent/Hy-Memory-30B-A3B-GGUF provides a GGUF build you can use.
License — apache-2.0 (Commercial use allowed): Permits commercial use, modification and redistribution. Redistribution requires including the license and stating changes; includes a patent grant.
Compression: the IQ2_XXS build measures 2.43 bits per weight — about 15% the size of the original 16-bit weights, calculated by this site from the actual file sizes.
Compiled by this site’s code from the published formats, converted builds we have found, and each engine’s own model registry. “Not found" means we have not seen such a build, not that none exists. License summaries are not legal advice — check the publisher’s original terms before relying on them.
Quantized and Converted Variants
→ Scroll horizontally to see all columns
| Added | Publisher | Format | Repository | Smallest VRAM tier (build, est. memory) |
|---|---|---|---|---|
| 2026-11-17 | mlx-community | MLX | mlx-community/Hy-Memory-30B-A3B-4bit | MLX 4bit 18.9GB (fits in 24GB VRAM) |
| 2026-11-17 | mlx-community | MLX | mlx-community/Hy-Memory-30B-A3B-8bit | MLX 8bit 35.7GB (fits in 48GB VRAM) |
| 2026-10-19 | tencent | GGUF (imatrix) | tencent/Hy-Memory-30B-A3B-GGUF | IQ2_XXS 10.2GB (fits in 12GB VRAM) |
| 2026-10-18 | tencent | FP8 | tencent/Hy-Memory-30B-A3B-FP8 | FP8 34.2GB (fits in 48GB VRAM) |
File sizes of each build:
- Available builds in mlx-community/Hy-Memory-30B-A3B-4bit: MLX 4bit 15.8GB
- Available builds in mlx-community/Hy-Memory-30B-A3B-8bit: MLX 8bit 29.8GB
- Available builds in tencent/Hy-Memory-30B-A3B-GGUF: IQ1_M 7.5GB / IQ2_XXS 8.5GB / Q3_K_M 13.5GB / Q4_K_M 17.0GB / Q6_K 23.0GB / Q8_0 29.8GB
- Available builds in tencent/Hy-Memory-30B-A3B-FP8: FP8 28.5GB
This section is appended automatically by Local Model Watch when a converted build of this model appears after publication. Memory figures are estimated from the size of the distributed files.
Articles (the family’s own models first, then newest)
| Published | Model | Type | Article |
|---|---|---|---|
| 2026-11-17 | tencent/Hy-Memory-30B-A3B | New Models | Hy-Memory-30B-A3B Text Generation Model: 12GB+ VRAM, GGUF Builds |
Repositories
Last updated 2026-11-17 (JST). Assembled by code from our article log; no text on this page is written by an AI model.