NVIDIA-Nemotron-3.5-Super-VL Guide: VRAM Requirements, GGUF Builds

Everything Local Model Watch has published about the NVIDIA-Nemotron-3.5-Super-VL family: 2 article(s) covering the base model and its fine-tunes, plus converted builds we tracked after publication. Memory requirements below are computed by this site from file sizes, not quoted from model cards. Part of our model family index.

At a Glance

Item Value
Base model(s) nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16, nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4
Publisher NVIDIA
License (model card) openmdw-1.1
Smallest VRAM tier 80GB
Articles 2

Hardware Requirements

Estimated requirements (calculated by Local Model Watch) — 124.5B parameters

Your VRAM Quantization File size Est. memory needed
80GB class (A100 / H100) Q3_K_XL 61.2GB 73.5GB

Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model’s authors. File sizes are measured from the converted build unsloth/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF. Compare with other models in our VRAM quick reference. What the quantization names mean: glossary.

Figures are for nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16. Other sizes in this family are covered in the articles below.

Can You Run It Locally?

Runs in Ollama, LM Studio and llama.cpp via a converted build.

The publisher ships safetensors, but unsloth/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF provides a GGUF build you can use.

License — openmdw-1.1: A custom license from the publisher. Check the original terms directly, including whether commercial use is permitted.

Compiled by this site’s code from the published formats, converted builds we have found, and each engine’s own model registry. “Not found" means we have not seen such a build, not that none exists. License summaries are not legal advice — check the publisher’s original terms before relying on them.

This assessment is for nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16.

Quantized and Converted Variants

→ Scroll horizontally to see all columns

Added Publisher Format Repository Smallest VRAM tier (build, est. memory)
2026-11-17 nvidia NVFP4 nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4 NVFP4 83.8GB (does not fit a single consumer GPU)
2026-11-17 nvidia NVFP4 nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4-LiLiCorr NVFP4 1.5GB (fits in 4GB VRAM)
2026-11-17 DevQuasar GGUF DevQuasar/nvidia.NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16-GGUF Q3_K_M 75.1GB (fits in 80GB VRAM)
2026-10-16 unsloth GGUF unsloth/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF Q3_K_XL 73.5GB (fits in 80GB VRAM)

File sizes of each build:

  • Available builds in nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4: NVFP4 69.9GB
  • Available builds in nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4-LiLiCorr: NVFP4 1.2GB
  • Available builds in DevQuasar/nvidia.NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16-GGUF: Q2_K 49.8GB / Q3_K_M 62.6GB / Q4_K_M 80.1GB / Q5_K_M 89.1GB / Q6_K 105.2GB / Q8_0 119.6GB
  • Available builds in unsloth/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF: IQ1_M 43.0GB / IQ2_XXS 47.6GB / IQ2_M 52.0GB / Q2_K_XL 53.8GB / IQ3_XXS 55.7GB / Q3_K_XL 61.2GB / Q4_K_XL 80.9GB / Q5_K_XL 103.1GB / Q6_K_XL 112.7GB / Q8_0 122.6GB

This section is appended automatically by Local Model Watch when a converted build of this model appears after publication. Memory figures are estimated from the size of the distributed files.

Articles (the family’s own models first, then newest)

Published Model Type Article
2026-11-17 nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 New Models NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16: 80GB+ VRAM, GGUF Builds
2026-11-17 nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4 New Models NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4: ~84GB Memory

Repositories

Last updated 2026-11-17 (JST). Assembled by code from our article log; no text on this page is written by an AI model.