granite-switch-4.1 Guide: VRAM Requirements, GGUF Builds

Everything Local Model Watch has published about the granite-switch-4.1 family: 1 article(s) covering the base model and its fine-tunes, plus converted builds we tracked after publication. Memory requirements below are computed by this site from file sizes, not quoted from model cards. Part of our model family index.

At a Glance

Item Value
Base model(s) ibm-granite/granite-switch-4.1-8b
Publisher IBM (Granite)
Parameters 8.8B
License (model card) apache-2.0
Smallest VRAM tier 24GB
Articles 1

Hardware Requirements

Estimated requirements (calculated by Local Model Watch) — 8.8B parameters

Your VRAM Quantization File size Est. memory needed
24GB (RTX 4090 / 3090, etc.) I64 16.3GB 19.6GB

Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model’s authors. Compare with other models in our VRAM quick reference. What the quantization names mean: glossary.

Can You Run It Locally?

Runs in Ollama, LM Studio and llama.cpp via a converted build.

The publisher ships safetensors, but ibm-granite/granite-switch-4.1-8b-GGUF provides a GGUF build you can use.

License — apache-2.0 (Commercial use allowed): Permits commercial use, modification and redistribution. Redistribution requires including the license and stating changes; includes a patent grant.

Compiled by this site’s code from the published formats, converted builds we have found, and each engine’s own model registry. “Not found" means we have not seen such a build, not that none exists. License summaries are not legal advice — check the publisher’s original terms before relying on them.

Quantized and Converted Variants

→ Scroll horizontally to see all columns

Added Publisher Format Repository Smallest VRAM tier (build, est. memory)
2026-10-23 ibm-granite GGUF ibm-granite/granite-switch-4.1-8b-GGUF Q5_0 7.8GB (fits in 8GB VRAM)
2026-10-23 ibm-granite GGUF ibm-granite/granite-switch-4.1-30b-GGUF Q4_1 24.0GB (fits in 24GB VRAM)

File sizes of each build:

  • Available builds in ibm-granite/granite-switch-4.1-8b-GGUF: Q2_K 4.3GB / Q3_K_S 4.6GB / Q3_K_M 5.1GB / Q3_K_L 5.5GB / Q4_0 5.6GB / Q4_K_S 5.6GB / Q4_K_M 6.0GB / Q4_1 6.1GB / Q5_0 6.5GB / Q5_K_S 6.5GB / Q5_K_M 6.7GB / Q5_1 7.0GB / Q6_K 7.5GB / Q8_0 9.4GB / BF16 16.7GB
  • Available builds in ibm-granite/granite-switch-4.1-30b-GGUF: Q2_K 13.4GB / Q3_K_S 14.8GB / Q3_K_M 16.3GB / Q3_K_L 17.6GB / Q4_0 18.4GB / Q4_K_S 18.5GB / Q4_K_M 19.6GB / Q4_1 20.0GB / Q5_0 21.7GB / Q5_K_S 21.7GB / Q5_K_M 22.3GB / Q5_1 23.3GB / Q6_K 25.2GB / Q8_0 31.7GB / BF16 56.9GB

This section is appended automatically by Local Model Watch when a converted build of this model appears after publication. Memory figures are estimated from the size of the distributed files.

Articles (the family’s own models first, then newest)

Published Model Type Article
2026-11-17 ibm-granite/granite-switch-4.1-8b New Models IBM Releases Granite Switch 4.1: Modular LLMs with aLoRA and Speech

Repositories

Last updated 2026-11-17 (JST). Assembled by code from our article log; no text on this page is written by an AI model.