s2-pro-GGUF 80-Language Text-to-Speech Model: 8GB+ VRAM, File List

s2-pro-GGUF 80-Language Text-to-Speech Model: 8GB+ VRAM, File List

At a Glance

Item Value
Repository ggml-org/s2-pro-GGUF
Publisher guide Fish Audio: models and licenses
Published 2026-11-18
License fish-audio-research-license
Formats GGUF
Source type Primary source (the publisher itself)

Values determined by this site’s code when the information was collected. Dates are JST.

Overview

ggml-org/s2-pro-GGUF is a GGUF conversion of the fishaudio/s2-pro text-to-speech model. It is automatically converted and published by ggml-org and can be run using llama-tts or the /tts endpoint in llama serve. The performance and specifications below are based on the original fishaudio/s2-pro model card unless otherwise noted.

Specifications

  • Original Model: fishaudio/s2-pro (Fish Audio S2 Pro). The model card states it was trained on “10M+ hours of audio data across 80+ languages."
  • Architecture: A Dual-Autoregressive (Dual-AR) configuration combining a decoder-only Transformer with an RVQ-based audio codec (10 codebooks, approx. 21Hz frame rate).
  • Slow AR (4B parameters): Operates on the time axis to predict the primary semantic codebook. – Fast AR (400M parameters): Generates the remaining 9 residual codebooks at each time step to reconstruct fine acoustic details.
  • Training Method: Reported to incorporate alignment via reinforcement learning.
  • Supported Languages: 80+
  • Tier 1: Japanese (ja), English (en), Chinese (zh) – Tier 2: Korean, Spanish, Portuguese, Arabic, Russian, French, German – Also supports many others including sv, it, tr, no, nl, etc.
  • Inline Control: Natural language instructions can be embedded in the text using [tag] format. It accepts free-form descriptions like [whisper in small voice], [professional broadcast tone], or [pitch up] rather than a fixed set of tags. Frequently used tags include [pause], [emphasis], [laughing], [whisper], [sad], and [singing], with support for over 15,000 unique tags.
  • GGUF Usage Features:
  • Assign voices to characters using speaker tags (e.g., <|speaker:0|>). – For voice cloning, specify a reference audio file via --tts-speaker-file and provide a transcription via --tts-speaker-text if necessary.
  • License Terms: According to the GGUF model card, it is free for research and non-commercial use, with restrictions on commercial use. Please check the full license text for details.

Performance

There are no comparison tables or benchmark scores against other models in the model card. The following information is provided by the original developer (Fish Audio) regarding the base model:

  • The model card positions S2 Pro as an “advanced TTS model capable of fine-grained control over prosody and emotion at the word level."
  • Streaming performance on a single NVIDIA H200 is reported as follows:
  • Real-Time Factor (RTF): 0.195 – Time to first audio: approx. 100 ms – Throughput: 3,000+ acoustic tokens/s while keeping RTF below 0.5

These figures are based on an SGLang-based streaming inference engine. Speed and quality when running the GGUF version via llama-tts are not documented and remain unverified.

Strengths and Use Cases

Based on the fishaudio/s2-pro model card:

  • Fine-grained emotional and prosodic control: Tags like [laughing], [whisper], [sad], [excited], and [pause] can be inserted at the word level. Free-form descriptions like [whisper in small voice] or [professional broadcast tone] are also supported. This is ideal for narration, character dialogue, and conversational audio requiring expressive intonation.
  • Multi-speaker interaction: The GGUF version allows assigning voices to different characters using speaker tags like <|speaker:0|>.
  • Voice cloning: Use --tts-speaker-file to provide a reference audio. If a transcription is available, it can be provided via --tts-speaker-text. The fidelity of the voice cloning is not documented and remains unverified.
  • Multilingual synthesis: Supports over 80 languages, with Japanese, English, and Chinese in Tier 1. This is good news for users wanting to test Japanese speech synthesis locally.

This GGUF version is an automatic conversion of the original model weights by ggml-org. It is intended to enable execution via llama.cpp tools rather than as a fine-tuned model with altered performance or capabilities.

If you are considering commercial use, please be cautious. The GGUF card states that it is free for research and non-commercial use, but commercial use is restricted. Please verify the license terms in detail.

Hardware Requirements

Estimated requirements (calculated by Local Model Watch) — 4.6B parameters (taken from the base model fishaudio/s2-pro)

Your VRAM Quantization File size Est. memory needed
8GB (RTX 4060 / 3060 Ti, etc.) Q8_0 4.0GB 4.8GB
12GB (RTX 4070 / 3060 12GB, etc.) BF16 7.5GB 9.0GB

Memory estimates add a 20% runtime overhead (KV cache, etc.) to the actual size of the distributed files. Actual usage varies with context length, batch size and inference engine. These figures are computed by this site from file sizes, not published by the model’s authors. Compare with other models in our VRAM quick reference. What the quantization names mean: glossary.

Can You Run It Locally?

The publisher distributes this model as GGUF.

License — fish-audio-research-license: A custom license from the publisher. Check the original terms directly, including whether commercial use is permitted.

Compression: the Q8_0 build measures 7.53 bits per weight — about 47% the size of the original 16-bit weights, calculated by this site from the actual file sizes.

Compiled by this site’s code from the published formats and the license field. License summaries are not legal advice — check the publisher’s original terms before relying on them.

Our Own Measurements

Measurements We Did Not Take

We have not confirmed that this site meets the commercial-use terms of this model’s license (fish-audio-research-license). Because this site carries advertising, we did not run the model (no CPU run, answers, quantization comparison, conversion or generation).

Distributed Files

Weight files published in ggml-org/s2-pro-GGUF, listed by this site from the Hugging Face API. Sizes are the actual file sizes.

File Size
mmproj-s2-pro-BF16.gguf 2.05GB
s2-pro-BF16.gguf 8.07GB
s2-pro-Q8_0.gguf 4.29GB

How to Get It

  • Distribution Format: GGUF. It is not gated, so you can download it from Hugging Face without needing to agree to a license on the site. However, the weights are released under the Fish Audio Research License.
  • Repository: ggml-org/s2-pro-GGUF (Original model: fishaudio/s2-pro)
  • Supported Tools: llama-tts and llama serve from llama.cpp. Support for other tools like ComfyUI is not mentioned in the documentation.

To run from the terminal, use the following command:

llama-tts -hf ggml-org/s2-pro-GGUF -p "<|speaker:0|>Hello world [laughing]" --output out.wav

To use it as a server, start it with the following command and call the /tts endpoint:

llama serve -hf ggml-org/s2-pro-GGUF

Specific instructions for voice cloning are summarized in the llama.cpp TTS documentation (Fish Audio S2 Pro section).

According to the card, this conversion is performed automatically by https://github.com/ggml-org/convert. Differences in quality between quantization levels are not documented.

Related Articles

What to Read Next

Sources