Idol 3D Gaussian Splatting Generation Model: ComfyUI Paths

Idol 3D Gaussian Splatting Generation Model: ComfyUI Paths

At a Glance

Item Value
Repository Comfy-Org/Idol
Family guide idol guide (2 articles)
Published 2026-11-02
License apache-2.0
Formats safetensors
Source type Primary source (the publisher itself)

Values determined by this site’s code when the information was collected. Dates are JST.

Overview

Comfy-Org has released “Comfy-Org/Idol", a ComfyUI-compatible repackaged version of “Idol", an open-weight model that generates 3D Gaussian Splatting models from a single image.

This model is a derivative distribution where the files from “speridlabs/idol", published by speridlabs, have been rearranged to match ComfyUI’s standard folder structure. It accepts a single image of an object (CG renderings, AI-generated images, or real-world photographs) as input, estimates up to 1,048,576 3D Gaussians including the backside and sides not visible in the original image, and outputs a standard 3DGS format .ply file.

Specifications

The main specifications described in the distribution repository and the documentation for the original model “speridlabs/idol" are as follows. This model is positioned as a fine-tuned version of “TripoSplat" and is compatible with existing TripoSplat workflows.

  • Architecture and Components: It features a pipeline configuration combining multiple components:
  • DiT (denoiser): 370.6M – Octree decoder: 50.8M – Gaussian decoder: 237.3M – BiRefNet (background removal): 220.7M – DINOv3 ViT-H+/16 (image encoder): 840.6M – FLUX.2 VAE: 84.1M – Total parameters across the request: Approximately 1.80B (~1.80B)
  • Output Specifications:
  • 3D Gaussian Splatting data (.ply file) – Background-removed and cropped input image (_input.png) – Estimated camera parameters (_camera.json) – Number of output Gaussians: 32,768 to 1,048,576 (specifiable in multiples of 32, default is 262,144)
  • Recommended Sampling Parameters:
  • Number of sampling steps (--steps): Default 50 steps (reducing steps speeds up generation but sacrifices fine details) – CFG strength (--cfg_strength): Default 3.0 (controls how strictly the object shape follows the input image) – Time shift (--rescale_t): Default 3.0 (higher values allocate more steps to rough overall shape formation, lower values allocate more to fine detail formation)
  • Input Mode Settings:
  • synthetic (default): For CG renderings or generated images of single objects. Objects are cropped to occupy 1/1.2 of the frame – real: For real-world photographs. Objects are cropped to occupy 1/1.7 of the frame
  • Optimization and Operational Settings:
  • Fast sampling functionality is enabled by default, operating approximately 1.7x faster on GPU while maintaining the same output quality. The denoiser is compiled with torch.compile, paths with and without guidance are executed as a single batch, and cuDNN with TF32 matrix multiplication is used for attention (can be disabled with --no_optimize) – DINOv3 precision setting (--dinov3_dtype): Default is bf16 (fp32 can also be specified)
  • License Terms:
  • Governed by the Apache-2.0 license

Performance

Below are the benchmark evaluations published in the model card of the original model “speridlabs/idol". Each model was evaluated using a single NVIDIA H100, comparing average scores across the input viewpoint (PSNR, SSIM, LPIPS, IoU) and seven novel viewpoints (DINOv2, CLIP, Sharpness distance).

→ Scroll horizontally to see all columns

Model Setting PSNR ↑ SSIM ↑ LPIPS ↓ IoU ↑ DINOv2 ↑ CLIP ↑ Sharpness distance ↓ Request time ↓
Idol 50 steps, 262,144 Gaussians 12.25 0.726 0.213 0.862 0.781 0.885 0.81 6.8 s
TripoSplat 50 steps, 262,144 Gaussians 11.76 0.712 0.225 0.860 0.743 0.868 1.03 9.9 s
TRELLIS Paper setting, 50 + 50 steps 11.89 0.716 0.235 0.845 0.754 0.868 0.97 7.1 s
LGM Default, 65,536 Gaussians 12.46* 0.722 0.237 0.834 0.575 0.784 1.22 1.1 s

According to this comparison released by the publishers, Idol achieves the best scores across SSIM (0.726), LPIPS (0.213), IoU (0.862), DINOv2 (0.781), CLIP (0.885), and Sharpness distance (0.81), outperforming TripoSplat, TRELLIS, and LGM. Furthermore, compared to its base model TripoSplat, the request processing time has been reduced from 9.9 seconds to 6.8 seconds. On the other hand, its PSNR (12.25) and processing time (6.8 seconds) fall short of LGM (PSNR 12.46, Request time 1.1 seconds). Note that according to the publisher’s disclaimer, LGM achieves the highest numerical PSNR because PSNR is an metric averaging squared pixel errors, despite its generation results being visually blurry.

Additionally, the original model documentation reports processing speeds on various GPUs (median of 8 images at 50 steps and 262,144 generated Gaussians), showing processing times provided by the publishers such as 3.4 seconds on B300, 6.7 seconds on H100, 14.1 seconds on RTX 5090, 19.1 seconds on RTX 4090, and 46.2 seconds on RTX 3080, ranging from consumer-grade to data-center hardware.

Strengths and Use Cases

According to the documentation for the original model “speridlabs/idol" and the notes in this repository, this model specializes in taking a single still image as input and reconstructing 3D shapes—including the backsides and sides of objects not visible in the image—in 3D Gaussian Splatting (3DGS) format. Main use cases and specialized processing include:

  • 3D Object Generation from Diverse Image Sources: Can generate 3D Gaussian Splatting data from 3D CG renderings, AI-generated images, and real-world photographs alike.
  • Automatic Framing and Background Removal Based on Input Image: Integrates BiRefNet internally to automatically remove backgrounds from input images and frame subjects at appropriate ratios before processing. Two modes are available depending on the type of input image:
  • synthetic mode: Settings for 3D CG renderings and AI-generated images. Cropping is performed so objects occupy 1/1.2 of the entire frame. – real mode: Settings for real-world photographs. Cropping is performed so objects occupy 1/1.7 of the entire frame.
  • High-Resolution and High-Density Gaussian Representation: The number of generated Gaussians can be specified from a minimum of 32,768 up to a maximum of 1,048,576 (~1 million). Adjustments can be made from lightweight previews to high-detail expressions according to use case and machine specs.
  • Integration with Existing TripoSplat Workflows: Because this model was developed as a fine-tuned version of TripoSplat, it can be dropped directly into existing TripoSplat workflow environments. It is well-suited for operations such as constructing nodes in ComfyUI and placing them downstream of an image generation pipeline to perform direct 3D conversion.

Distributed Files

Weight files published in Comfy-Org/Idol, listed by this site from the Hugging Face API. Sizes are the actual file sizes.

File Size ComfyUI folder
clip_vision/dino_v3_vit_h_bf16.safetensors 1.68GB models/clip_vision/
diffusion_models/idol_fp16.safetensors 741MB models/diffusion_models/
vae/flux2-vae.safetensors 336MB models/vae/
vae/idol_decoder_fp16.safetensors 576MB models/vae/

The ComfyUI folder is shown only where the repository’s layout mirrors ComfyUI’s models/ directory.

How to Get It

“Comfy-Org/Idol" is available from the Hugging Face repository. Weight files are distributed in the single-file safetensors format.

When using this model in a ComfyUI environment, place the respective repository files into ComfyUI’s designated directories as follows:

📂 ComfyUI/
├── 📂 models/
│   ├── 📂 diffusion_models/
│   │   └── idol_fp16.safetensors
│   ├── 📂 clip_vision/
│   │   └── dino_v3_vit_h_bf16.safetensors
│   ├── 📂 vae/
│   │   ├── flux2-vae.safetensors
│   │   └── idol_decoder_fp16.safetensors

Note that while the Comfy-Org/Idol repository itself is not gated, the following two image encoders/VAEs referenced by the original model pipeline are published as gated models on Hugging Face. When using them, you must agree to the terms of use (request access) on each respective model page in advance and log in to your Hugging Face account (hf auth login or setting HF_TOKEN).

Alternatively, if running via Python scripts or the command line using the original model’s SDK (idol-sdk) without ComfyUI, you can set up the environment with the following steps. Python 3.10 or higher, PyTorch 2.5 or higher, and a CUDA-capable NVIDIA GPU are required.

git clone https://github.com/speridlabs/idol-sdk.git
cd idol-sdk
pip install -e.

Required weights will be automatically downloaded to the Hugging Face cache directory upon first execution. If access permissions for the encoders have not been acquired, a notification regarding missing permissions will be issued before the download starts.

Example commands for running from the command line are as follows. A 3DGS format .ply file, background-removed image (_input.png), and estimated camera information (_camera.json) are output as generation results:

# When inputting a real-world photograph
python -m idol.sample --image photo.jpg --mode real

# When inputting a CG image or generated image folder
python -m idol.sample --image renders/ --mode synthetic --out outputs

When calling from Python code, you can run it using IdolPipeline as follows:

from idol import IdolPipeline

pipeline = IdolPipeline.from_pretrained("speridlabs/idol")
output = pipeline("photo.jpg", mode="real", seed=42, num_gaussians=1_048_576)
output.gaussian.save_ply("photo.ply")

Can You Run It Locally?

The publisher distributes this model as safetensors.

License — apache-2.0 (Commercial use allowed): Permits commercial use, modification and redistribution. Redistribution requires including the license and stating changes; includes a patent grant.

Compiled by this site’s code from the published formats and the license field. License summaries are not legal advice — check the publisher’s original terms before relying on them.

Related Articles

What to Read Next

Sources