New Models

Qwen3.5-4B-GGUF Vision-Language Model: 4GB+ VRAM

Explore ggml-org/Qwen3.5-4B-GGUF, a GGUF quantized multimodal 4B language model supporting text, image, and video inp ...

Engines and Tools

llama.cpp Speculative Decoding Test GGUF Models Released

ggml-org released ggml-org/spec-for-testing-GGUF featuring target and draft GGUF models for speculative decoding inte ...