Run GGUF Models Directly in Transformers with llama.cpp Support
Hugging Face adds direct execution support for llama.cpp GGUF models in transformers, starting with local Qwen3.5 inf ...
Open-Weight Model Weekly: Ternary 27B Models and Apple Silicon Updates
Weekly roundup of open-weight generative models: ternary quantization for 27B models, Apple Silicon optimizations, an ...
Intern-S2-397B-GGUF Vision-Language Model: ~102GB Memory
Discover bartowski/Intern-S2-397B-GGUF, a multimodal foundation model quantized for local inference using llama.cpp.
llama.cpp v0.4.1 Released with Breaking Changes
llama.cpp v0.4.1 is released, featuring important argument cleanups, new model architectures, and stability improveme ...
TheDrummer_Orion-26B-A4B-v1.1-GGUF Multimodal Model: 12GB+ VRAM
Explore bartowski’s GGUF quantizations for Orion-26B-A4B-v1.1, featuring multimodal support, performance tables ...
Signal-3.8-27B-GGUF: Our Test Answers, 16GB+ VRAM
Discover Signal-3.8-27B-GGUF, a minimally invasive fine-tune of Qwen3.8-27B offering lower latency, reduced token usa ...