llama.cpp v0.6.0 Released with llama_batch_ext and Metal Boosts
llama.cpp v0.6.0 is out, featuring the new llama_batch_ext API, major Metal backend speedups, web UI updates, and new ...
ggml v0.26.0 Released with Sparse Flash Attention & New Backends
ggml v0.26.0 is released, featuring sparse Flash Attention optimizations, expanded quantization support for WebGPU, a ...
GLM-5.3-Flash-GGUF Vision-Language Model: ~150GB Memory
Discover ggml-org/GLM-5.3-Flash-GGUF, a GGUF quantization of zai-org’s native multimodal MoE model, featuring v ...
OpenJev-GGUF 27.4B Decision-Making Specialized Model: 24GB+ VRAM
Explore OpenJev-GGUF, a GGUF quantized open-weight decision-making model by ggml-org designed for structured choices ...
Testing OpenJev GGUF: A Tiny Model for Runtime Loaders
Explore tinyopenjev-for-testing-gguf, a miniature GGUF model by ggml-org designed for testing loader and runtime beha ...
ggml v0.25.2 Released with Hardware Backend Optimizations
ggml v0.25.2 has been released, focusing on improvements to hardware backends including CUDA, Vulkan, OpenCL, and Hex ...
llama.cpp v0.5.0 Released with Backend and Server Upgrades
llama.cpp v0.5.0 is released, featuring CUDA/Metal hardware acceleration, multi-address server support, and new model ...
ggml v0.25.0 Released: FlashAttention and MoE Optimizations
ggml v0.25.0 is now available, featuring expanded FlashAttention support, MoE and SSM optimizations, and new hardware ...
MiMo-V2.6-Flash-RL-GGUF Multimodal MoE Model: ~141GB Memory
Explore MiMo-V2.6-Flash-RL-GGUF, a GGUF quantization of XiaomiMiMo’s native omni-modal model featuring a 309B t ...
MiMo-V2.6-Distill-Qwen-9B-GGUF: Our Test Answers, 12GB+ VRAM
Download the GGUF version of MiMo-V2.6-Distill-Qwen-9B, a 9.4B agentic model for coding and cybersecurity.