ExLlamaV3 1.5.0 Released: Major MoE Inference Speedups
ExLlamaV3 1.5.0 is released, bringing massive MoE inference speedups, experimental Linux CPU offloading, and Nemotron ...
Signal-3.8-27B-GGUF: Our Test Answers, 16GB+ VRAM
Discover Signal-3.8-27B-GGUF, a minimally invasive fine-tune of Qwen3.8-27B offering lower latency, reduced token usa ...
Gryphe_Pantheon-Reasoning-26B-A4B-1.1-V2-GGUF: Our Test Answers
Download bartowski’s GGUF quantizations for Gryphe Pantheon-Reasoning-26B, a Gemma 4 roleplay and reasoning mod ...
Benchmarking Qwen3.8 27B Quantizations: Performance Analysis
Detailed benchmark results reveal performance changes in Qwen3.8 27B quantizations, showing high performance down to ...
MiniCPM5-2B Text Generation Model: Our Test Answers, 4GB+ VRAM
OpenBMB has released MiniCPM5-2B, a 2B-class on-device model delivering SOTA performance in coding, math, long contex ...
Inference Engine Updates and Practical GGUF Models Like Qwopus
Explore the latest local AI trends, including inference engine updates like ggml v0.23.0 and ExLlamaV3, and GGUF rele ...