Community

DeepSeek V4.1 Flash Rumors: Outperforming V4 Pro

DeepSeek plans to release V4.1 Flash, outperforming V4 Pro at a lower cost, sparking community debate on forced model ...

Engines and Tools

vLLM v0.29.0 Released: Model Runner V2 Now Default

vLLM v0.29.0 is released with Model Runner V2 as default, FlashInfer all-reduce, new admission control flags, and sup ...

Community

Qwen3.8 27B Quantization Benchmark: 4-bit vs 1-bit

Detailed benchmark results reveal performance changes in Qwen3.8 27B quantizations, showing high performance down to ...

Engines and Tools

Unsloth v0.1.807-beta Released with Major Performance Boost

Unsloth v0.1.807-beta is out, bringing major performance boosts for AMD and Apple Silicon, Vulkan defaults, and Windo ...

New Models

MiniCPM5-2B Text Generation Model: Our Test Answers, 4GB+ VRAM

OpenBMB has released MiniCPM5-2B, a 2B-class on-device model delivering SOTA performance in coding, math, long contex ...

Engines and Tools

ExLlamaV3 1.4.8 Released: VRAM Opt & FA-2 Removal

ExLlamaV3 1.4.8 is released. Key updates include VRAM allocation optimization and the complete removal of Flash Atten ...