Magnitude 0.2.4 Released: Faster Inference and Lower Memory
Magnitude 0.2.4 is released with significantly reduced memory usage, faster kernel tuning, and improved error handlin ...
SGLang v0.5.21 Released with Dynamic PD Role Switching
SGLang v0.5.21 is out, bringing dynamic PD role switching, a Rust-based prefix cache core, new APIs, and expanded mod ...
vLLM v0.30.0 Released: Fast Start Weight Caching and New Models
vLLM v0.30.0 is released, featuring Fast Start weight caching, engine initialization speedups, DeepSeek-V4.1-Flash su ...
llama.cpp v0.4.1 Released with Breaking Changes
llama.cpp v0.4.1 is released, featuring important argument cleanups, new model architectures, and stability improveme ...