magnitudedev/magnitude v0.2.6 Released: Major Mac Speedups
magnitudedev/magnitude v0.2.6 is out, bringing massive prompt processing speedups and stability fixes for Apple Silic ...
llama.cpp v0.6.0 Released with llama_batch_ext and Metal Boosts
llama.cpp v0.6.0 is out, featuring the new llama_batch_ext API, major Metal backend speedups, web UI updates, and new ...
ggml v0.26.0 Released with Sparse Flash Attention & New Backends
ggml v0.26.0 is released, featuring sparse Flash Attention optimizations, expanded quantization support for WebGPU, a ...
vLLM v0.31.0 Released: Fast Restart and Hardware Optimization
vLLM v0.31.0 is released, featuring fast restart, DeepSeek optimizations, prefix cache security improvements, and bro ...
Magnitude CLI v0.2.5 Released: M5 Mac & MoE Speedups
Version 0.2.5 of @magnitudedev/cli is out, bringing 2x faster prompt processing on M5 Macs, MoE speedups, and M1/M2 f ...
LocalAI v4.11.0 Released with Failover and NeMo Audio Models
LocalAI v4.11.0 introduces model failover chains, NeMo speech-to-text models, decision models, signed OCI galleries, ...
Magnitude 0.2.4 Released: Faster Inference and Lower Memory
Magnitude 0.2.4 is released with significantly reduced memory usage, faster kernel tuning, and improved error handlin ...
SGLang v0.5.21 Released with Dynamic PD Role Switching
SGLang v0.5.21 is out, bringing dynamic PD role switching, a Rust-based prefix cache core, new APIs, and expanded mod ...
Testing OpenJev GGUF: A Tiny Model for Runtime Loaders
Explore tinyopenjev-for-testing-gguf, a miniature GGUF model by ggml-org designed for testing loader and runtime beha ...
Unsloth v0.1.901-beta Released: Major LoRA Memory Reductions
Unsloth v0.1.901-beta is released, featuring massive LoRA memory reductions for 4-bit checkpoints, a desktop command ...