magnitudedev/magnitude v0.2.6 Released: Major Mac Speedups
magnitudedev/magnitude v0.2.6 is out, bringing massive prompt processing speedups and stability fixes for Apple Silic ...
Magnitude CLI v0.2.5 Released: M5 Mac & MoE Speedups
Version 0.2.5 of @magnitudedev/cli is out, bringing 2x faster prompt processing on M5 Macs, MoE speedups, and M1/M2 f ...
Magnitude 0.2.4 Released: Faster Inference and Lower Memory
Magnitude 0.2.4 is released with significantly reduced memory usage, faster kernel tuning, and improved error handlin ...
Magnitude: Up to 2x Faster Than llama.cpp Officially, 21x Slower on Our CPU
Magnitude is an open-source inference engine for AI agents that auto-optimizes kernels for hardware, beating llama.cp ...