Engines and Tools

magnitudedev/magnitude v0.2.6 Released: Major Mac Speedups

magnitudedev/magnitude v0.2.6 is out, bringing massive prompt processing speedups and stability fixes for Apple Silic ...

Weekly Roundup

Local AI Model Weekly Highlights: Structured Output & Video LoRAs

Weekly roundup of local generative AI models: structured output models, video generation LoRAs, inference engines, an ...

Engines and Tools

Magnitude CLI v0.2.5 Released: M5 Mac & MoE Speedups

Version 0.2.5 of @magnitudedev/cli is out, bringing 2x faster prompt processing on M5 Macs, MoE speedups, and M1/M2 f ...

Engines and Tools

Magnitude 0.2.4 Released: Faster Inference and Lower Memory

Magnitude 0.2.4 is released with significantly reduced memory usage, faster kernel tuning, and improved error handlin ...

Engines and Tools

Magnitude: Up to 2x Faster Than llama.cpp Officially, 21x Slower on Our CPU

Magnitude is an open-source inference engine for AI agents that auto-optimizes kernels for hardware, beating llama.cp ...