Engines and Tools

ggml v0.26.0 Released with Sparse Flash Attention & New Backends

ggml v0.26.0 is released, featuring sparse Flash Attention optimizations, expanded quantization support for WebGPU, a ...

Engines and Tools

Magnitude CLI v0.2.5 Released: M5 Mac & MoE Speedups

Version 0.2.5 of @magnitudedev/cli is out, bringing 2x faster prompt processing on M5 Macs, MoE speedups, and M1/M2 f ...

Engines and Tools

ggml v0.25.2 Released with Hardware Backend Optimizations

ggml v0.25.2 has been released, focusing on improvements to hardware backends including CUDA, Vulkan, OpenCL, and Hex ...

Engines and Tools

ggml v0.24.0 Released with Backend Improvements and API Updates

ggml v0.24.0 is out, featuring a new precision control API, major backend improvements for Vulkan, SYCL, and Metal, a ...

Engines and Tools

Unsloth v0.1.808-beta Released with Speedups for Diffusion

Unsloth v0.1.808-beta brings significant performance gains for diffusion models, AMD GPUs, and Apple Silicon, alongsi ...

Engines and Tools

Unsloth v0.1.807-beta Released with Major Performance Boost

Unsloth v0.1.807-beta is out, bringing major performance boosts for AMD and Apple Silicon, Vulkan defaults, and Windo ...