Unsloth v0.1.810-beta Released with Multi-User and AMD Support
Unsloth v0.1.810-beta is out, adding multi-user accounts, Docker refreshes, AMD RDNA1/2 and Windows ARM64 support, an ...
GLM Announces Custom Inference Infrastructure and Local MoE Tests
GLM announces a new custom inference infrastructure built on Chinese accelerators, alongside community tests running ...
TensorRT Edge-LLM Accelerates MLPerf Agentic Benchmark
NVIDIA tests TensorRT Edge-LLM with Qwen3.6-27B on Jetson AGX Thor, achieving a 6.4x speedup over llama.cpp in MLPerf ...
Unsloth Now Supports Windows ARM64 for Local LLMs
Unsloth releases Windows ARM64 binaries, enabling local LLM execution and fine-tuning on ARM-based Windows devices.
ComfyUI v0.36.0 Released: Generic Loops, Yue2 & Marigold v2
ComfyUI v0.36.0 is out, introducing Generic Loops, support for Yue2 and Marigold v2, Llama RoPE speedups, AMD improve ...
koboldcpp v1.121 Released: New Features & Bug Fixes
koboldcpp v1.121 is out with Minimax H3 media reference support, revamped MusicUI, runtime LoRA selectors in SDUI, an ...
llama.cpp v0.4.1 Released with Breaking Changes
llama.cpp v0.4.1 is released, featuring important argument cleanups, new model architectures, and stability improveme ...
ggml v0.24.0 Released with Backend Improvements and API Updates
ggml v0.24.0 is out, featuring a new precision control API, major backend improvements for Vulkan, SYCL, and Metal, a ...
ExLlamaV3 1.5.0 Released: Major MoE Inference Speedups
ExLlamaV3 1.5.0 is released, bringing massive MoE inference speedups, experimental Linux CPU offloading, and Nemotron ...
litelm: Lightweight LLM Routing Library Released
Discover litelm, a lightweight LLM routing library extracting core routing and message format translation features fr ...