Ollama v0.35.0 Released: New API for Decision Models
Ollama v0.35.0 is released with a new/v1/systemone API for decision models, supporting nimble and tev1 models for fas ...
LM Studio Announces Session References and Introspection in Bionic
LM Studio has announced ‘Introspection’ and ‘@’ mention features for Bionic, enabling agents ...
LocalAI v4.10.0 Released: Fleet Dashboard & M5 Support
LocalAI v4.10.0 is out, featuring a fleet management dashboard, Apple M5 startup crash fixes, credential file managem ...
Unsloth v0.1.810-beta Released with Multi-User and AMD Support
Unsloth v0.1.810-beta is out, adding multi-user accounts, Docker refreshes, AMD RDNA1/2 and Windows ARM64 support, an ...
GLM Announces Custom Inference Infrastructure and Local MoE Tests
GLM announces a new custom inference infrastructure built on Chinese accelerators, alongside community tests running ...
Breaking the 1.58-bit Barrier for Ternary LLMs with BITCOS
A research paper proposes BITCOS, achieving 1.485 bits/weight in ternary LLMs by exploiting weight distribution skew ...
Unsloth Now Supports Windows ARM64 for Local LLMs
Unsloth releases Windows ARM64 binaries, enabling local LLM execution and fine-tuning on ARM-based Windows devices.
EleutherAI Releases OLMo-3-7B Models for Reward-Hacking Research
EleutherAI releases two OLMo-3-7B models trained via GRPO to study reward-hacking dynamics and validate the hack-igni ...
Why Tech Community is Debating Bearish Views on LLMs
A personal blog post arguing against the autonomous future of LLMs sparks intense debate in the tech community on Hac ...
ComfyUI v0.36.0 Released: Generic Loops, Yue2 & Marigold v2
ComfyUI v0.36.0 is out, introducing Generic Loops, support for Yue2 and Marigold v2, Llama RoPE speedups, AMD improve ...