LM Studio Announces Session References and Introspection in Bionic
LM Studio has announced ‘Introspection’ and ‘@’ mention features for Bionic, enabling agents ...
LocalAI v4.10.0 Released: Fleet Dashboard & M5 Support
LocalAI v4.10.0 is out, featuring a fleet management dashboard, Apple M5 startup crash fixes, credential file managem ...
Tencent Releases WeVisDoc-2B and WeVisDoc-4B Document Parsing Models
Tencent has released WeVisDoc-2B and WeVisDoc-4B, end-to-end document parsing models based on Qwen3-VL that extract s ...
Unsloth v0.1.810-beta Released with Multi-User and AMD Support
Unsloth v0.1.810-beta is out, adding multi-user accounts, Docker refreshes, AMD RDNA1/2 and Windows ARM64 support, an ...
GLM Announces Custom Inference Infrastructure and Local MoE Tests
GLM announces a new custom inference infrastructure built on Chinese accelerators, alongside community tests running ...
Breaking the 1.58-bit Barrier for Ternary LLMs with BITCOS
A research paper proposes BITCOS, achieving 1.485 bits/weight in ternary LLMs by exploiting weight distribution skew ...
TensorRT Edge-LLM Accelerates MLPerf Agentic Benchmark
NVIDIA tests TensorRT Edge-LLM with Qwen3.6-27B on Jetson AGX Thor, achieving a 6.4x speedup over llama.cpp in MLPerf ...
Qwen-2.5-1B-RLCD Text Generation Model: 4GB+ VRAM
Explore harshatheg/Qwen-2.5-1B-RLCD, an MLX implementation using parallel constrained decoding on Apple Silicon for h ...
EleutherAI Releases OLMo-3-7B Models for Reward-Hacking Research
EleutherAI releases two OLMo-3-7B models trained via GRPO to study reward-hacking dynamics and validate the hack-igni ...
Why Tech Community is Debating Bearish Views on LLMs
A personal blog post arguing against the autonomous future of LLMs sparks intense debate in the tech community on Hac ...