Realtime-Venus Full-Duplex Audio-Video Dialog Model: 24GB+ VRAM
Explore Realtime-Venus, a multimodal conversational system featuring asynchronous delegation and active full-duplex d ...
SGLang v0.5.20 Released: New Models and Optimizations
SGLang v0.5.20 is released with 713 PRs, adding support for new models, ROCm load time improvements, Intel XPU offici ...
needle3 Text Generation Model: 4GB+ VRAM
Cactus Compute has released Needle 3, a tiny 2bit automation foundation model for mobile, edge, and IoT devices focus ...
Unsloth v0.1.811-beta Released with AMD & NVIDIA Docker Images
Unsloth v0.1.811-beta is out, introducing new NVIDIA and AMD Docker images, multi-user accounts, 2x faster diffusion ...
Ternary-Bonsai-2-27B-gguf: Our Test Answers, 8GB+ VRAM
Discover Ternary-Bonsai-2-27B-gguf, a ternary language model by Prism ML achieving 1.72 bits/weight with near FP16 pe ...
LM Studio Announces Session References and Introspection in Bionic
LM Studio has announced ‘Introspection’ and ‘@’ mention features for Bionic, enabling agents ...
LocalAI v4.10.0 Released: Fleet Dashboard & M5 Support
LocalAI v4.10.0 is out, featuring a fleet management dashboard, Apple M5 startup crash fixes, credential file managem ...
Tencent Releases WeVisDoc-2B and WeVisDoc-4B Document Parsing Models
Tencent has released WeVisDoc-2B and WeVisDoc-4B, end-to-end document parsing models based on Qwen3-VL that extract s ...
Unsloth v0.1.810-beta Released with Multi-User and AMD Support
Unsloth v0.1.810-beta is out, adding multi-user accounts, Docker refreshes, AMD RDNA1/2 and Windows ARM64 support, an ...
GLM Announces Custom Inference Infrastructure and Local MoE Tests
GLM announces a new custom inference infrastructure built on Chinese accelerators, alongside community tests running ...