vLLM v0.30.0 Released: Fast Start Weight Caching and New Models
vLLM v0.30.0 is released, featuring Fast Start weight caching, engine initialization speedups, DeepSeek-V4.1-Flash su ...
MiMo-V2.6-Distill-Qwen-9B-GGUF: Our Test Answers, 12GB+ VRAM
Download the GGUF version of MiMo-V2.6-Distill-Qwen-9B, a 9.4B agentic model for coding and cybersecurity.
Open WebUI v0.11.4 Released: Dramatic Docker Image Slimming
Open WebUI v0.11.4 is released with a dramatic reduction in Docker image size, terminal skill integration, and perfor ...
Mini-AGI: A Byte-Level Continual Learning Model for 8GB VRAM
Discover mini-AGI, an experimental byte-level language model designed to run on an 8GB VRAM GPU with continuous learn ...
Kev: Lightweight Local Decision-Making Model Based on Qwen3.5
Explore Kev, a lightweight local decision-making model family built on Qwen3.5, its community reception, use cases, a ...
Open-Weight Model Weekly: Ternary 27B Models and Apple Silicon Updates
Weekly roundup of open-weight generative models: ternary quantization for 27B models, Apple Silicon optimizations, an ...
Hacker News Discussion on Open-Weight Qwen-Image-2.1
Explore the Hacker News discussion on Qwen-Image-2.1, covering its 7B size, text rendering, transparency, and licensi ...
Qwen-Image-2.1 Released: Open-Weight Image Gen & Editing
Explore Qwen-Image-2.1, an open-weight model integrating text-to-image and image editing, with dedicated prompt rewri ...
Inco AI Releases Splash Engine for Fast Local LLMs on Mac
Inco AI releases Splash Engine, an open-source local LLM inference engine optimized for Apple Silicon, natively integ ...
Realtime-Venus Full-Duplex Audio-Video Dialog Model: 24GB+ VRAM
Explore Realtime-Venus, a multimodal conversational system featuring asynchronous delegation and active full-duplex d ...