New Models

EleutherAI Releases Bergson Leaderboard Baseline GPT-2 Model

EleutherAI has released the baseline model EleutherAI/bergson-wikitext-gpt2-leaderboard for the training data attribu ...

Image, Video and Audio

yue2-mothersuperior-realaudio-tokenizer-v4: 12GB+ VRAM, File List

Mothersuperior has released a real audio toolkit for the open music generation model YuE2-3B, enabling tokenization a ...

Community

Challenges of Migrating Large Prompts to Local Ollama

Discussing the technical hurdles, context thrashing, and prompt design issues when moving large agents from commercia ...

Engines and Tools

llama.cpp v0.4.1 Released with New Models and Load Modes

llama.cpp v0.4.1 is released, featuring important argument cleanups, new model architectures, and stability improveme ...

Engines and Tools

ggml v0.24.0 Released with Backend Improvements and API Updates

ggml v0.24.0 is out, featuring a new precision control API, major backend improvements for Vulkan, SYCL, and Metal, a ...

New Models

TheDrummer_Orion-26B-A4B-v1.1-GGUF Multimodal Model: 12GB+ VRAM

Explore bartowski’s GGUF quantizations for Orion-26B-A4B-v1.1, featuring multimodal support, performance tables ...

New Models

Simple-Attention-Sparsification Text Generation Model: 12GB+ VRAM

Tencent has released Simple Attention Sparsification (SAS) checkpoints for Qwen3 models, enabling efficient context p ...

Engines and Tools

ExLlamaV3 v1.5.0 Released for Local LLM Inference

ExLlamaV3 1.5.0 is released, bringing massive MoE inference speedups, experimental Linux CPU offloading, and Nemotron ...

Image, Video and Audio

YuE2: 12GB+ VRAM, ComfyUI Paths

Comfy-Org has released Comfy-Org/YuE2, packaging the open-weight music generation model YuE2-3B for local execution v ...

Engines and Tools

litelm: Lightweight LLM Routing and Message Conversion Library

Discover litelm, a lightweight LLM routing library extracting core routing and message format translation features fr ...