New Models

OpenJev-GGUF 27.4B Decision-Making Specialized Model: 24GB+ VRAM

Explore OpenJev-GGUF, a GGUF quantized open-weight decision-making model by ggml-org designed for structured choices ...

Engines and Tools

Testing OpenJev GGUF: A Tiny Model for Runtime Loaders

Explore tinyopenjev-for-testing-gguf, a miniature GGUF model by ggml-org designed for testing loader and runtime beha ...

Engines and Tools

Unsloth v0.1.901-beta Released: Major LoRA Memory Reductions

Unsloth v0.1.901-beta is released, featuring massive LoRA memory reductions for 4-bit checkpoints, a desktop command ...

New Models

Xing4.0-29B-A4B Text Generation Model: Our Test Answers, 24GB+ VRAM

China Telecom’s Xing4.0-29B-A4B is a 29B MoE model trained exclusively on Huawei Ascend NPUs, featuring strong ...

Weekly Roundup

Open-Weight Models Weekly: The MiMo-V2.6 Family & Transformers GGUF Support

Weekly roundup of open-weight generative models. Highlights include Qwen3.8-27B, native GGUF support in Transformers, ...

Engines and Tools

KoboldCpp v1.122 Released with Built-in Agentic Framework

KoboldCpp v1.122 is released, featuring the new KoboldCpp Agent, ubatchsize controls, and upstream fixes from llama.c ...

Engines and Tools

RamaLama v0.25.0 Released: Security and Engine Updates

RamaLama v0.25.0 is out, featuring secure default bindings, llama.cpp v0.4.1 update, Vulkan support for NVIDIA, and W ...

Engines and Tools

ggml v0.25.2 Released with Hardware Backend Optimizations

ggml v0.25.2 has been released, focusing on improvements to hardware backends including CUDA, Vulkan, OpenCL, and Hex ...

Engines and Tools

llama.cpp v0.5.0 Released with Backend and Server Upgrades

llama.cpp v0.5.0 is released, featuring CUDA/Metal hardware acceleration, multi-address server support, and new model ...

Engines and Tools

ggml v0.25.0 Released: FlashAttention and MoE Optimizations

ggml v0.25.0 is now available, featuring expanded FlashAttention support, MoE and SSM optimizations, and new hardware ...