Weekly Roundup

Local AI Model Weekly Highlights: Structured Output & Video LoRAs

Weekly roundup of local generative AI models: structured output models, video generation LoRAs, inference engines, an ...

Engines and Tools

Ollama v0.35.0 Released with New Decision Models Feature

Ollama v0.35.0 is released with a new/v1/systemone API for decision models, supporting nimble and tev1 models for fas ...

Engines and Tools

Open WebUI v0.11.4 Released: Dramatic Docker Image Slimming

Open WebUI v0.11.4 is released with a dramatic reduction in Docker image size, terminal skill integration, and perfor ...

Community

Challenges of Migrating Large Prompts to Local Ollama

Discussing the technical hurdles, context thrashing, and prompt design issues when moving large agents from commercia ...

Engines and Tools

litelm: Lightweight LLM Routing and Message Conversion Library

Discover litelm, a lightweight LLM routing library extracting core routing and message format translation features fr ...