Engines and Tools

vLLM v0.30.0 Released: Fast Start Weight Caching and New Models

vLLM v0.30.0 is released, featuring Fast Start weight caching, engine initialization speedups, DeepSeek-V4.1-Flash su ...

Engines and Tools

Open WebUI v0.11.4 Released: Dramatic Docker Image Slimming

Open WebUI v0.11.4 is released with a dramatic reduction in Docker image size, terminal skill integration, and perfor ...

Technical Reports

litelm: Lightweight LLM Routing and Message Conversion Library

Discover litelm, a lightweight LLM routing library extracting core routing and message format translation features fr ...