litelm: Lightweight LLM Routing Library Released
Discover litelm, a lightweight LLM routing library extracting core routing and message format translation features fr ...
DeepSeek-V4-Pro-0813-nvfp4-DSpark: ~1005GB Memory
NVIDIA has released nvidia/DeepSeek-V4-Pro-0813-nvfp4-DSpark, a fully NVFP4-quantized MoE language model supporting S ...
vLLM v0.29.0 Released: Model Runner V2 Default and More
vLLM v0.29.0 is released with Model Runner V2 as default, FlashInfer all-reduce, new admission control flags, and sup ...
MiniCPM5-2B Text Generation Model: Our Test Answers, 4GB+ VRAM
OpenBMB has released MiniCPM5-2B, a 2B-class on-device model delivering SOTA performance in coding, math, long contex ...