vLLM v0.31.0 Released: Fast Restart and Hardware Optimization
vLLM v0.31.0 is released, featuring fast restart, DeepSeek optimizations, prefix cache security improvements, and bro ...
DeepSeek-V4-Pro-0813 Text Generation Model: ~998GB Memory, GGUF Builds
Discover DeepSeek-V4-Pro-0813, a 1.6T MoE model on Hugging Face featuring enhanced agent capabilities, 1M context, an ...
SGLang v0.5.20 Released: New Models and Optimizations
SGLang v0.5.20 is released with 713 PRs, adding support for new models, ROCm load time improvements, Intel XPU offici ...
ExLlamaV3 v1.4.9 Released: Faster CPU Offloading
ExLlamaV3 v1.4.9 is released with faster CPU offloading, Intel AVX512BW support, and new model architectures.
DeepSeek V4.1 Flash: Faster and Cheaper Than V4 Pro
DeepSeek plans to release V4.1 Flash, outperforming V4 Pro at a lower cost, sparking community debate on forced model ...