vLLM v0.31.0 Released: Fast Restart and Hardware Optimization
vLLM v0.31.0 is released, featuring fast restart, DeepSeek optimizations, prefix cache security improvements, and bro ...
K2-Horizon-32B-NVFP4: Our Test Answers, 32GB+ VRAM
IFM releases K2-Horizon-32B-NVFP4, an NVFP4 quantized version of the 32B long-context open-weight LLM optimized for N ...