SGLang v0.5.20 Released: New Models and Optimizations
SGLang v0.5.20 is released with 713 PRs, adding support for new models, ROCm load time improvements, Intel XPU offici ...
Tencent Releases Simple Attention Sparsification for Qwen3
Tencent has released Simple Attention Sparsification (SAS) checkpoints for Qwen3 models, enabling efficient context p ...
Nex-AGI Releases Agent Model Nex-N2.5-Pro
Nex-AGI announces the Nex-N2.5 agent model family. Weights for mini, Pro, and Max are available on Hugging Face, with ...
OpenBMB Releases MiniCPM5-2B: A SOTA 2B On-Device Model
OpenBMB has released MiniCPM5-2B, a 2B-class on-device model delivering SOTA performance in coding, math, long contex ...
Inference Engine Updates and Practical GGUF Models Like Qwopus
Explore the latest local AI trends, including inference engine updates like ggml v0.23.0 and ExLlamaV3, and GGUF rele ...