Engines and Tools

GLM Announces Custom Inference Infrastructure and Local MoE Tests

GLM announces a new custom inference infrastructure built on Chinese accelerators, alongside community tests running ...

Engines and Tools

ExLlamaV3 v1.4.9 Released: New Models & CPU Offload

ExLlamaV3 v1.4.9 is released with faster CPU offloading, Intel AVX512BW support, and new model architectures.