GLM Announces Custom Inference Infrastructure and Local MoE Tests
GLM announces a new custom inference infrastructure built on Chinese accelerators, alongside community tests running ...
ExLlamaV3 v1.4.9 Released: Faster CPU Offloading
ExLlamaV3 v1.4.9 is released with faster CPU offloading, Intel AVX512BW support, and new model architectures.