Engines and Tools

ExLlamaV3 v1.4.9 Released: New Models & CPU Offload

ExLlamaV3 v1.4.9 is released with faster CPU offloading, Intel AVX512BW support, and new model architectures.