ExLlamaV3 v1.4.9 Released: Faster CPU Offloading
ExLlamaV3 v1.4.9 is released with faster CPU offloading, Intel AVX512BW support, and new model architectures.
News on open-weight models you can run locally
ExLlamaV3 v1.4.9 is released with faster CPU offloading, Intel AVX512BW support, and new model architectures.