量子化 | Local Model Watch

ExLlamaV3 v1.4.9 Released: Faster CPU Offloading

September 10, 2026Engines and Tools

ExLlamaV3 v1.4.9 Released: New Models & CPU Offload

October 31, 2026

ExLlamaV3 v1.4.9 is released with faster CPU offloading, Intel AVX512BW support, and new model architectures.

About Local Model Watch

Local Model Watch is a reference site, in English and Japanese, for open-weight generative models (text, image, video and audio) you can run on your own hardware: articles on new releases, hub pages, and measurements we take by running models on our own server. Memory requirements in every article are computed by this site from the actual distributed file sizes.

Start here