ExLlamaV3 1.4.8 Released: VRAM and FA2 Updates
ExLlamaV3 1.4.8 is released. Key updates include VRAM allocation optimization and the complete removal of Flash Atten ...
News, quick references and our own measurements for open-weight models you can run locally
ExLlamaV3 1.4.8 is released. Key updates include VRAM allocation optimization and the complete removal of Flash Atten ...