llama.cpp v0.9.0 Released: FP8 Quantization and More
llama.cpp v0.9.0 is released, featuring OCP FP8 E4M3 quantization support, KV cache improvements, multimodal updates, ...
News, quick references and our own measurements for open-weight models you can run locally
llama.cpp v0.9.0 is released, featuring OCP FP8 E4M3 quantization support, KV cache improvements, multimodal updates, ...