Engines and Tools

llama.cpp v0.9.0 Released: FP8 Quantization and More

llama.cpp v0.9.0 is released, featuring OCP FP8 E4M3 quantization support, KV cache improvements, multimodal updates, ...