Engines and Tools

llama.cpp Speculative Decoding Test GGUF Models Released

ggml-org released ggml-org/spec-for-testing-GGUF featuring target and draft GGUF models for speculative decoding inte ...