llama.cpp Speculative Decoding Test GGUF Models Released
ggml-org released ggml-org/spec-for-testing-GGUF featuring target and draft GGUF models for speculative decoding inte ...
News, quick references and our own measurements for open-weight models you can run locally
ggml-org released ggml-org/spec-for-testing-GGUF featuring target and draft GGUF models for speculative decoding inte ...