Magnitude v0.2.16 Released: Faster Parallel Requests and Docker
Magnitude v0.2.16 is out with major speedups for shared prompt prefixes, official Docker support, and new GGUF quanti ...
News, quick references and our own measurements for open-weight models you can run locally
Magnitude v0.2.16 is out with major speedups for shared prompt prefixes, official Docker support, and new GGUF quanti ...