MiniCPM-V-4.7-35B-A3B-DSpark-gguf Draft Model for Speedup: 4GB+ VRAM
A GGUF quantized version of MiniCPM-V-4.7-35B-A3B-DSpark has been released by OpenBMB for speculative decoding accele ...
News, quick references and our own measurements for open-weight models you can run locally
A GGUF quantized version of MiniCPM-V-4.7-35B-A3B-DSpark has been released by OpenBMB for speculative decoding accele ...