llama-modchip v2.4.0 Released for CPU Inference of Large MoE
Version v2.4.0 of llama-modchip brings CPU inference for massive MoE models like DeepSeek-V4-Flash on 64GB RAM.
News, quick references and our own measurements for open-weight models you can run locally
Version v2.4.0 of llama-modchip brings CPU inference for massive MoE models like DeepSeek-V4-Flash on 64GB RAM.