Community

Breaking the 1.58-bit Barrier for Ternary LLMs with BITCOS

A research paper proposes BITCOS, achieving 1.485 bits/weight in ternary LLMs by exploiting weight distribution skew ...