Bonsai 27B: first 27B-parameter 1-bit LLM designed to run on a phone

PrismML has unveiled Bonsai 27B, the first 27-billion-parameter large language model using 1-bit quantization that is designed to run directly on a smartphone. The extreme compression of model weights dramatically reduces hardware requirements while maintaining the scale of a large model. This represents a potential breakthrough for running advanced AI locally on mobile devices.