Meet Bonsai: The First 27B AI Model That Fits on Your Phone - Decrypt

Meet Bonsai: The First 27B AI Model That Fits on Your Phone I models eat up a lot of memory. A 27-billion-parameter AI model, considered medium-sized by industry standards, needs roughly 54 GB of memory to run on half...