๐Ÿ’ป
๐Ÿ’ป Technology

28.9M-parameter LLM runs on an $8 microcontroller

A developer has successfully run a 28.9 million parameter large language model on an ESP32 microcontroller costing just $8. The project demonstrates that local AI inference is possible on extremely cheap, low-power hardware. The source code has been published publicly on GitHub.

Comments

No comments yet