Meta's Muse Glimmer is a 30bn-parameter AI model that runs locally on your PC

Full text

TL;DR

Meta’s Muse Glimmer is a 30-billion-parameter AI model designed to run locally on a Mac or PC.

It focuses on agentic AI, with the ability to code, use tools, handle multi-step tasks, and recover from errors.

The model is available now on Hugging Face, with support for popular local AI tools coming soon.

Most modern, capable AI models rely on cloud computing to give you fast and reliable responses — your prompt and associated data has to leave your device, head to a server, get processed by the model in use, and then make its way back to you as a response. But we’ve also seen models taking an on-device approach, one that minimizes concerns related to cloud-based AI, but at the same time introducing their own limitations. A new model from Meta takes the latter approach, and it does so in a way that tackles some of on-device AI’s main constraints head on.

With cloud-based AI, one of the biggest limitations is that models cannot run without an active internet connection. Models like Meta’s new Muse Glimmer that run totally on-device don’t face this limitation.