Petals lets you run large language models at home BitTorrent-style

Petals is a project that allows users to run large language models on home hardware by distributing computation across multiple machines, in a manner similar to BitTorrent file sharing. This approach makes advanced AI models accessible to people without high-end servers. The project lowers the barrier to running LLMs locally and privately.