๐Ÿ’ป
๐Ÿ’ป Technology

Goku: browser-based LLM inference and model manager via WebAssembly

Goku is a browser-based tool that runs large language model inference entirely client-side using WebAssembly and the wllama library. It also includes a built-in model manager. A live demo is available online.

Comments

No comments yet