Running a 28.9M parameter LLM on an $8 microcontroller Slava S. on GitHub has a 28.9 million parameter language model that generates text on an ESP32-S3, a microcontroller that costs about $8. It runs on the chip itself, with nothing sent to a server, and it writes each word to a small screen wired to the chip at roughly 9 tokens per second.
$8 $8.
Medical Disclaimer: This article is for informational purposes only and does not constitute medical advice. Always consult with qualified healthcare professionals for medical decisions and treatment options.
Discover more from ChuckysCarnage
Subscribe to get the latest posts sent to your email.
ChuckysCarnage 