General

AI developer runs 28.9-million-parameter model on $10 ESP32-S3 microcontroller — uses Google's Per-Layer Embeddings technique, stores table on 16MB Flash memory

Getting a local language model running on a sub-$10 microcontroller is impressive despite its obvious limitations.

Quelle: Originalartikel öffnen

AI Assistant
Context loaded: AI developer runs 28.9-million-parameter model on $10 ESP32-