How it works
Mel is a fruit fly that lives on a tiny screen. It breathes, grooms, leans when you tilt the board, flies when you turn or shake it, and lands when it is still.
A program on my laptop listens to music, remembers songs and uses a fruit fly brain model to decide how Mel should feel. It sends a face and two lines of text to the board over WiFi.
The board is a borrowed ESP32-S3 handheld with a small screen and an accelerometer. The drawing code is my own and runs at 30 frames per second with no framebuffer.
I built it at Fruit Flyathon at the Devfolio office. The brief was to make something fun, useful or a simulation with Google's fruit fly research.
Stack
ESP32-S3 / Arduino C++ / LIS2DH12 accelerometer / WiFi / Python / WebSocket / Fruit fly connectome data / Audio fingerprinting
