The LuMIDI is an audio-visual instrument that transforms movement into reactive sound and illuminated visuals. This project explores the relationship our bodies share with technology, data, and performance. 

Inspired by gesture-based instruments like the theremin, the LuMIDI system is a modular controller that converts physical movement into MIDI information and serial data. The sensors send this data through an Arduino Leonardo, where it is processed. TF Luna laser distance sensors are the magic behind the LuMIDI. The height data from these sensors is read from the user's hand. Additional knobs and buttons on the instrument face can also influence the sound and projection generated in real time. Creating a responsive environment where light and sound integrate with the performer's gesture.

The Arduino converts the sensor information to MIDI and serial, used to manipulate audio in Ableton Live while simultaneously generating reactive visuals in TouchDesigner. User data and distance information evolve as the performer moves, allowing the body's movement to compose an ever-changing audiovisual experience.

The instrument is designed to house the electronics with a fully transparent acrylic structure, designed with AutoCAD modeling software and fabricated through CNC milling. The clear casing exposes the circuitry and pathways of data, emphasizing craftsmanship and the technological process behind the interaction. A detachable sheer projection screen allows for flexibility and modular setup options while preserving the view between performer, interaction, and audience. Allowing the generated visuals and sounds to meet the performer in the interaction, seamlessly merging with their movement paths.