Synthetic Overgrowth
I worked with Left/Right on an 8-foot plant wall, integrating hand tracking in TouchDesigner. Gestures control the projection, creating an immersive audio-visual experience.
November 15, 2024
installationprojection mappingcomputer vision
I collaborated with music producer and visual artist Left/Right (@leftrightmusic) on an 8-foot-long interactive plastic plant wall installation, contributing to hand tracking and TouchDesigner implementation. We created a mapped projection that responds to hand movements, giving participants the feeling of controlling the visuals with their gestures. Each animation, paired with music, allows participants to shape sounds and visuals for an engaging, dynamic experience.
As you move your hand, the light projected onto the sculpture follows your gestures. The sound environment responds to them as well, with different sound designs responding in different ways.
We were able to get this done pretty quickly after discovering Torin Blankensmith's MediaPipe tox and examples. What a useful tool! After getting that set up, we set up some data manipulation and an OSC output, then used the OSC to control MadMapper (for the interactive visuals) and Ableton (for the interactive sound).
As you move your hand, the light projected onto the sculpture follows your gestures. The sound environment responds to them as well, with different sound designs responding in different ways.
We were able to get this done pretty quickly after discovering Torin Blankensmith's MediaPipe tox and examples. What a useful tool! After getting that set up, we set up some data manipulation and an OSC output, then used the OSC to control MadMapper (for the interactive visuals) and Ableton (for the interactive sound).