Play! Sequence is a multimedia installation for iPod Touch, USB camera, and VGA video display and TouchOSC, Max/MSP/Jitter, and Isadora software applications. By creating a multitouch sequencer that controls the playback of audio and video masks, Play! Sequence enables the user to simultaneously interact with the space’s sonic and visual environment.
The iPod Touch provides a familiar language for the user and for the nature of the tactile interactions. The user is allowed to create, edit, and delete three synchronous sequences of sixteen steps, thereby changing the evolution and the complexity of the piece over time.
Each of the three sequences represent a sonic timbre and color mask that mirror the user’s actions. With each sonic timbre, the user has control over pitch, rhythm, and amplitude. The color masks follow the sounds across the screen, repeating from the left upon the start of each loop. The masks help visualize the user’s tactile and sound experience by revealing the user inside the space, and each mask represents one of elements in the RGB color model.
Play! Sequence operates within the framework of natural human interaction, playing off of our curiosity and our engagement with objects that we can creatively control. The user manipulates and interacts with the sounds and visuals in real time, driven by the immediate feedback that the system provides.