MUSICAL/DEVICES - 2001

Musical collaboration through any phone.

Exhibitions:
Featured on Soundtoys.net, 2001.
Cybersonica Festival, June 4-6 2002, ICA, London, UK.

Overview
Musical/Devices allows you to collaborate in a musical composition with other people using any telephone. The project allows for multiple users to participate in one experience through a mobile device.

Prototype
Users call up and connect to the program and can select a high or low pitch note. Once they choose a tone, the tone is released into the main screen and when the bouncing ball collides with it, it produces the appropriate high or low pitch sound.

System
The system uses VoiceXML (a subset of XML) through TellMe and speech recognition to decipher user input in the form of voice or DTMF tones. Once the user connects, they are prompted to say "high" to generate a high pitch sound or to say "low" to generate a low pitch sound. Once the VXML gets an answer it recognizes it writes to a cgi script and relays that message to the movie.

Close up of the Musical/Devices playing field: