Tele-media-art is a web-based asynchronous e-learning platform, enabling blind students to have dance and theatre classes remotely, using low-cost motion tracking technology feasible for home use. Teachers and students submit dance recordings augmented with sound synthesis of their motions. Sound synthesis is generated by processing Kinect motion capture data, enabling blind students to compare the audio feedback of their motions with the audio generated by the teacher's motions. To study the feasibility of this approach, the authors present data on early testing of the prototype, performed with blindfolded users.
The use of cutting-edge technologies such as wearable devices to control reactive audiovisual systems are rarely applied in more conventional stage performances, such as opera performances. This work reports a cross-disciplinary approach for the research and development of the WMTSensorGlove, a data-glove used in an opera performance to control audiovisual elements on stage through gestural movements. A system architecture of the interaction between the wireless wearable device and the different audiovisual systems is presented, taking advantage of the Open Sound Control (OSC) protocol. The developed wearable system was used as audiovisual controller in “As sete mulheres de Jeremias Epicentro”, a portuguese opera by Quarteto Contratempus, which was premiered in September 2017.
1 October 2012 in Ubiquity: The Journal of Pervasive Media