For a Digital Performing Agent to be able to perform live with a human dancer, it would be useful for the agent to be able to contextualize the movement the dancer is performing and to have a suitable movement vocabulary with which to contribute to the performance. In this paper we will discuss our research into the use of Artificial Neural Networks (ANN) as a means of allowing a software agent to learn a shared vocabulary of movement from a dancer. The agent is able to use the learnt movements to form an internal representation of what the dancer is performing, allowing it to follow the dancer, generate movement sequences based on the dancer's current movement and dance independently of the dancer using a shared movement vocabulary. By combining the ANN with a Hidden Markov Model (HMM) the agent is able to recognize short full body movement phrases and respond when the dancer performs these phrases. We consider the relationship between the dancer and agent as a means of supporting the agent's learning and performance, rather than developing the agent's capability in a self-contained fashion
In this paper we propose a framework for communicating performance art to deaf, blind and deaf blind audiences and artists haptically through the sense of touch. This research opens doors for novel artistic trends relying mainly on the sense of touch. The paper investigates the design considerations dictated by solo and group dances as well as stage setup. Implementation scenarios for deaf blind audiences and performers are also discussed.
This paper describes a system for delivering movement information from a dance performance using a multisensory approach that includes visual, sonic and haptic information. The work builds on previous research into interpreting dance as haptic information for blind, deaf-blind and vision-impaired audience members. This current work is aimed at a general audience, with haptic information being one of a number of sensory experiences of the dance. A prototype haptic device has been developed for use in dance performance research.
Virtual and augmented environments are often dependent on human intervention for change to occur. However there are times when it would be advantageous for appropriate human-like activity to still occur when there are no humans present. In this paper, we describe the installation art piece Recognition, which uses the movement of human participants to effect change, and the movement of a performing agent when there are no humans present. The agent\u27s Artificial Neural Network has learnt appropriate movements from a dancer and is able to generate suitable movement for the main avatar in the absence of human participants