This paper describes a method to detect smiles and laughter sounds from the video of natural dialogue. A smile is the most common facial expression observed in a dialogue. Detecting a user's smiles and laughter sounds can be useful for estimating the mental state of the user of a spoken-dialogue-based user interface. In addition, detecting laughter sound can be utilized to prevent the speech recognizer from wrongly recognizing the laughter sound as meaningful words. In this paper, a method to detect smile expression and laughter sound robustly by combining an image-based facial expression recognition method and an audio-based laughter sound recognition method. The image-based method uses a feature vector based on feature point detection from face images. The method could detect smile faces by more than 80% recall and precision rate. A method to combine a GMM-based laughter sound recognizer and the image-based method could improve the accuracy of detection of laughter sounds compared with methods that use image or sound only. As a result, more than 70% recall and precision rate of laughter sound detection was obtained from the natural conversation videos
Human symbiosis service robots of various sizes have already been developed. However, few quantitative investigations have been made concerning the influence of the size of a robot on a userpsilas impression. We focused on the height of a robot (robot size), investigating the effect of robot size on the anxiety or threat felt by a human to be caused by a robot and the appropriate human-robot distance. We prepared three mobile robots that were 0.6 m, 1.2 m and 1.8 m tall. One of these robots approached a male subject from a distance of 3 m, at a maximum speed of 0.4 m/s, and the subject stopped the robot using a switch when he began to feel anxious. We measured the distance between the human and the robot when the subject stopped the robot. Then, we asked the subject to complete a questionnaire to evaluate differences in anxiety levels caused by robots of different sizes. As a result of the experiment based on 19 subjects, we were able to observe a tendency for the human-robot distance to increase along with the size of the robot. From the questionnaires, we found that the subjects felt most anxious with the 1.8-m-tall robots, but that some subjects also experienced anxiety with the 0.6-m-tall robots. Considering both the experimental results and the questionnaires, we conclude that 1.2 m is better than other two sizes.
1 January 1999 in Acoustical Science and Technology
Discriminative training has received a lot of attention from both the machine learning and speech recognition communities. The idea behind the discriminative approach is to construct a model that distinguishes correct samples from incorrect samples, while the conventional generative approach estimates the distributions of correct samples. We propose a novel discriminative training method and apply it to a language model for reranking speech recognition hypotheses. Our proposed method has round-robin duel discrimination (R2D2) criteria in which all the pairs of sentence hypotheses including pairs of incorrect sentences are distinguished from each other, taking their error rate into account. Since the objective function is convex, the global optimum can be found through a normal parameter estimation method such as the quasi-Newton method. Furthermore, the proposed method is an expansion of the global conditional log-linear model whose objective function corresponds to the conditional random fields. Our experimental results show that R2D2 outperforms conventional methods in many situations, including different languages, different feature constructions and different difficulties.