Autism Spectrum Disorders (ASD) are characterized by atypical patterns of behaviors and impairments in social communication. Among the fundamental social impairments in the ASD population are challenges in appropriately recognizing and responding to facial expressions. Traditional intervention approaches often require intensive support and well-trained therapists to address core deficits, with many with ASD having tremendous difficulty accessing such care due to lack of available trained therapists as well as intervention costs. As a result, emerging technology such as virtual reality (VR) has the potential to offer useful technology-enabled intervention systems. In this paper, an innovative VR-based facial emotional expression presentation system was developed that allows monitoring of eye gaze and physiological signals related to emotion identification to explore new efficient therapeutic paradigms. A usability study of this new system involving ten adolescents with ASD and ten typically developing adolescents as a control group was performed. The eye tracking and physiological data were analyzed to determine intragroup and intergroup variations of gaze and physiological patterns. Performance data, eye tracking indices and physiological features indicated that there were differences in the way adolescents with ASD process and recognize emotional faces compared to their typically developing peers. These results will be used in the future for an online adaptive VR-based multimodal social interaction system to improve emotion recognition abilities of individuals with ASD.
3 September 2015 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Autism spectrum disorder (ASD) impacts 1 in 68 children in the U.S., with tremendous individual and societal costs. Technology-aided intervention, more specifically robotic intervention, has gained momentum in recent years due to the inherent affinity of many children with ASD towards technology. In this paper we present a novel robot-mediated intervention system for imitation skill learning, which is considered a core deficit area for children with ASD. The Robot-mediated Imitation Skill Training Architecture (RISTA) is designed in such a manner that it can operate either completely autonomously or in coordination with a human therapist depending on the intervention need. Experimental results are presented from small user studies validating system functionality, assessing user tolerance, and documenting subject performance. Preliminary results show that this novel robotic system draws more attention from the children with ASD and teaches gestures more effectively as compared to a human therapist. While no broad generalized conclusions can be made about the effectiveness of RISTA based on our small user studies, initial results are encouraging and justify further exploration in the future.
14 January 2014 in Journal of Autism and Developmental Disorders
The aging population with its concomitant medical conditions, physical and cognitive impairments, at a time of strained resources, establishes the urgent need to explore advanced technologies that may enhance function and quality of life. Recently, robotic technology, especially socially assistive robotics has been investigated to address the physical, cognitive, and social needs of older adults. Most system to date have predominantly focused on one-on-one human robot interaction (HRI). In this paper, we present a multi-user engagement-based robotic coach system architecture (ROCARE). ROCARE is capable of administering both one-on-one and multi-user HRI, providing implicit and explicit channels of communication, and individualized activity management for long-term engagement. Two preliminary feasibility studies, a one-on-one interaction and a triadic interaction with two humans and a robot, were conducted and the results indicated potential usefulness and acceptance by older adults, with and without cognitive impairment.
15 April 2010 in IEEE Computational Intelligence Magazine
In order to solve the image segmentation problem which assigns a label to every pixel in an image such that pixels with the same label share certain visual characteristics more effectively, a novel approach based on memetic algorithm (MISA) is proposed. Watershed segmentation is applied to segment original images into non-overlap small regions before performing the portioning process by MISA. MISA adopts a straightforward representation method to find the optimal combination of watershed regions under the criteria of interclass variance in feature space. After implementing cluster-based crossover and mutation, an individual learning procedure moves exocentric regions in current cluster to the one they should belong to according to the distance between these regions and cluster centers in feature space. In order to evaluate the new algorithm, six texture images, three remote sensing images and three natural images are employed in experiments. The experimental results show that MISA outperforms its genetic version, the Fuzzy c-means algorithm, and K-means algorithm in partitioning most of the test problems, and is an effective approach when compared with two state-ofthe-art image segmentation algorithms including an efficient graph-based algorithm and a spectral clustering ensemble-based algorithm.