Gaze direction cues and facial expressions have been shown to influence object processing in infants. For example, infants around 12 months of age utilize others' gaze directions and facial expressions to regulate their own behaviour toward an ambiguous target (i.e., social referencing). However, the mechanism by which social signals influence overt orienting in infants is unclear. The present study examined the effects of static gaze direction cues and facial expressions (neutral vs. fearful) on overt orienting using a gaze-cueing paradigm in 6- and 12-month-old infants. Two experiments were conducted: in Experiment 1, a face with a leftward or rightward gaze direction was used as a cue, and a face with a forward gaze direction was added in Experiment 2. In both experiments, an effect of facial expression was found in 12-month-olds; no effect was found in 6-month-olds. Twelve-month-old infants exhibited more rapid overt orienting in response to fearful expressions than neutral expressions, irrespective of gaze direction. These findings suggest that gaze direction information and facial expressions independently influence overt orienting in infants, and the effect of facial expression emerges earlier than that of static gaze direction. Implications for the development of gaze direction and facial expression processing systems are discussed.
Recent neurophysiological studies have shown that several human brain regions involved in executing actions are activated by merely observing such actions via a human, and not by a mechanical hand. At a behavioral level, observing a human’s movements, but not those of a robot, significantly interferes with ongoing executed movements. However, it is unclear whether the biological tuning in the observation/execution matching system are functional during infancy. The present study examines whether a human’s actions, and not a mechanical action, influence infants’ execution of the same actions due to the observation/execution matching system. Twelve-month-old infants were given a searching task. In the tasks, infants observed an object hidden at location A, after which either a human hand (human condition) or a mechanical one (mechanical condition) searched the object correctly. Next, the object was hidden at location B and infants were allowed to search the object. We examined whether infants searched the object at location B correctly. The results revealed that infants in the human condition were more likely to search location A than those in the mechanical condition. Moreover, the results suggested that infants’ searching behaviors were affected by their observations of the same actions by a human, but not a mechanical hand. Thus, it may be concluded that the observation/execution matching system may be biologically tuned during infancy.
22 May 2025 in International Journal of Social Robotics
Given their embodied social nature, robots have the potential to facilitate educational processes. As childhood is an opportune age to introduce a new language, robots could be particularly useful in the area of second language (L2) learning for children. This study assessed whether a social robot could provide efficient teaching to young children and how social cues of joint attention (pointing and gazing) can influence L2 learning. 82 children participated in an experiment with the Nao robot telling a story in French, adding -or not- joint attention gestures to the story (interactive versus non interactive robot). During the storytelling, target-words were frequently repeated by the robot and were then used to evaluate children’s learning through a preferential looking procedure (PLP) with an eye-tracking system, thus providing a quantitative measurement of learning. To our knowledge, no other study has combined a storytelling task with eye-tracking to quantify learning gains. Both behavioral and gaze data indicated that children are able to learn the vocabulary provided during storytelling by the two types of robots, although there is an advantage for the interactive robot that triggered more significant learning results (particularly for gaze data that is a more reliable measure than pointing). Our findings suggest that social robots can be used effectively as teachers for L2 learning, but also that learning can be influenced positively by their social nature and behaviors. Indeed, providing explicit social signals in a timely manner, such as joint attention markers, seems to be particularly important for more efficient learning.
It has been shown that an averted gaze with emotional expression guides our attention toward a gazed-at location, and the effect of a gaze with fearful expression has been well-investigated. However, the findings are not consistent, and most studies used the manual response measure. Recent studies suggest that examining eye movements is more suitable to capture the early stage of the effect of threat-related stimuli on attentional process. Therefore, in the present study, we investigated the effects of static neutral and fearful gaze on overt attention orienting by examining the saccadic responses in an unselected sample of people. Our results found the gaze congruency effects for both expressions, and importantly, enhanced attention orienting by fearful gaze at a short stimulus onset asynchrony (SOA): participants looked faster at the fearful gaze-cued target than the neutral gaze-cued one at the 300 ms SOA. These findings provide the first evidence that fearful averted gaze elicits rapid overt attention orienting toward the target, and suggest that the information of gaze direction and emotional expression are rapidly integrated and modulate the oculomotor system.
This study examines the feasibility of using event-related potentials (ERPs) obtained from electroencephalographic (EEG) recordings as biomarkers for long-term memory item classification. Previous studies have identified old/new effects in memory paradigms associated with explicit long-term memory and familiarity. Recent advancements in convolutional neural networks (CNNs) have enabled the classification of ERP trials under different conditions and the identification of features related to neural processes at the single-trial level. We employed this approach to compare three CNN models with distinct architectures using experimental data. Participants (N = 25) performed an association memory task while recording ERPs that were used for training and validation of the CNN models. The EEGNET-based model achieved the most reliable performance in terms of precision, recall, and specificity compared with the shallow and deep convolutional approaches. The classification accuracy of this model reached 62% for known items and 66% for unknown items. Good overall accuracy requires a trade-off between recall and specificity and depends on the architecture of the model and the dataset size. These results suggest the possibility of integrating ERP and CNN into online learning tools and identifying the underlying processes related to long-term memorization.
Infants use information on gaze direction and facial expressions for social referencing when encountering various objects in their environment. However, it remains unclear how these social cues influence attentional orienting in infants. Using event-related potentials (ERPs), we investigated the neural correlates of attentional orienting cued by an averted gaze with neutral and fearful expressions in 12-month-olds. We focused on the ERPs in response to a face (N290, P400, and Nc) as well as a saccade toward the target (the presaccadic spike potential: SP) and found that the amplitudes of the face-sensitive ERPs (N290 and P400) were larger for directed than averted gaze direction irrespective of facial expression. Furthermore, the amplitude of the SP involved in overt orienting was larger for fearful expressions than for neutral expressions, irrespective of gaze congruency. These results suggest that information on gaze direction and facial expression, specifically neutral and fearful expressions, may be processed independently, and that fearful expressions dominantly influence the neural correlates of attentional orienting in infants around 12 months of age.