4 October 2017 in Frontiers in Psychology
Facial expressions are of major importance in understanding the mental and emotional states of others. So far, most studies on the perception and comprehension of emotions have used isolated facial expressions as stimuli; for example, photographs of actors displaying facial expressions corresponding to one of the so called ‘basic emotions’. However, our real experience during social interactions is different: facial expressions of emotion are mostly perceived in a wider context, constituted by body language, the surrounding environment, and our beliefs and expectations. Already in the early twentieth century, the Russian filmmaker Lev Kuleshov argued that such context, established by intermediate shots of strong emotional content, could significantly change our interpretation of facial expressions in film. Prior experiments have shown behavioral effects pointing in this direction, but have only used static images as stimuli. Our study used a more ecological design with participants watching film sequences of neutral faces, crosscut with scenes of strong emotional content (evoking happiness or fear, plus neutral stimuli as a baseline condition). The task was to rate the emotion displayed by a target person’s face in terms of valence, arousal, and category. Results clearly demonstrated the presence of a significant effect in terms of both valence and arousal in the fear condition only. Moreover, participants tended to categorize the target person’s neutral facial expression choosing the emotion category congruent with the preceding context. Our results highlight the context-sensitivity of emotions and the importance of studying them under ecologically valid conditions.
2 March 2020 in Scientific Reports
MUMaria Alessandra Umiltà
Cardiac synchrony is a crucial component of shared experiences, considered as an objective measure of emotional processes accompanying empathic interactions. No study has investigated whether cardiac synchrony among people engaged in collective situations links to the individual emotional evaluation of the shared experience. We investigated theatrical live performances as collective experiences evoking strong emotional engagement in the audience. Cross Recurrence Quantification Analysis was applied to obtain the cardiac synchrony of twelve spectators’ quartets attending to two live acting performances. This physiological measure was then correlated with spectators’ emotional intensity ratings. Results showed an expected increment in synchrony among people belonging to the same quartet during both performances attendance and rest periods. Furthermore, participants’ cardiac synchrony was found to be correlated with audience’s convergence in the explicit emotional evaluation of the performances they attended to. These findings demonstrate that the mere co-presence of other people sharing a common experience is enough for cardiac synchrony to occur spontaneously and that it increases in function of a shared and coherent explicit emotional experience.
14 February 2019 in Scientific Reports
MUMaria Alessandra Umiltà
+1
Few studies have explored the specificities of contextual modulations of the processing of facial expressions at a neuronal level. This study fills this gap by employing an original paradigm, based on a version of the filmic “Kuleshov effect”. High-density EEG was recorded while participants watched film sequences consisting of three shots: the close-up of a target person’s neutral face (Face_1), the scene that the target person was looking at (happy, fearful, or neutral), and another close-up of the same target person’s neutral face (Face_2). The participants’ task was to rate both valence and arousal, and subsequently to categorize the target person’s emotional state. The results indicate that despite a significant behavioural ‘context’ effect, the electrophysiological indexes still indicate that the face is evaluated as neutral. Specifically, Face_2 elicited a high amplitude N170 when preceded by neutral contexts, and a high amplitude Late Positive Potential (LPP) when preceded by emotional contexts, thus showing sensitivity to the evaluative congruence (N170) and incongruence (LPP) between context and Face_2. The LPP activity was mainly underpinned by brain regions involved in facial expressions and emotion recognition processing. Our results shed new light on temporal and neural correlates of context-sensitivity in the interpretation of facial expressions.
13 March 2019 in PLOS ONE
MUMaria Alessandra Umiltà
+1
One key feature of film consists in its power to bodily engage the viewer. Previous research has suggested lens and camera movements to be among the most effective stylistic devices involved in such engagement. In an EEG experiment we assessed the role of such movements in modulating specific spectators´ neural and experiential responses, likely reflecting such engagement. We produced short video clips of an empty room with a still, a zooming and a moving camera (steadicam) that might simulate the movement of an observer in different ways. We found an event related desynchronization of the beta components of the rolandic mu rhythm that was stronger for the clips produced with steadicam than for those produced with a still or zooming camera. No equivalent modulation in the attention related occipital areas was found, thus confirming the sensorimotor nature of spectators´ neural responses to the film clips. The present study provides the first empirical evidence that filmic means such as camera movements alone can modulate spectators’ bodily engagement with film.
29 July 2014 in Scientific Reports
The temporal dynamics of brain activation during visual and auditory perception of congruent vs. incongruent musical video clips was investigated in 12 musicians from the Milan Conservatory of music and 12 controls. 368 videos of a clarinetist and a violinist playing the same score with their instruments were presented. The sounds were similar in pitch, intensity, rhythm and duration. To produce an audiovisual discrepancy, in half of the trials, the visual information was incongruent with the soundtrack in pitch. ERPs were recorded from 128 sites. Only in musicians for their own instruments was a N400-like negative deflection elicited due to the incongruent audiovisual information. SwLORETA applied to the N400 response identified the areas mediating multimodal motor processing: the prefrontal cortex, the right superior and middle temporal gyrus, the premotor cortex, the inferior frontal and inferior parietal areas, the EBA, somatosensory cortex, cerebellum and SMA. The data indicate the existence of audiomotor mirror neurons responding to incongruent visual and auditory information, thus suggesting that they may encode multimodal representations of musical gestures and sounds. These systems may underlie the ability to learn how to play a musical instrument.