Neuroscientific investigations regarding aspects of emotional experiences usually focus on one stimulus modality (e.g., pictorial or verbal). Similarities and differences in the processing between the different modalities have rarely been studied directly. The comparison of verbal and pictorial emotional stimuli often reveals a processing advantage of emotional pictures in terms of larger or more pronounced emotion effects evoked by pictorial stimuli. In this study, we examined whether this picture advantage refers to general processing differences or whether it might partly be attributed to differences in visual complexity between pictures and words. We first developed a new stimulus database comprising valence and arousal ratings for more than 200 concrete objects representable in different modalities including different levels of complexity: words, phrases, pictograms, and photographs. Using fMRI we then studied the neural correlates of the processing of these emotional stimuli in a valence judgment task, in which the stimulus material was controlled for differences in emotional arousal. No superiority for the pictorial stimuli was found in terms of emotional information processing with differences between modalities being revealed mainly in perceptual processing regions. While visual complexity might partly account for previously found differences in emotional stimulus processing, the main existing processing differences are probably due to enhanced processing in modality specific perceptual regions. We would suggest that both pictures and words elicit emotional responses with no general superiority for either stimulus modality, while emotional responses to pictures are modulated by perceptual stimulus features, such as picture complexity.
This study investigates the neuronal correlates of empathic processing in children aged 4–8 years, an age range discussed to be crucial for the development of empathy. Empathy, defined as the ability to understand and share another person's inner life, consists of two components: affective (emotion-sharing) and cognitive empathy (Theory of Mind). We examined the hemodynamic responses of preschool and school children (N = 48), while they processed verbal (auditory) and non-verbal (cartoons) empathy stories in a passive following paradigm, using functional Near-Infrared Spectroscopy. To control for the two types of empathy, children were presented blocks of stories eliciting either affective or cognitive empathy, or neutral scenes which relied on the understanding of physical causalities. By contrasting the activations of the younger and older children, we expected to observe developmental changes in brain activations when children process stories eliciting empathy in either stimulus modality toward a greater involvement of anterior frontal brain regions. Our results indicate that children's processing of stories eliciting affective and cognitive empathy is associated with medial and bilateral orbitofrontal cortex (OFC) activation. In contrast to what is known from studies using adult participants, no additional recruitment of posterior brain regions was observed, often associated with the processing of stories eliciting empathy. Developmental changes were found only for stories eliciting affective empathy with increased activation, in older children, in medial OFC, left inferior frontal gyrus, and the left dorsolateral prefrontal cortex. Activations for the two modalities differ only little, with non-verbal presentation of the stimuli having a greater impact on empathy processing in children, showing more similarities to adult processing than the verbal one. This might be caused by the fact that non-verbal processing develops earlier in life and is more familiar.