Christine Nussbaum

Dr. Christine Nussbaum

orcid

Research Focus & Metrics

Academic Career Length

24Years (2003-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 May 2022 in Social Cognitive and Affective Neuroscience
Verified
Journal Article
Open access
PDF file
CNChristine Nussbaum
Christine Nussbaum
ASAnnett Schirmer
Annett Schirmer
SSStefan Robert Schweinberger
Stefan Robert Schweinberger
Our ability to infer a speaker’s emotional state depends on the processing of acoustic parameters such as fundamental frequency (F0) and timbre. Yet, how these parameters are processed and integrated to inform emotion perception remains largely unknown. Here we pursued this issue using a novel parameter-specific voice morphing technique to create stimuli with emotion modulations in only F0 or only timbre. We used these stimuli together with fully modulated vocal stimuli in an event-related potential (ERP) study in which participants listened to and identified stimulus emotion. ERPs (P200 and N400) and behavioral data converged in showing that both F0 and timbre support emotion processing but do so differently for different emotions: Whereas F0 was most relevant for responses to happy, fearful and sad voices, timbre was most relevant for responses to voices expressing pleasure. Together, these findings offer original insights into the relative significance of different acoustic parameters for early neuronal representations of speaker emotion and show that such representations are predictive of subsequent evaluative judgments.

8 July 2021 in Emotion Review
Verified
Journal Article
Open access
PDF file
CNChristine Nussbaum
Christine Nussbaum
SSStefan Robert Schweinberger
Stefan Robert Schweinberger
Links between musicality and vocal emotion perception skills have only recently emerged as a focus of study. Here we review current evidence for or against such links. Based on a systematic literature search, we identified 33 studies that addressed either (a) vocal emotion perception in musicians and nonmusicians, (b) vocal emotion perception in individuals with congenital amusia, (c) the role of individual differences (e.g., musical interests, psychoacoustic abilities), or (d) effects of musical training interventions on both the normal hearing population and cochlear implant users. Overall, the evidence supports a link between musicality and vocal emotion perception abilities. We discuss potential factors moderating the link between emotions and music, and possible directions for future research.

25 February 2025 in Trends in Cognitive Sciences
Verified
Journal Article
Open access
CNChristine Nussbaum
Christine Nussbaum
SFSascha Frühholz
Sascha Frühholz
SSStefan Robert Schweinberger
Stefan Robert Schweinberger
The perceived naturalness of a voice is a prominent property emerging from vocal sounds, which affects our interaction with both human and artificial agents. Despite its importance, a systematic understanding of voice naturalness is elusive. This is due to (i) conceptual underspecification, (ii) heterogeneous operationalization, (iii) lack of exchange between research on human and synthetic voices, and (iv) insufficient anchoring in voice perception theory. This review reflects on current insights into voice naturalness by pooling evidence from a wider interdisciplinary literature. Against that backdrop, it offers a concise definition of naturalness and proposes a conceptual framework rooted in both empirical findings and theoretical models. Finally, it identifies gaps in current understanding of voice naturalness and sketches perspectives for empirical progress.

1 February 2022 in Cognition
Verified
Journal Article
Open access
CNChristine Nussbaum
Christine Nussbaum
CECelina I. von Eiff
Celina I. von Eiff
VSVerena G. Skuk
Verena G. Skuk
SSStefan Robert Schweinberger
Stefan Robert Schweinberger
While the human perceptual system constantly adapts to the environment, some of the underlying mechanisms are still poorly understood. For instance, although previous research demonstrated perceptual aftereffects in emotional voice adaptation, the contribution of different vocal cues to these effects is unclear. In two experiments, we used parameter-specific morphing of adaptor voices to investigate the relative roles of fundamental frequency (F0) and timbre in vocal emotion adaptation, using angry and fearful utterances. Participants adapted to voices containing emotion-specific information in either F0 or timbre, with all other parameters kept constant at an intermediate 50% morph level. Full emotional voices and ambiguous voices were used as reference conditions. All adaptor stimuli were either of the same (Experiment 1) or opposite speaker gender (Experiment 2) of subsequently presented target voices. In Experiment 1, we found consistent aftereffects in all adaptation conditions. Crucially, aftereffects following timbre adaptation were much larger than following F0 adaptation and were only marginally smaller than those following full adaptation. In Experiment 2, adaptation aftereffects appeared massively and proportionally reduced, with differences between morph types being no longer significant. These results suggest that timbre plays a larger role than F0 in vocal emotion adaptation, and that vocal emotion adaptation is compromised by eliminating gender-correspondence between adaptor and target stimuli. Our findings also add to mounting evidence suggesting a major role of timbre in auditory adaptation.

18 October 2023 in British Journal of Psychology
Verified
Journal Article
Open access
CNChristine Nussbaum
Christine Nussbaum
ASAnnett Schirmer
Annett Schirmer
SSStefan R. Schweinberger
Stefan R. Schweinberger
Musicians outperform non‐musicians in vocal emotion perception, likely because of increased sensitivity to acoustic cues, such as fundamental frequency (F0) and timbre. Yet, how musicians make use of these acoustic cues to perceive emotions, and how they might differ from non‐musicians, is unclear. To address these points, we created vocal stimuli that conveyed happiness, fear, pleasure or sadness, either in all acoustic cues, or selectively in either F0 or timbre only. We then compared vocal emotion perception performance between professional/semi‐professional musicians ( N = 39) and non‐musicians ( N = 38), all socialized in Western music culture. Compared to non‐musicians, musicians classified vocal emotions more accurately. This advantage was seen in the full and F0‐modulated conditions, but was absent in the timbre‐modulated condition indicating that musicians excel at perceiving the melody (F0), but not the timbre of vocal emotions. Further, F0 seemed more important than timbre for the recognition of all emotional categories. Additional exploratory analyses revealed a link between time‐varying F0 perception in music and voices that was independent of musical training. Together, these findings suggest that musicians are particularly tuned to the melody of vocal emotions, presumably due to a natural predisposition to exploit melodic patterns.

5 January 2022 in Ear & Hearing
Verified
Journal Article
Open access
CECelina I. von Eiff
Celina I. von Eiff
VSVerena G. Skuk
Verena G. Skuk
RZRomi Zäske
Romi Zäske
CNChristine Nussbaum
Christine Nussbaum
SFSascha Frühholz
Sascha Frühholz
SSStefan Robert Schweinberger
Stefan Robert Schweinberger
Objectives: Research on cochlear implants (CIs) has focused on speech comprehension, with little research on perception of vocal emotions. We compared emotion perception in CI users and normal-hearing (NH) individuals, using parameter-specific voice morphing. Design: Twenty-five CI users and 25 NH individuals (matched for age and gender) performed fearful-angry discriminations on bisyllabic pseudoword stimuli from morph continua across all acoustic parameters (Full), or across selected parameters (F0, Timbre, or Time information), with other parameters set to a noninformative intermediate level. Results: Unsurprisingly, CI users as a group showed lower performance in vocal emotion perception overall. Importantly, while NH individuals used timbre and fundamental frequency (F0) information to equivalent degrees, CI users were far more efficient in using timbre (compared to F0) information for this task. Thus, under the conditions of this task, CIs were inefficient in conveying emotion based on F0 alone. There was enormous variability between CI users, with low performers responding close to guessing level. Echoing previous research, we found that better vocal emotion perception was associated with better quality of life ratings. Conclusions: Some CI users can utilize timbre cues remarkably well when perceiving vocal emotions.