Speech contrasts are signaled by multiple acoustic dimensions, but these dimensions are not equally diagnostic. Moreover, the relative diagnosticity, or weight, of acoustic dimensions in speech can shift in different communicative contexts for both speech perception and speech production. However, the literature remains unclear on whether, and if so how, talkers adjust speech to emphasize different acoustic dimensions in the context of changing communicative demands. Here, we examine the interplay of flexible cue weights in speech production and perception across amplitude and duration, secondary non-spectral acoustic dimensions for phonated Mandarin Chinese lexical tone, across natural speech and whispering, which eliminates fundamental frequency contour, the primary acoustic dimension. Phonated and whispered Mandarin productions from native talkers revealed enhancement of both duration and amplitude cues in whispered, compared to phonated speech. When nonspeech amplitude-modulated noises modeled these patterns of enhancement, identification of the noises as Mandarin lexical tone categories was more accurate than identification of noises modeling phonated speech amplitude and duration cues. Thus, speakers exaggerate secondary cues in whispered speech and listeners make use of this information. Yet, enhancement is not symmetric among the four Mandarin lexical tones, indicating possible constraints on the realization of this enhancement.
How language mediates emotional perception and experience is poorly understood. The present event-related potential (ERP) study examined the explicit and implicit processing of emotional speech to differentiate the relative influences of communication channel, emotion category and task type in the prosodic salience effect. Thirty participants (15 women) were presented with spoken words denoting happiness, sadness and neutrality in either the prosodic or semantic channel. They were asked to judge the emotional content (explicit task) and speakers’ gender (implicit task) of the stimuli. Results indicated that emotional prosody (relative to semantics) triggered larger N100, P200 and N400 amplitudes with greater delta, theta and alpha inter-trial phase coherence (ITPC) and event-related spectral perturbation (ERSP) values in the corresponding early time windows, and continued to produce larger LPC amplitudes and faster responses during late stages of higher-order cognitive processing. The relative salience of prosodic and semantics was modulated by emotion and task, though such modulatory effects varied across different processing stages. The prosodic salience effect was reduced for sadness processing and in the implicit task during early auditory processing and decision-making but reduced for happiness processing in the explicit task during conscious emotion processing. Additionally, across-trial synchronization of delta, theta and alpha bands predicted the ERP components with higher ITPC and ERSP values significantly associated with stronger N100, P200, N400 and LPC enhancement. These findings reveal the neurocognitive dynamics of emotional speech processing with prosodic salience tied to stage-dependent emotion- and task-specific effects, which can reveal insights into understanding language and emotion processing from cross-linguistic/cultural and clinical perspectives.
How people recognize linguistic and emotional prosody in different listening conditions is essential for understanding the complex interplay between social context, cognition, and communication. The perception of both lexical tones and emotional prosody depends on prosodic features including pitch, intensity, duration, and voice quality. However, it is unclear which aspect of prosody is perceptually more salient and resistant to noise. This study aimed to investigate the relative perceptual salience of emotional prosody and lexical tone recognition in quiet and in the presence of multi-talker babble noise. Forty young adults randomly sampled from a pool of native Mandarin Chinese with normal hearing listened to monosyllables either with or without background babble noise and completed two identification tasks, one for emotion recognition and the other for lexical tone recognition. Accuracy and speed were recorded and analyzed using generalized linear mixed-effects models. Compared with emotional prosody, lexical tones were more perceptually salient in multi-talker babble noise. Native Mandarin Chinese participants identified lexical tones more accurately and quickly than vocal emotions at the same signal-to-noise ratio. Acoustic and cognitive dissimilarities between linguistic prosody and emotional prosody may have led to the phenomenon, which calls for further explorations into the underlying psychobiological and neurophysiological mechanisms.
How language mediates emotional perception and experience is poorly understood. The present event-related potential (ERP) study examined the explicit and implicit processing of emotional speech to differentiate the relative influences of communication channel, emotion category and task type in the prosodic salience effect. Thirty participants (15 women) were presented with spoken words denoting happiness, sadness and neutrality in either the prosodic or semantic channel. They were asked to judge the emotional content (explicit task) and speakers’ gender (implicit task) of the stimuli. Results indicated that emotional prosody (relative to semantics) triggered larger N100 and P200 amplitudes with greater delta, theta and alpha inter-trial phase coherence (ITPC) values in the corresponding early time windows, and continued to produce larger LPC amplitudes and faster responses during late stages of higher-order cognitive processing. The relative salience of prosodic and semantics was modulated by emotion and task, though such modulatory effects varied across different processing stages. The prosodic salience effect was reduced for sadness processing and in the implicit task during early auditory processing and decision-making but reduced for happiness processing in the explicit task during conscious emotion processing. Additionally, across-trial synchronization of delta, theta and alpha bands predicted the ERP components with higher ITPC values significantly associated with stronger N100, P200 and LPC enhancement. These findings reveal the neurocognitive dynamics of emotional speech processing with prosodic salience tied to stage-dependent emotion- and task-specific effects, which can reveal insights to research reconciling language and emotion processing from cross-linguistic/cultural and clinical perspectives.
As artificial intelligence (AI) technologies become increasingly embedded in higher education, concerns have emerged regarding their psychological impact on university faculty. While existing research has largely focused on technological readiness and digital competencies, the social–psychological foundations of faculty well-being in AI-integrated teaching environments remain insufficiently explored. Drawing on social support theory and self-determination theory, this study proposes and tests a structural model of AI-related well-being among university faculty. A total of 523 faculty members in China participated in a cross-sectional survey measuring perceived social support, organizational support, AI literacy, technological self-efficacy, and AI well-being. Structural equation modeling (SEM) was used to examine the hypothesized pathways and mediating mechanisms. The results indicate that both social support and organizational support significantly and positively influence AI literacy and technological self-efficacy. In turn, AI literacy and technological self-efficacy significantly predict AI well-being and serve as key mediators. Among all factors, AI literacy exhibits the strongest total effect on AI well-being, followed by social support, organizational support, and technological self-efficacy. This study contributes to the theoretical understanding of faculty psychological adjustment during technological transitions and offers practical recommendations for institutions seeking to cultivate AI-ready and psychologically supportive academic environments.
1 October 2016 in The Journal of the Acoustical Society of America
Speech in tone languages requires listeners to identify not only phonemes but also tones. As non-tone language users, Korean-native speakers may have difficulty in identifying tones and vowels and processing both tonal and phonemic information at the same time, which are not presented in their mother tongue. The goal of the present study was to investigate the identification of Mandarin Chinese vowels and tones for both native Mandarin Chinese and native Korean speakers with medium and high Chinese proficiency. Results showed that for the identification of Mandarin vowel-plus-tone, vowel, and tone, there was no difference between Chinese- and Korean-native listeners with high Chinese proficiency, whereas Chinese listeners significantly outperformed Korean listeners with medium Chinese proficiency, particularly for tones 1, 3, and 4 and vowel /y/. For Korean listeners, there was no significant correlation between the onset age of Chinese learning and identification scores, while the identification performance significantly correlated with the length of Chinese learning. Moreover, for both Chinese and Korean listeners, identification scores of vowel-plus-tone, tone and vowel are comparable, suggesting that both groups may process dual cues (vowel and tone) as efficiently as individual cues (vowel or tone).