24 October 2024 in Journal of Speech, Language, and Hearing Research
Purpose: Breathing is ubiquitous in speech production, crucial for structuring speech, and a potential diagnostic indicator for respiratory diseases. However, the acoustic characteristics of speech breathing remain underresearched. This work aims to characterize the spectral properties of human inhalation noises in a large speaker sample and explore their potential similarities with speech sounds. Speech sounds are mostly realized with egressive airflow. To account for this, we investigated the effect of airflow direction (inhalation vs. exhalation) on acoustic properties of certain vocal tract (VT) configurations. Method: To characterize human inhalation, we describe spectra of breath noises produced by human speakers from two data sets comprising 34 female and 100 male participants. To investigate the effect of airflow direction, three-dimensional–printed VT models of a male and a female speaker with static VT configurations of four vowels and four fricatives were used. An airstream was directed through these VT configurations in both directions, and their spectral consequences were analyzed. Results: For human inhalations, we found spectra with a decreasing slope and several weak peaks below 3 kHz. These peaks show moderate (female) to strong (male) overlap with resonances found for participants inhaling with a VT configuration of a central vowel. Results for the VT models suggest that airflow direction is crucial for spectral properties of sibilants, /ç/, and /i:/, but not the other sounds we investigated. Inhalation noise is most similar to /ə/ where airflow direction does not play a role. Conclusions: Inhalation is realized on ingressive airflow, and inhalation noises have specific resonance properties that are most similar to /ə/ but occur without phonation. Airflow direction does not play a role in this specific VT configuration, but subglottal resonances may do. For future work, we suggest investigating the articulation of speech breathing and link it to current work on pause postures. Supplemental Material: https://doi.org/10.23641/asha.24520585
21 May 2025 in Proceedings Of The Royal Society B-Biological Sciences
Humans often vocalize while concurrently gesturing with their hands. Fluctuations in the intensity and tone of the voice have been shown to synchronize with gestural upper limb movement. This research provides direct evidence that (postural) muscle activity associated with arm movements predict these voicing fluctuations. We show that specific muscles (e.g. pectoralis major, erector spinae), associated with upper limb movement and their postural anticipations, are especially likely to interact with the voice. Adding a 1 kg mass to the upper limb increased this interaction. Ground-reaction forces were also found to relate to postural muscles, and these measurements also directly covaried with fluctuations in the voice during some movement conditions. These results show that the voice co-patterns with whole-body kinetics (i.e. forces). We thereby go beyond kinematic analyses in studying interactions between gesturing and vocalization, invoking several implications for biomechanical modelling. We conclude that human voicing has evolved in a dynamical interaction with the whole-body motor system.
28 November 2023 in bioRxiv
Humans often vocalize while concurrently gesturing with their hands. Fluctuations in the intensity and tone of the voice have been shown to synchronize with gestural upper limb movement. This research provides direct evidence that interactions between arm movements and postural muscle activity cause these voicing fluctuations. We show that specific muscles (e.g., pectoralis major, erector spinae), associated with upper limb movement and their postural anticipations, are especially likely to interact with the voice. Adding mass to the upper limb increased this interaction. Ground-reaction forces were also found to relate to postural muscles, and these measurements also directly covaried with fluctuations in the voice during some movement conditions. These results show that the voice co-patterns with whole-body kinetics, i.e. forces. We thereby go beyond kinematic analyses in studying interactions between gesturing and vocalization, invoking several implications for biomechanical modeling. We conclude that human voicing has evolved in a dynamical interaction with the whole-body motor system.
8 January 2024 in bioRxiv
The gesture-speech physics theory suggests that there are biomechanical interactions of the voice with the whole body, driving speech to align fluctuations in loudness and F0 with upper-limb movement. This exploratory study offers a possible falsification of the gesture-speech physics theory, which would predict effects of upper-limb movement on voice as well as respiration. We therefore investigate co-movement expiration. Seventeen participants were asked to produce a continuous exhalation for several seconds. After 3s, they execute one of five within-subject movement conditions with their arm with and without a wrist weight (no movement, elbow flexion, elbow extension, internal arm rotation, external arm rotation). We analyzed the smoothed amplitude envelope of the acoustic signal in relation to arm movement. Compared to no movement, all four movements lead to higher positive peaks in the amplitude peaks, while weight did not influence the amplitude. We also found that across movement conditions, positive amplitude peaks are structurally timed relative to peaks in kine-matics (speed, acceleration). We conclude that the reason why upper-limb movements affect voice loudness is still best understood through gesture-speech physics theory, where upper-limb movements affect the voice directly by modulating sub-glottal pressures. Multimodal prosody is therefore partly literally embodied.
2 December 2025 in bioRxiv
In a landmark paper in JASA , Orlikoff & Baken (1989a) demonstrated that the heartbeat carries through acoustic features of the human voice. Heart-voice coupling questions how vocal control is functionally regulated and has many potential engineering applications to extract heart rate from the human voice. However, laboratory phonology and bioacoustics seem to have forgotten about the phenomenon, such that its physiological underpinnings have been left unexplained. The current contribution showed that vocal acoustics contain signatures of the heartbeat as originally reported by Orlikoff & Baken (1989a). More specifically, the steady-state vowel vocalizations of 17 participants were analysed and a significant relationship between the vocal acoustic envelope and the cardiac activity (ECG) was found. Furthermore, two empirical tests were conducted to discriminate between vocal fold (vascularization) and pulmonary (heart-lung interaction) mechanisms of heart-voice coupling. In addition to a stable heart-voice coupling, a significant heart-expiration coupling during conditions of silent expiration was also found. Since the vocal folds are abducted during expiration, this result demonstrated that pulmonary mechanisms that modulate expiratory flow must be involved in heart-voice coupling. It is speculated that the heart’s rhythm may be a weakly coupled pattern generator that possibly shaped the evolution of vocal and speech production.
1 October 2019 in Journal of Thoracic Oncology