18 July 2019 in Scientific Reports
How do people have conversations in noise and make themselves understood? While many previous studies have investigated speaking and listening in isolation, this study focuses on the behaviour of pairs of individuals in an ecologically valid context. Specifically, we report the fine-grained dynamics of natural conversation between interlocutors of varying hearing ability (n = 30), addressing how different levels of background noise affect speech, movement, and gaze behaviours. We found that as noise increased, people spoke louder and moved closer together, although these behaviours provided relatively small acoustic benefit (0.32 dB speech level increase per 1 dB noise increase). We also found that increased noise led to shorter utterances and increased gaze to the speaker’s mouth. Surprisingly, interlocutors did not make use of potentially beneficial head orientations. While participants were able to sustain conversation in noise of up to 72 dB, changes in conversation structure suggested increased difficulty at 78 dB, with a significant decrease in turn-taking success. Understanding these natural conversation behaviours could inform broader models of interpersonal communication, and be applied to the development of new communication technologies. Furthermore, comparing these findings with those from isolation paradigms demonstrates the importance of investigating social processes in ecologically valid multi-person situations.
12 January 2022 in Nature Reviews Psychology
16 December 2015 in Journal of Neuroscience
Overlap between sensory and motor representations has been documented for a range of human actions, from grasping (Rizzolatti et al., 1996b) to playing a musical instrument (Novembre and Keller, 2014). Such overlap suggests that individuals use motor simulation to predict the outcome of observed actions (Wolpert, 1997). Here we investigate motor simulation as a basis of human communication. Using a musical turn-taking task, we show that pianists call on motor representations of their partner's part to predict when to come in for their own turn. Pianists played alternating solos with a videoed partner, and double-pulse transcranial magnetic stimulation was applied around the turn-switch to temporarily disrupt processing in two cortical regions implicated previously in different forms of motor simulation: (1) the dorsal premotor cortex (dPMC), associated with automatic motor resonance during passive observation of hand actions, especially when the actions are familiar (Lahav et al., 2007); and (2) the supplementary motor area (SMA), involved in active motor imagery, especially when the actions are familiar (Baumann et al., 2007). Stimulation of the right dPMC decreased the temporal accuracy of pianists' (right-hand) entries relative to sham when the partner's (left-hand) part had been rehearsed previously. This effect did not occur for dPMC stimulation without rehearsal or for SMA stimulation. These findings support the role of the dPMC in predicting the time course of observed actions via resonance-based motor simulation during turn-taking. Because turn-taking spans multiple modes of human interaction, we suggest that simulation is a foundational mechanism underlying the temporal dynamics of joint action.SIGNIFICANCE STATEMENTEven during passive observation, seeing or hearing somebody execute an action from within our repertoire activates motor cortices of our brain. But what is the functional relevance of such “motor simulation”? By combining a musical duet task with a real-time repetitive transcranial magnetic stimulation protocol, we provide evidence indicating that the dorsal premotor cortex plays a causal role in accurate turn-taking coordination between a pianist and their observed interaction partner. Given that turn-taking behavior is a fundamental feature of human communication, we suggest that simulation is a foundational mechanism underlying the temporal dynamics of communicative joint action.
1 October 2020 in Cognition
As children become older, they better maintain task-relevant information in preparation of upcoming cognitive demands. This is referred to as proactive control, which is a key component of cognitive control development. However, it is still uncertain whether children engage in proactive control consistently across different contexts and how proactive control relates to academic abilities. This study used two common tasks-the AX Continuous Performance Task (AX-CPT) and the Cued Task-Switching Paradigm (CTS)-to examine whether proactive control engagement in 102 children (age range: 6.91-10.91 years) converges between the two tasks and predicts academic abilities. Proactive control indices modestly correlated between tasks in higher but not lower working-memory children, suggesting that consistency in proactive control engagement across contexts is relatively low during childhood but increases with working memory capacity. Further, working memory (but not verbal speed) predicted proactive control engagement in both tasks. While proactive control as measured by each task predicted math and reading performance, only proactive control measured by CTS additionally predicted reasoning, suggesting that proactive control can be used as a proxy for academic achievements.
13 October 2020 in Psychonomic Bulletin & Review
Many conversations in our day-to-day lives are held in noisy environments – impeding comprehension, and in groups – taxing auditory attention-switching processes. These situations are particularly challenging for older adults in cognitive and sensory decline. In noisy environments, a variety of extra-linguistic strategies are available to speakers and listeners to facilitate communication, but while models of language account for the impact of context on word choice, there has been little consideration of the impact of context on extra-linguistic behaviour. To address this issue, we investigate how the complexity of the acoustic environment and interaction situation impacts extra-linguistic conversation behaviour of older adults during face-to-face conversations. Specifically, we test whether the use of intelligibility-optimising strategies increases with complexity of the background noise (from quiet to loud, and in speech-shaped vs. babble noise), and with complexity of the conversing group (dyad vs. triad). While some communication strategies are enhanced in more complex background noise, with listeners orienting to talkers more optimally and moving closer to their partner in babble than speech-shaped noise, this is not the case with all strategies, as we find greater vocal level increases in the less complex speech-shaped noise condition. Other behaviours are enhanced in the more complex interaction situation, with listeners using more optimal head orientations, and taking longer turns when gaining the floor in triads compared to dyads. This study elucidates how different features of the conversation context impact individuals’ communication strategies, which is necessary to both develop a comprehensive cognitive model of multimodal conversation behaviour, and effectively support individuals that struggle conversing.
20 May 2019 in Developmental Science
Monitoring progression towards one's goals is essential for efficient cognitive control. Immature performance monitoring may contribute to suboptimal cognitive control engagement in childhood, potentially explaining why children engage control reactively even when proactive control would be more effective. This study investigated whether encouraging children to actively monitor their performance results in more mature control engagement. Electroencephalography data were collected while children and adults performed a flanker task in three conditions in which they were provided no feedback, standard feedback, or were asked to estimate their own feedback. Both age groups accurately estimated their own feedback. Critically, feedback estimation promoted online performance monitoring and proactive engagement of attention and inhibition during the flanker period in children. These findings indicate that proactive control engagement in childhood can be effectively supported by encouraging performance monitoring.