While there is an increasing shift in cognitive science to study perception of naturalistic stimuli, this study extends this goal to naturalistic contexts by assessing physiological synchrony across audience members in a concert setting. Cardiorespiratory, skin conductance, and facial muscle responses were measured from participants attending live string quintet performances of full-length works from Viennese Classical, Contemporary, and Romantic styles. The concert was repeated on three consecutive days with different audiences. Using inter-subject correlation (ISC) to identify reliable responses to music, we found that highly correlated responses depicted typical signatures of physiological arousal. By relating physiological ISC to quantitative values of music features, logistic regressions revealed that high physiological synchrony was consistently predicted by faster tempi (which had higher ratings of arousing emotions and engagement), but only in Classical and Romantic styles (rated as familiar) and not the Contemporary style (rated as unfamiliar). Additionally, highly synchronised responses across all three concert audiences occurred during important structural moments in the music—identified using music theoretical analysis—namely at transitional passages, boundaries, and phrase repetitions. Overall, our results show that specific music features induce similar physiological responses across audience members in a concert context, which are linked to arousal, engagement, and familiarity.
1 April 2023 in Psychology of Aesthetics, Creativity, and the Arts
Compared to audio only (AO) conditions, audiovisual (AV) information can enhance the aesthetic experience of a music performance. However, such beneficial multimodal effects have yet to be studied in naturalistic music performance settings. Further, peripheral physiological correlates of aesthetic experiences are not well-understood. Here, participants were invited to a concert hall for piano performances of Bach, Messiaen, and Beethoven, which were presented in two conditions: AV and AO. They rated their aesthetic experience (AE) after each piece (Experiment 1 and 2), while peripheral signals (cardiorespiratory measures, skin conductance, and facial muscle activity) were continuously measured (Experiment 2). Factor scores of AE were significantly higher in the AV condition in both experiments. LF/HF ratio, a heart rhythm that represents activation of the sympathetic nervous system, was higher in the AO condition, suggesting increased arousal, likely caused by less predictable sound onsets in the AO condition. We present partial evidence that breathing was faster and facial muscle activity was higher in the AV condition, suggesting that observing a performer's movements likely enhances motor mimicry in these more voluntary peripheral measures. Further, zygomaticus ('smiling') muscle activity was a significant predictor of AE. Thus, we suggest physiological measures are related to AE, but at different levels: the more involuntary measures (i.e., heart rhythms) may reflect more sensory aspects, while the more voluntary measures (i.e., muscular control of breathing and facial responses) may reflect the liking aspect of an AE. In summary, we replicate and extend previous findings that AV information enhances AE in a naturalistic music performance setting. We further show that a combination of self-report and peripheral measures benefit a meaningful assessment of AE in naturalistic music performance settings.
3 January 2025 in Annals of the New York Academy of Sciences
People enjoy engaging with music. Live music concerts provide an excellent option to investigate real‐world music experiences, and at the same time, use neurophysiological synchrony to assess dynamic engagement. In the current study, we assessed engagement in a live concert setting using synchrony of cardiorespiratory measures, comparing inter‐subject, stimulus–response, correlation, and phase coherence. As engagement might be enhanced in a concert setting by seeing musicians perform, we presented audiences with audio‐only (AO) and audio‐visual (AV) piano performances. Only correlation synchrony measures were above chance level. In comparing time‐averaged synchrony across conditions, AV performances evoked a higher inter‐subject correlation of heart rate (ISC‐HR). However, synchrony averaged across music pieces did not correspond to self‐reported engagement. On the other hand, time‐resolved analyses show that synchronized deceleration‐acceleration heart rate (HR) patterns, typical of an “orienting response” (an index of directed attention), occurred within music pieces at salient events of section boundaries. That is, seeing musicians perform heightened audience engagement at structurally important moments in Western classical music. Overall, we could show that multisensory information shapes dynamic engagement. By comparing different synchrony measures, we further highlight the advantages of time series analysis, specifically ISC‐HR, as a robust measure of holistic musical listening experiences in naturalistic concert settings.
Recent empirical evidence and theoretical propositions motivate a paradigm shift in how we investigate neurocognitive functions. Rather than looking at the brain-behaviour relationship in isolation, research shows that cognition is shaped by reciprocal, dynamical interactions between the brain and the body across multiple timescales: from ultra-slow circadian rhythm to gastrointestinal and cardiorespiratory activity. This interest in body-brain-behaviour dynamics has raised new questions about if and how autonomic functioning, the coordination of intero- and exteroception, lifestyle and dietary choices, gut microbiome composition, hormonal cycles, and inflammation can impact behaviour, general health and well-being. We carefully reviewed existing theoretical accounts and empirical evidence on the body-brain-behaviour interface and delineated new emerging avenues for multimodal, functional, ecologically valid, and personalized research that also integrates smart sensing technologies. In a synopsis, we propose the concept of a body-brain (dis)equilibrium regulating transitions from health to pathology.
A concert is a common event at which people gather to share a musical experience. While techniques are increasingly offering insights into naturalistic stimuli perception, this study extended methods to a more ecological context in order to explore real-world music listening within a concert setting. Cardiorespiratory, skin conductance, and facial muscle responses were measured from participants attending one of three concerts with live chamber music performances of works of varying Western Classical styles (Viennese Classical, Contemporary, and Romantic). Collective physiological synchronisation of audience members was operationalised via inter-subject correlation (ISC). By assessing which musical features (obtained via Music Information Retrieval and music-theoretical analyses) evoked moments of high synchrony, logistic regressions revealed that tempo consistently predicted physiological synchrony across all concerts in Classical and Romantic styles, but not the Contemporary style. Highly synchronised responses across all three concert audiences seemed to occur during structural transitional passages, boundaries, and at phrase repetitions. The results support the idea that group synchronisation is linked to musical arousal, structural coherence, and familiarity. By employing physiological ISC and an inter-disciplinary musical analysis, the current study demonstrates a novel approach to gain valuable insight into experiences of naturalistic stimuli in an ecological context.