18 November 2025 in Nature Communications
Dance is an ancient, holistic art form practiced worldwide throughout human history. Although it offers a window into cognition, emotion, and cross‑modal processing, fine‑grained quantitative accounts of how its diverse information is represented in the brain have rarely been performed. Here, we relate features from a cross‑modal deep generative model of dance to functional magnetic resonance imaging responses while participants watched naturalistic dance clips. We demonstrate that cross-modal features explain dance‑evoked brain activity better than low‑level motion and audio features. Using encoding models as in silico simulators, we quantify how dances that elicit different emotions yield distinct neural patterns. While expert dancers’ brain activity is more broadly explained by dance features than that of novices, experts exhibit greater individual variability. Our approach links cross-modal representations from generative models to naturalistic neuroimaging, clarifying how motion, music, and expertise jointly shape aesthetic and emotional experience.
18 March 2026 in Royal Society Open Science
Accurately inferring others’ emotions from whole-body motion is essential for effective social interaction; however, the specific movement patterns that signal distinct emotions, as well as their causal status, remain elusive. This study combined behavioural assessment with kinematic decomposition to isolate and manipulate gait components influencing emotion recognition. In Experiment 1, we created point-light videos using motion-capture data of walking movements. Participants then reported the perceived emotion in the videos. The motion-capture data were subjected to principal component analysis decomposing coordinated movement patterns. We then investigated relationships between these components and perceived emotions. The second principal component (PC2), reflecting the coordinated arm and leg swings, varied systematically with perceived emotion. In Experiment 2, we undertook a similar task using stimuli in which PC2 scores were scaled to resemble the characteristics of anger, sadness, or fear (based on gaits judged to be neutral). Participants’ judgements shifted significantly in the predicted direction, with manipulated gaits more frequently judged as angry, sad or fearful. These findings suggest that specific movement patterns can independently and causally influence emotion recognition. Our approach offers an effective framework for isolating and manipulating dynamic features within complex movements, thereby advancing understanding of emotional, aesthetic and technical evaluations of movement.
4 September 2026 in bioRxiv
Research on impression evaluation from whole-body movements has traditionally focused on the relationships between emotional perception or aesthetic evaluation and movement patterns characterized by local kinematic features and inter-limb coordination. However, because observers perceive the entire body simultaneously when evaluating emotions or aesthetics in real-world viewing situations, impressions derived from whole-body movements should also be investigated. This requires a low-dimensional representation that summarizes whole-body information in an interpretable manner. In the present study, we evaluated whether the state space generated by multidimensional scaling (MDS) provides a valid representation for summarizing whole-body movement. Specifically, using exercises from Radio Calisthenics No. 1 , we examined whether distances between points in the MDS state space primarily reflected exercise category rather than individual differences. The results showed that distances in the state space reflected exercise category more strongly than performer identity, suggesting that MDS captures similarities among postures of the same exercise. However, the patterns of distances between conditions varied across exercise categories. These findings suggest that MDS-based state-space representations provide a valid and interpretable approach for summarizing whole-body movements. Nevertheless, further validation using a wider variety of whole-body movements and a more diverse participant population is required.