1 November 2021 in NeuroImage
Recognizing the actions of others depends on segmentation into meaningful events. After decades of research in this area, it remains still unclear how humans do this and which brain areas support underlying processes. Here we show that a computer vision-based model of touching and untouching events can predict human behavior in segmenting object manipulation actions with high accuracy. Using this computational model and functional Magnetic Resonance Imaging (fMRI), we pinpoint the neural networks underlying this segmentation behavior during an implicit action observation task. Segmentation was announced by a strong increase of visual activity at touching events followed by the engagement of frontal, hippocampal and insula regions, signaling updating expectation at subsequent untouching events. Brain activity and behavior show that touching-untouching motifs are critical features for identifying the key elements of actions including object manipulations.
8 April 2025 in NeuroImage
Previous research has highlighted the critical role of prediction errors (PEs) in signaling the need to adapt memory representations in response to unexpected changes in the environment. Yet, the influence of PE type and strength on memory remains underexplored. In this study, participants encoded naturalistic dialogues prior to undergoing fMRI scanning. During the fMRI session, they listened to dialogues that had been modified in their surface or gist, to varying extents. As expected, our findings revealed robust activation in the inferior frontal gyrus for all PEs. Notably, gist modifications elicited additional activations within the episodic memory network, including the hippocampus. A post-fMRI recognition test demonstrated that surface modifications had no significant impact on memory. Conversely, weak gist changes impaired memory for the original content and hindered learning of the modification. These weak gist changes also triggered activation in the parahippocampal cortex. These results underscore the importance of both the type and strength of PEs in shaping brain activations and memory outcomes, highlighting their complex interplay in cognitive processes.
8 December 2023 in Human Brain Mapping
The brain's structural network follows a hierarchy that is described as rich club (RC) organization, with RC hubs forming the well‐interconnected top of this hierarchy. In this study, we tested whether RC hubs are involved in the processing of hierarchically higher structures in stimulus sequences. Moreover, we explored the role of previously suggested cortical gradients along anterior‐posterior and medial‐lateral axes throughout the frontal cortex. To this end, we conducted a functional magnetic resonance imaging (fMRI) experiment and presented participants with blocks of digit sequences that were structured on different hierarchically nested levels. We additionally collected diffusion weighted imaging data of the same subjects to identify RC hubs. This classification then served as the basis for a region of interest analysis of the fMRI data. Moreover, we determined structural network centrality measures in areas that were found as activation clusters in the whole‐brain fMRI analysis. Our findings support the previously found anterior and medial shift for processing hierarchically higher structures of stimuli. Additionally, we found that the processing of hierarchically higher structures of the stimulus structure engages RC hubs more than for lower levels. Areas involved in the functional processing of hierarchically higher structures were also more likely to be part of the structural RC and were furthermore more central to the structural network. In summary, our results highlight the potential role of the structural RC organization in shaping the cortical processing hierarchy.
16 July 2025 in NeuroImage
Episodic memories are not static - they shift and reshape as our surroundings evolve. One powerful mechanism for change are prediction errors, which arise when predictions about what is going to happen next do not match the actual input. This study investigated how the size of prediction errors - arising from predictions based on episodic memories - affects recognition memory and neural memory representations. In an fMRI experiment, participants listened to a series of naturalistic dialogues. In a later session, a critical segment of the dialogue was altered to introduce a mismatch and thus evoke a prediction error. Importantly, larger prediction errors were linked to increased recognition memory for the original and mismatching targets, and better source memory for the mismatching targets. Representational similarity analysis revealed that larger prediction errors were also associated with stronger reinstatement of the original version during mismatching (unpredicted) input, which promoted memory for both the old and the new version. Additionally, larger prediction errors enhanced the long-term representational stability of the original memory. We argue that these results support the idea that stronger episodic prediction errors lead to a more distinct encoding of new information, which benefits the recognition of both old and new information. This could be achieved by a pattern completion mechanism in which old information is reinstated during mismatching new input.
12 June 2024 in NeuroImage
Even though actions we observe in everyday life seem to unfold in a continuous manner, they are automatically divided into meaningful chunks, that are single actions or segments, which provide information for the formation and updating of internal predictive models. Specifically, boundaries between actions constitute a hub for predictive processing since the prediction of the current action comes to an end and calls for updating of predictions for the next action. In the current study, we investigated neural processes which characterize such boundaries using a repertoire of complex action sequences with a predefined probabilistic structure. Action sequences consisted of actions that started with the hand touching an object (T) and ended with the hand releasing the object (U). These action boundaries were determined using an automatic computer vision algorithm. Participants trained all action sequences by imitating demo videos. Subsequently, they returned for an fMRI session during which the original action sequences were presented in addition to slightly modified versions thereof. Participants completed a post-fMRI memory test to assess the retention of original action sequences. The exchange of individual actions, and thus a violation of action prediction, resulted in increased activation of the action observation network and the anterior insula. At U events, marking the end of an action, increased brain activation in supplementary motor area, striatum, and lingual gyrus was indicative of the retrieval of the previously encoded action repertoire. As expected, brain activation at U events also reflected the predefined probabilistic branching structure of the action repertoire. At T events, marking the beginning of the next action, midline and hippocampal regions were recruited, reflecting the selected prediction of the unfolding action segment. In conclusion, our findings contribute to a better understanding of the various cerebral processes characterizing prediction during the observation of complex action repertoires.
10 August 2025 in NeuroImage
Recently, it has been suggested that brain dysconnectivity in patients with schizophrenia contributes to the wide-ranging cognitive deficits that characterize the disorder. Graph theoretical analysis offers a unique method for studying how architectural alterations in large-scale brain networks may contribute to cognitive impairments in these patients. Implementing this technique, we analyzed the functional brain activity during a predictive switch-drift task from 21 patients with schizophrenia and 22 matched healthy controls. We specifically calculated task-based global graph measures for the functional networks that were activated during expected events, events requiring a flexible updating of predictions, and events that required the stabilization of predictions. By implementing Bayesian multivariate generalized linear models, we found functional network alterations during all event types, which indicated less centralized, less integrated, and simultaneously less segregated network topology in patients with schizophrenia compared to controls. In addition, the rate of correctly detected switches, requiring flexible updating of internal models, predicted global graph measures differently for patients compared to controls. In particular, lower cognitive flexibility in patients was associated with reduced integration of functional networks. Overall, the results indicate alterations of network topologies, resulting in less optimal network organization in patients with schizophrenia compared to healthy controls.