31 January 2018 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
This paper aims to investigate how adequate cognitive functions for recognizing, predicting, and generating a variety of actions can be developed through iterative learning of action-caused dynamic perceptual patterns. Particularly, we examined the capabilities of mental simulation of one's own actions as well as the inference of others' intention because they play a crucial role, especially in social cognition. We propose a dynamic neural network model based on predictive coding which can generate and recognize dynamic visuo-proprioceptive patterns. The proposed model was examined by conducting a set of robotic simulation experiments in which a robot was trained to imitate visually perceived gesture patterns of human subjects in a simulation environment. The experimental results showed that the proposed model was able to develop a predictive model of imitative interaction through iterative learning of large-scale spatio-temporal patterns in visuo-proprioceptive input streams. Also, the experiment verified that the model was able to generate mental imagery of dynamic visuo-proprioceptive patterns without feeding the external inputs. Furthermore, the model was able to recognize the intention of others by minimizing prediction error in the observations of the others' action patterns in an online manner. These findings suggest that the error minimization principle in predictive coding could provide a primal account for the mirror neuron functions for generating actions as well as recognizing those generated by others in a social cognitive context.
9 January 2023 in IEEE Transactions on Biomedical Engineering
Objective: Gastrointestinal magnetic resonance imaging (MRI) provides rich spatiotemporal data about the movement of the food inside the stomach, but does not directly report muscular activity on the stomach wall. Here we describe a novel approach to characterize the motility of the stomach wall that drives the volumetric changes of the ingesta. Methods: A neural ordinary differential equation was optimized to model a diffeomorphic flow that ascribed the deformation of the stomach wall to a continuous biomechanical process. Driven by this diffeomorphic flow, the surface of the stomach progressively changes its shape over time, while preserving its topology and manifoldness. Results: We tested this approach with MRI data collected from 10 rats under a lightly anesthetized condition, and demonstrated accurate characterization of gastric motor events with an error in the order of sub-millimeters. Uniquely, we characterized gastric anatomy and motility with a surface coordinate system common at individual and group levels. Functional maps were generated to reveal the spatial, temporal, and spectral characteristics of muscle activity and its coordination across different regions. The peristalsis at the distal antrum had a dominant frequency and peak-to-peak amplitude of $5.73\pm 0.55$ cycles per minute and $1.49\pm 0.41$ mm, respectively. The relationship between muscle thickness and gastric motility was also evaluated in two distinct functional regions. Conclusion: These results demonstrate the efficacy of using MRI to model gastric anatomy and function. Significance: The proposed approach is expected to enable non-invasive and accurate mapping of gastric motility for preclinical and clinical studies.