23 October 2019 in IEEE Transactions on Biomedical Engineering
It has been recently shown that deep learning models such as convolutional neural networks (CNN), deep belief networks (DBN) and recurrent neural networks (RNN), exhibited remarkable ability in modeling and representing fMRI data for the understanding of functional activities and networks because of their superior data representation capability and wide availability of effective deep learning tools. For example, spatial and/or temporal patterns of functional brain activities embedded in fMRI data can be effectively characterized and modeled by a variety of CNN/DBN/RNN deep learning models as shown in recent studies. However, it has been rarely investigated whether it is possible to directly infer hierarchical brain networks from volumetric fMRI data using deep learning models such as DBN. The perceived difficulties of such studies include very large number of input variables, very large number of training parameters, the lack of effective software tools, the challenge of results interpretation, and etc. To bridge these technical gaps, we designed a novel volumetric sparse deep belief network (VS-DBN) model and implemented it through the popular TensorFlow open source platform to reconstruct hierarchical brain networks from volumetric fMRI data based on the Human Connectome Project (HCP) 900 subjects release. Our experimental results showed that a large number of interpretable and meaningful brain networks can be robustly reconstructed from HCP 900 subjects in a hierarchical fashion, and importantly, these brain networks exhibit reasonably good consistency and correspondence across multiple HCP task-based fMRI datasets. Our work contributed a new general deep learning framework for inferring multiscale volumetric brain networks and offered novel insights into the hierarchical organization of functional brain architecture.
23 September 2020 in IEEE Transactions on Cognitive and Developmental Systems
In the neuroimaging and brain mapping communities, researchers have proposed a variety of computational methods to map functional brain networks (FBNs). Recently, it has been proven that deep learning (DL) can be applied on functional magnetic resonance image (fMRI) data with superb representation power over the traditional machine learning methods. However, due to the lack of labeled data and the high dimension of fMRI volume images, DL suffers from overfitting in both supervised and unsupervised training processes. In this work, we proposed a novel generative model: deep variational autoencoder (DVAE) to tackle the challenge of insufficient data and incomplete supervision. The experimental results showed that the representations learned by DVAE are interpretable and meaningful compared to those learned from well-known sparse dictionary learning (SDL). Besides, the organization of some FBN patterns derived from different layers in DVAE was observed in a hierarchical fashion. Furthermore, we showed that DVAE has better performance on small dataset over autoencoder (AE). By using attention deficit hyperactivity disorder (ADHD)-200 dataset as our test bed, we constructed a DVAE-based modeling and classification pipeline in which all subjects’ functional connectivities estimated by FBNs were taken as input features to train a classifier. Finally, the results achieved by our pipeline reached state-of-the-art classification accuracies on three ADHD-200 sites compared with other fMRI-based methods.