Numerous artificial intelligence (AI) based approaches have been proposed for automatic Alzheimer's disease (AD) prediction with brain structural magnetic resonance imaging (sMRI). Previous studies extract features from the whole brain or individual slices separately, ignoring the properties of multi-view slices and feature complementarity. For this reason, we present a novel AD diagnosis model based on the multiview-slice attention and 3D convolution neural network (3D-CNN). Specifically, we begin by extracting the local slice-level characteristic in various dimensions using multiple sub-networks. Then we proposed a slice-level attention mechanism to emphasize specific 2D-slices to exclude the redundancy features. After that, a 3D-CNN was employed to capture the global subject-level structural changes. Finally, all these 2D and 3D features were fused to obtain more discriminative representations. We conduct the experiments on 1,451 subjects from ADNI-1 and ADNI-2 datasets. Experimental results showed the superiority of our model over the state-of-the-art approaches regarding dementia classification. Specifically, our model achieves accuracy values of 91.1 and 80.1% on ADNI-1 for AD diagnosis and mild cognitive impairment (MCI) convention prediction, respectively.
15 June 2023 in IEEE/CAA Journal of Automatica Sinica
Dear Editor, This letter presents a novel tensor-distribution-regression model based on 3D conventional neural networks (3D-TDR) with an application to clinical score prediction in aging-related diagnosis. The estimation of clinical scores of subjects using brain magnetic resonance imaging (MRI) helps understand the pathological stage of dementia. However, clinical scores prediction is still unsolved due to the reasons of: 1) Analyzing the whole-brain MRI is extremely difficult as the high-dimensional MRI data contains millions of voxels; 2) The clinical scores prediction is formulated as a one-dimensional regression issue in the current deep-learning-based algorithms, which ignores the implicit label information between subjects with different score levels. Motivated by the above discoveries, the proposed 3D-TDR model innovatively establishes the following three-fold ideas: a) incorporating a tensor regression layer (TRL) into a 3D conventional neural network (3D-CNN) to enable its extraction of more discriminative structural changes from the high-dimensional whole-brain magnetic resonance (MR) data; b) adopting the label distribution learning (LDL) to fully utilize the label correlation among the MR images, thus emphasizing the diversity of subjects' scores; and c) combining the TRL and LDL for an end-to-end deep learning framework, thereby achieving jointly low-rank feature extraction and clinical scores prediction. Experimental results on two real-world MRI datasets of two typical clinical prediction tasks indicate that the 3D-TDR outperforms the benchmark and state-of-the-art models. The proposed 3D-TDR model can achieve significant accuracy gain in dementia score and brain age prediction.
1 January 2022 in Computer Methods and Programs in Biomedicine