Big medical data mainly include electronic health record data, medical image data, gene information data, etc. Among them, medical image data account for the vast majority of medical data at this stage. How to apply big medical data to clinical practice? This is an issue of great concern to medical and computer researchers, and intelligent imaging and deep learning provide a good answer. This review introduces the application of intelligent imaging and deep learning in the field of big data analysis and early diagnosis of diseases, combining the latest research progress of big data analysis of medical images and the work of our team in the field of big data analysis of medical imagec, especially the classification and segmentation of medical images.
Background: Accurate glioma grading before surgery is of the utmost importance in treatment planning and prognosis prediction. But previous studies on magnetic resonance imaging (MRI) images were not effective enough. According to the remarkable performance of convolutional neural network (CNN) in medical domain, we hypothesized that a deep learning algorithm can achieve high accuracy in distinguishing the World Health Organization (WHO) low grade and high grade gliomas. Methods: One hundred and thirteen glioma patients were retrospectively included. Tumor images were segmented with a rectangular region of interest (ROI), which contained about 80% of the tumor. Then, 20% data were randomly selected and leaved out at patient-level as test dataset. AlexNet and GoogLeNet were both trained from scratch and fine-tuned from models that pre-trained on the large scale natural image database, ImageNet, to magnetic resonance images. The classification task was evaluated with five-fold cross-validation (CV) on patient-level split. Results: The performance measures, including validation accuracy, test accuracy and test area under curve (AUC), averaged from five-fold CV of GoogLeNet which trained from scratch were 0.867, 0.909, and 0.939, respectively. With transfer learning and fine-tuning, better performances were obtained for both AlexNet and GoogLeNet, especially for AlexNet. Meanwhile, GoogLeNet performed better than AlexNet no matter trained from scratch or learned from pre-trained model. Conclusion: In conclusion, we demonstrated that the application of CNN, especially trained with transfer learning and fine-tuning, to preoperative glioma grading improves the performance, compared with either the performance of traditional machine learning method based on hand-crafted features, or even the CNNs trained from scratch.
Background: The hippocampus is a key area of the brain responsible for learning, memory, and other abilities. Accurately segmenting the hippocampus and precisely calculating the volume of the hippocampus is of great significance for predicting Alzheimer’s disease and amnesia. Most of the segmentation algorithms currently involved are based on templates, such as the more popular FreeSufer. Methods: This study proposes Deephipp, a deep learning network based on a 3D dense block using an attention mechanism for accurate segmentation of the hippocampus. DeepHipp is based on the following novelties: (i) DeepHipp adopts powerful data augmentation schemes to enhance the segmentation ability. (ii) DeepHipp is designed to incorporate 3D dense-block to capture multiple-scale features of the hippocampus. (iii) DeepHipp creatively uses the attention mechanism in the field of hippocampal image segmentation, extracting useful hippocampus information in a massive feature map, and improving the accuracy and sensitivity of the model. Conclusions: We describe the illustrative results and show extensive qualitative and quantitative comparisons with other methods. Our achievement demonstrates that the accuracy of DeepHipp can reach 83.63%, which is superior to most existing methods in terms of accuracy and efficiency of hippocampus segmentation. It is noticeable that deep learning can potentially lead to an effective segmentation of medical images.
Parallel imaging is a technique to shorten the acquisition time by reducing the data size in phase encoding direction. Compressed Sensing is a technique to improve the performance of parallel imaging based reconstruction methods such as l1-regularized SPIRiT by adding the regularization term, which leads to frequent calculations of Discrete Wavelet Transform (DWT) with high time cost. However, clinical practice of MRI scan requires fast or real-time reconstruction with high image quality. In this paper, by taking advantage of the properties of parallel imaging and GPU computing, we develop a fast three-dimensional DWT for parallel imaging based reconstruction methods such as l1-regularized SPIRiT. Computational results show that fast DWT in l1-regularized SPIRiT MRI reconstruction is approximately three times faster than the conventional DWT. Computational results also show that fast DWT for reconstructing an 80 × 150 × 32 × 80 Cardiac MRI dataset by l1-regularized SPIRiT is approximately 20 per cent faster than l1-regularized SPIRiT of the conventional DWT.