A generative adversarial network (GAN) is one of the most significant research directions in the field of artificial intelligence, and its superior data generation capability has garnered wide attention. In this article, we discuss the recent advancements in GANs, particularly in the medical field. First, the different medical imaging modalities and the principal theory of GANs were analyzed and summarized, after which, the evaluation metrics and training issues were determined. Third, the extension models of GANs were classified and introduced one-by-one. Fourth, the applications of GAN in medical images including cross-modality, augmentation, detection, classification, and reconstruction were illustrated. Finally, the problems we needed to resolve and future directions were discussed. The objective of this review is to provide a comprehensive overview of the GAN, simplify the GAN’s basics, and present the most successful applications in different scenarios.
Human Pose Estimation (HPE) is the task that aims to predict the location of human joints from images and videos. This task is used in many applications, such as sports analysis and surveillance systems. Recently, several studies have embraced deep learning to enhance the performance of HPE tasks. However, building an efficient HPE model is difficult; many challenges, like crowded scenes and occlusion, must be handled. This paper followed a systematic procedure to review different HPE models comprehensively. About 100 articles published since 2014 on HPE using deep learning were selected using several selection criteria. Both image and video data types of methods were investigated. Furthermore, both single and multiple HPE methods were reviewed. In addition, the available datasets, different loss functions used in HPE, and pretrained feature extraction models were all covered. Our analysis revealed that Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) are the most used in HPE. Moreover, occlusion and crowd scenes remain the main problems affecting models’ performance. Therefore, the paper presented various solutions to address these issues. Finally, this paper highlighted the potential opportunities for future work in this task.
23 April 2020 in IEEE Transactions on Medical Imaging
Breast arterial calcifications (BACs) are part of several benign findings present on some mammograms. Previous studies have indicated that BAC may provide evidence of general atherosclerotic vascular disease, and potentially be a useful marker of cardiovascular disease (CVD). Currently, there is no technique in use for the automatic detection of BAC in mammograms. Since a majority of women over the age of 40 already undergo breast cancer screening with mammography, detecting BAC may offer a method to screen women for CVD in a way that is effective, efficient, and broad reaching, at no additional cost or radiation. In this paper, we present a deep learning approach for detecting BACs in mammograms. Inspired by the promising results achieved using the U-Net model in many biomedical segmentation problems and the DenseNet in semantic segmentation, we extend the U-Net model with dense connectivity to automatically detect BACs in mammograms. The presented model helps to facilitate the reuse of computation and improve the flow of gradients, leading to better accuracy and easier training of the model. We evaluate the performance using a set of full-field digital mammograms collected and prepared for this task from a publicly available dataset. Experimental results demonstrate that the presented model outperforms human experts as well as the other related deep learning models. This confirms the effectiveness of our model in the BACs detection task, which is a promising step in providing a cost-effective risk assessment tool for CVD.
Glaucoma is an eye disease that damages the optic nerve head (ONH) causing loss of vision. Therefore, early diagnosis and treatment are important in preventing possible blindness caused by glaucoma. Its current identification is based on the manual segmentation of the optic cup and disc to examine the cup-to-disc ratio (CDR). However, experts’ annotation of these regions is a rather difficult and tedious task. Employing a convolutional neural network (CNN) for diagnosing glaucoma could be an alternative solution. However, its performance depends on the availability of a large number of labeled samples for the training phase. This paper presents an automatic glaucoma diagnosing framework based on three convolutional neural network (CNN) models with different learning methods, and compares the performance of these models with ophthalmologists. We use transfer and semi-supervised learning methods based on both labeled and unlabeled data. First, the transfer learning model starts with a pre-trained CNN model that was trained with non-medical data and fine-tunes it with our labeled data. Secondly, a semi-supervised framework is developed and trained using both labeled and unlabeled data based on two different unsupervised methods. The experimental results using two datasets, RIM-ONE and RIGA, demonstrate the efficacy of deep learning models when applied to glaucoma, which is a promising step towards automated screening for identifying individuals with early-stage glaucoma. Compared with annotations by two ophthalmologists, all the presented models achieve better performances, demonstrating the capability of artificial intelligence in diagnosing glaucoma with a high level of reliability.