Optical coherence tomography (OCT) is a promising high-speed, non-invasive imaging modality providing high-resolution retinal scans. However, a variety of external factors such as light occlusion and patient movement can seriously degrade OCT image quality, which complicates manual retinopathy detection and computer-aided diagnosis. As such, this study first presents an OCT image quality assessment (OCT-IQA) system, capable of automatic classification based on signal completeness, location, and effectiveness. Four CNN architectures (VGG-16, Inception-V3, ResNet-18, and ResNet-50) from the ImageNet classification task were used to train the proposed OCT-IQA system via transfer learning. The ResNet-50 with the best performance was then integrated into the final OCT-IQA network. The usefulness of this approach was evaluated using retinopathy detection results. A retinopathy classification network was first trained by fine-tuning Inception-V3 model. The model was then applied to two test datasets, created randomly from the original dataset, one of which was screened by the OCT-IQA system and only included high quality images while the other was mixed by high and low quality images. Results showed that retinopathy detection accuracy and area under curve (AUC) were 3.75% and 1.56% higher, respectively, for the filtered data (compared with the unfiltered data). These experimental results demonstrate the effectiveness of the proposed OCT-IQA system and suggest that deep learning could be applied to the design of computer-aided systems (CADSs) for automatic retinopathy detection.
Lesion detection is a critical component of disease diagnosis, but the manual segmentation of lesions in medical images is time-consuming and experience-demanding. These issues have recently been addressed through deep learning models. However, most of the existing algorithms were developed using supervised training, which requires time-intensive manual labeling and prevents the model from detecting unaware lesions. As such, this study proposes a weakly supervised learning network based on CycleGAN for lesions segmentation in full-width optical coherence tomography (OCT) images. The model was trained to reconstruct underlying normal anatomic structures from abnormal input images, then the lesions can be detected by calculating the difference between the input and output images. A customized network architecture and a multi-scale similarity perceptual reconstruction loss were used to extend the CycleGAN model to transfer between objects exhibiting shape deformations. The proposed technique was validated using an open-source retinal OCT image dataset. Image-level anomaly detection and pixel-level lesion detection results were assessed using area-under-curve (AUC) and the Dice similarity coefficient, producing results of 96.94% and 0.8239, respectively, higher than all comparative methods. The average test time required to generate a single full-width image was 0.039 s, which is shorter than that reported in recent studies. These results indicate that our model can accurately detect and segment retinopathy lesions in real-time, without the need for supervised labeling. And we hope this method will be helpful to accelerate the clinical diagnosis process and reduce the misdiagnosis rate.
2 March 2022 in Translational Vision Science & Technology
Purpose: The purpose of this study was to design an automated algorithm that can detect fluorescence leakage accurately and quickly without the use of a large amount of labeled data. Methods: A weakly supervised learning-based method was proposed to detect fluorescein leakage without the need for manual annotation of leakage areas. To enhance the representation of the network, a residual attention module (RAM) was designed as the core component of the proposed generator. Moreover, class activation maps (CAMs) were used to define a novel anomaly mask loss to facilitate more accurate learning of leakage areas. In addition, sensitivity, specificity, accuracy, area under the curve (AUC), and dice coefficient (DC) were used to evaluate the performance of the methods. Results: The proposed method reached a sensitivity of 0.73 ± 0.04, a specificity of 0.97 ± 0.03, an accuracy of 0.95 ± 0.05, an AUC of 0.86 ± 0.04, and a DC of 0.87 ± 0.01 on the HRA data set; a sensitivity of 0.91 ± 0.02, a specificity of 0.97 ± 0.02, an accuracy of 0.96 ± 0.03, an AUC of 0.94 ± 0.02, and a DC of 0.85 ± 0.03 on Zhao's publicly available data set; and a sensitivity of 0.71 ± 0.04, a specificity of 0.99 ± 0.06, an accuracy of 0.87 ± 0.06, an AUC of 0.85 ± 0.02, and a DC of 0.78 ± 0.04 on Rabbani's publicly available data set. Conclusions: The experimental results showed that the proposed method achieves better performance on fluorescence leakage detection and can detect one image within 1 second and thus has great potential value for clinical diagnosis and treatment of retina-related diseases, such as diabetic retinopathy and malarial retinopathy. Translational Relevance: The proposed weakly supervised learning-based method that automates the detection of fluorescence leakage can facilitate the assessment of retinal-related diseases.
The adaptive optics (AO) technique is widely used to compensate for ocular aberrations and improve imaging resolution. However, when affected by intraocular scatter, speckle noise, and other factors, the quality of the retinal image will be degraded. To effectively improve the image quality without increasing the imaging system’s complexity, the post-processing method of image deblurring is adopted. In this study, we proposed a conditional adversarial network-based method for directly learning an end-to-end mapping between blurry and restored AO retinal images. The proposed model was validated on synthetically generated AO retinal images and real retinal images. The restoration results of synthetic images were evaluated with the metrics of peak signal-to-noise ratio (PSNR), structural similarity (SSIM), perceptual distance, and error rate of cone counting. Moreover, the blind image quality index (BIQI) was used as the no-reference image quality assessment (NR-IQA) algorithm to evaluate the restoration results on real AO retinal images. The experimental results indicate that the images restored by the proposed method have sharper quality and higher signal-to-noise ratio (SNR) when compared with other state-of-the-art methods, which has great practical significance for clinical research and analysis.
Background and objective. Optical coherence tomography (OCT) is one of the most used retinal imaging modalities in the clinic as it can provide high-resolution anatomical images. The huge number of OCT images has significantly advanced the development of deep learning methods for automatic lesion detection to ease the doctor’s workload. However, it has been frequently revealed that the deep neural network model has difficulty handling the domain discrepancies, which widely exist in medical images captured from different devices. Many works have been proposed to solve the domain shift issue in deep learning tasks such as disease classification and lesion segmentation, but few works focused on lesion detection, especially for OCT images. Methods. In this work, we proposed a faster-RCNN based, unsupervised domain adaptation model to address the lesion detection task in cross-device retinal OCT images. The domain shift is minimized by reducing the image-level shift and instance-level shift at the same time. We combined a domain classifier with a Wasserstein distance critic to align the shifts at each level. Results. The model was tested on two sets of OCT image data captured from different devices, obtained an average accuracy improvement of more than 8% over the method without domain adaptation, and outperformed other comparable domain adaptation methods. Conclusion. The results demonstrate the proposed model is more effective in reducing the domain shift than advanced methods.
Traditional plenoptic wavefront sensors (PWFS) suffer from the obvious step change of the slope response, leading to poor wavefront detection performance. In order to solve this problem, in this paper, a deep learning model is proposed to restore phase maps directly from slope measurements of PWFS. Numerical simulations are employed to demonstrate our approach, and the statistical residual wavefront root mean square error (RMSE) of our method is 0.0810 ± 0.0258λ, which is much superior to those of modal algorithm (0.2511 ± 0.0587λ) and zonal approach (0.3584 ± 0.0487λ). The internal driving force of PWFS-ResUnet is investigated, and the slope response differences between sub-apertures and directions are considered as a probably key role to help our model to accurately restore the phase map. Additionally, the robustness of our model to turbulence strength and signal-to-noise ratio (SNR) level is also tested. The proposed method provides a new direction to solve the nonlinear problem of traditional PWFS.