19 July 2019 in IEEE Journal of Biomedical and Health Informatics
The presence of hyperreflective foci (HFs) is related to retinal disease progression, and the quantity has proven to be a prognostic factor of visual and anatomical outcome in various retinal diseases. However, lack of efficient quantitative tools for evaluating the HFs has deprived ophthalmologist of assessing the volume of HFs. For this reason, we propose an automated quantification algorithm to segment and quantify HFs in spectral domain optical coherence tomography (SD-OCT). The proposed algorithm consists of two parallel processes namely: region of interest (ROI) generation and HFs estimation. To generate the ROI, we use morphological reconstruction (MR) to obtain the reconstructed image and histogram constructed for data distributions and clustering. In parallel, we estimate the HFs by extracting the extremal regions from the connected regions obtained from a component tree. Finally, both the ROI and the HFs estimation process are merged to obtain the segmented HFs. The proposed algorithm was tested on 40 3D SD-OCT volumes from 40 patients diagnosed with non-proliferative diabetic retinopathy (NPDR), proliferative diabetic retinopathy (PDR) and diabetic macular edema (DME). The average dice similarity coefficient (DSC) and correlation coefficient (r) are 69.70%, 0.99 for NPDR, 70.31%, 0.99 for PDR, and 71.30%, 0.99 for DME respectively. The proposed algorithm can provide ophthalmologist with good HFs quantitative information, such as volume, size and location of the HFs.
8 May 2017 in Scientific Reports
To investigate the correlations between hyper-reflective foci and hard exudates in patients with non-proliferative diabetic retinopathy (NPDR) and proliferative diabetic retinopathy (PDR) by spectral-domain optical coherence tomography (SD OCT) images. Hyper-reflective foci in retinal SD OCT images were automatically detected by the developed algorithm. Then, the cropped CFP images generated by the semi-automatic registration method were automatically segmented for the hard exudates and corrected by the experienced clinical ophthalmologist. Finally, a set of 5 quantitative imaging features were automatically extracted from SD OCT images, which were used for investigating the correlations of hyper-reflective foci and hard exudates and predicting the severity of diabetic retinopathy. Experimental results demonstrated the positive correlations in area and amount between hard exudates and hyper-reflective foci at different stages of diabetic retinopathy, with statistical significance (all p < 0.05). In addition, the area and amount can be taken as potential discriminant indicators of the severity of diabetic retinopathy.
1 July 2021 in IEEE Journal of Biomedical and Health Informatics
Retinal related diseases are the leading cause of vision loss, and severe retinal lesion causes irreversible damage to vision. Therefore, the automatic methods for retinal diseases detection based on medical images is essential for timely treatment. Considering that manual diagnosis and analysis of medical images require a large number of qualified experts, deep learning can effectively diagnosis and locate critical biomarkers. In this paper, we present a novel model by jointly optimize the cycle generative adversarial network (CycleGAN) and the convolutional neural network (CNN) to detect retinal diseases and localize lesion areas with limited training data. The CycleGAN with cycle consistency can generate more realistic and reliable images. The discriminator and the generator achieve a local optimal solution in an adversarial manner, and the generator and the classifier are in a cooperative manner to distinguish the domain of input images. A novel res-guided sampling block is proposed by combining learnable residual features and pixel-adaptive convolutions. A res-guided U-Net is constructed as the generator by substituting the traditional convolution with the res-guided sampling blocks. Our model achieve superior classification and localization performance on LAG, Ichallenge-PM and Ichallenge-AMD datasets. With clear localization for lesion areas, the competitive results reveal great potentials of the joint optimization network. The source code is available at https://github.com/jizexuan/JointOptmization.
8 September 2021 in Journal of Diabetes Research
Purpose. The objective of this study was to establish diagnostic technology to automatically grade the severity of diabetic retinopathy (DR) according to the ischemic index and leakage index with ultra-widefield fluorescein angiography (UWFA) and the Early Treatment Diabetic Retinopathy Study (ETDRS) 7-standard field (7-SF). Methods. This is a cross-sectional study. UWFA samples from 280 diabetic patients and 119 normal patients were used to train and test an artificial intelligence model to differentiate PDR and NPDR based on the ischemic index and leakage index with UWFA. A panel of retinal specialists determined the ground truth for our data set before experimentation. A confusion matrix as a metric was used to measure the precision of our algorithm, and a simple linear regression function was implemented to explore the discrimination of indexes on the DR grades. In addition, the model was tested with simulated 7-SF. Results. The model classification of DR in the original UWFA images achieved 88.50 accuracy and 73.68 accuracy in the simulated 7-SF images. A simple linear regression function demonstrated that there is a significant relationship between the ischemic index and leakage index and the severity of DR. These two thresholds were set to classify the grade of DR, which achieved 76.8 accuracy. Conclusions. The optimization of the cycle generative adversarial network (CycleGAN) and convolutional neural network (CNN) model classifier achieved DR grading based on the ischemic index and leakage index with UWFA and simulated 7-SF and provided accurate inference results. The classification accuracy with UWFA is slightly higher than that of simulated 7-SF.
17 July 2019 in Medical Physics
1 May 2018 in Computer Methods and Programs in Biomedicine