Precise characterization and analysis of corneal nerve fiber tortuosity are of great importance in facilitating examination and diagnosis of many eye-related diseases. In this paper we propose a fully automated method for image-level tortuosity estimation, comprising image enhancement, exponential curvature estimation, and tortuosity level classification. The image enhancement component is based on an extended Retinex model, which not only corrects imbalanced illumination and improves image contrast in an image, but also models noise explicitly to aid removal of imaging noise. Afterwards, we take advantage of exponential curvature estimation in the 3D space of positions and orientations to directly measure curvature based on the enhanced images, rather than relying on the explicit segmentation and skeletonization steps in a conventional pipeline usually with accumulated pre-processing errors. The proposed method has been applied over two corneal nerve microscopy datasets for the estimation of a tortuosity level for each image. The experimental results show that it performs better than several selected state-of-the-art methods. Furthermore, we have performed manual gradings at tortuosity level of four hundred and three corneal nerve microscopic images, and this dataset has been released for public access to facilitate other researchers in the community in carrying out further research on the same and related topics.
1 November 2017 in Engineering Applications of Artificial Intelligence
Accurate estimation and quantification of the corneal nerve fiber tortuosity in corneal confocal microscopy (CCM) is of great importance for disease understanding and clinical decision-making. However, the grading of corneal nerve tortuosity remains a great challenge due to the lack of agreements on the definition and quantification of tortuosity. In this paper, we propose a fully automated deep learning method that performs image-level tortuosity grading of corneal nerves, which is based on CCM images and segmented corneal nerves to further improve the grading accuracy with interpretability principles. The proposed method consists of two stages: 1) A pre-trained feature extraction backbone over ImageNet is fine-tuned with a proposed novel bilinear attention (BA) module for the prediction of the regions of interest (ROIs) and coarse grading of the image. The BA module enhances the ability of the network to model long-range dependencies and global contexts of nerve fibers by capturing second-order statistics of high-level features. 2) An auxiliary tortuosity grading network (AuxNet) is proposed to obtain an auxiliary grading over the identified ROIs, enabling the coarse and additional gradings to be finally fused together for more accurate final results. The experimental results show that our method surpasses existing methods in tortuosity grading, and achieves an overall accuracy of 85.64% in four-level classification. We also validate it over a clinical dataset, and the statistical analysis demonstrates a significant difference of tortuosity levels between healthy control and diabetes group. We have released a dataset with 1500 CCM images and their manual annotations of four tortuosity levels for public access. The code is available at: https://github.com/iMED-Lab/TortuosityGrading .
28 November 2023 in IEEE Transactions on Instrumentation and Measurement
Oil leakage inspection is critical to ensure the safety of substation operations. However, weak edges and irregular segmentation pose challenges in oil leakage inspection tasks. To address these challenges, this paper proposes a semantic segmentation network based on a dual graph reasoning mechanism, named as DGRNet. Firstly, the spatial graph reasoning (SpGR) branch learns edge detail information by modeling long-term dependencies between pixels and employs auxiliary losses to further improve edge awareness. Secondly, the semantic graph reasoning (SeGR) branch learns the global context by modeling the global relationships between regions and reinforces texture feature representations. Finally, the dual branch structure is adopted to optimize the fusion mechanism of deep features and shallow features, achieving accurate segmentation of the oil leakage area. The experimental results demonstrate that the proposed network achieves significant performance improvement on the custom substation equipment oil leakage segmentation dataset, surpassing classical semantic segmentation networks. The intersection over union (IOU) and the F1 score (F1) of oil leakage reach 73.77% and 84.91%, respectively, with the pixel accuracy (PA) reaching 92.19%.
The tortuosity assessment of vessels and nerve fibres in ophthalmic images has drawn substantial attention, for its potentials in assisting various medical diagnoses. Numerous morphological tortuosity measures have been leveraged to quantify tortuosity from various perspectives, which warrants the simultaneous use of multiple measures with an aim to produce a robust and accurate assessment. This paper proposes an approach for the automated assessment of curvilinear structures' tortuosity. Starting with the generation of clusters of tortuosity density for each individual measure, labelled fuzzy sets are then extracted that enhances the readability of subsequent operations. Finally, results from multiple measures are aggregated by a nearest neighbour guided approach where weights are generated in a data-driven manner to explain the derived aggregations. Experimental results on both ophthalmic vessel and nerve images demonstrate the superior performance of the proposed method over those where measurements are used independently or aggregated using conventional averaging operators.
4 February 2024 in International Journal of Machine Learning and Cybernetics