The vestibular system is the sensory apparatus that helps the body maintain its postural equilibrium, and semicircular canal is an important organ of the vestibular system. The semicircular canals are three membranous tubes, each forming approximately two‐thirds of a circle with a diameter of approximately 6.5 mm, and segmenting them accurately is of great benefit for auxiliary diagnosis, surgery, and treatment of vestibular disease. However, the semicircular canal has small volume, which accounts for less than 1% of the overall computed tomography image. Doctors have to annotate the image in a slice‐by‐slice manner, which is time‐consuming and labor‐intensive. To solve this problem, we propose a novel 3D convolutional neural network based on 3D U‐Net to automatically segment the semicircular canal. We added the spatial attention mechanism of 3D spatial squeeze and excitation modules, as well as channel attention mechanism of 3D global attention upsample modules to improve the network performance. Our network achieved an average dice coefficient of 92.5% on the test dataset, which shows competitive performance in semicircular canals segmentation task.
4 August 2021 in IEEE Journal of Biomedical and Health Informatics
Accompanied with the rapid increase of the demand for routine examination of leucorrhea, efficiency and accuracy become the primary task. However, in super depth of field (SDoF) system, the problem of automatic detection and localization of cells in leucorrhea micro-images is still a big challenge. The changing of the relative position between the cell center and focus plane of microscope lead to variable cell morphological structure in the two-dimensional image, which is an important reason for the low accuracy of current deep learning target detection algorithms. In this paper, an object detection method based on Retinanet in state of super depth of field is proposed, which can achieve high precision detecting of leucorrhea components by the SDoF feature aggregation module. Compared with the current mainstream algorithms, the mean average accuracy (mAP) index has been improved significantly, the mAP index is 82.7% for SDoF module and 83.0% for SDoF+ module, with an average increase of more than 10%. These improved features can significantly improve the efficiency and accuracy of the algorithm. The algorithm proposed in this paper can be integrated into the leucorrhea automatic detection system.
Quantitative phase imaging and measurement of surface topography and fluid dynamics for objects, especially for moving objects, is critical in various fields. Although effective, existing synchronous phase-shifting methods may introduce additional phase changes in the light field due to differences in optical paths or need specific optics to implement synchronous phase-shifting, such as the beamsplitter with additional anti-reflective coating and a micro-polarizer array. Therefore, we propose a synchronous phase-shifting method based on the Mach–Zehnder interferometer to tackle these issues in existing methods. The proposed method uses common optics to simultaneously acquire four phase-shifted digital holograms with equal optical paths for object and reference waves. Therefore, it can be used to reconstruct the phase distribution of static and dynamic objects with high precision and high resolution. In the experiment, the theoretical resolution of the proposed system was 1.064 µm while the actual resolution could achieve 1.381 µm, which was confirmed by measuring a phase-only resolution chart. Besides, the dynamic phase imaging of a moving standard object was completed to verify the proposed system’s effectiveness. The experimental results show that our proposed method is suitable and promising in dynamic phase imaging and measurement of moving objects using phase-shifting digital holography.
Vaginitis is a prevalent gynecologic disease that threatens millions of women’s health. Although microscopic examination of vaginal discharge is an effective method to identify vaginal infections, manual analysis of microscopic leucorrhea images is extremely time-consuming and labor-intensive. To automate the detection and identification of visible components in microscopic leucorrhea images for early-stage diagnosis of vaginitis, we propose a novel end-to-end deep learning-based cells detection framework using attention-based detection with transformers (DETR) architecture. The transfer learning was applied to speed up the network convergence while maintaining the lowest annotation cost. To address the issue of detection performance degradation caused by class imbalance, the weighted sampler with on-the-fly data augmentation module was integrated into the detection pipeline. Additionally, the multi-head attention mechanism and the bipartite matching loss system of the DETR model perform well in identifying partially overlapping cells in real-time. With our proposed method, the pipeline achieved a mean average precision (mAP) of 86.00% and the average precision (AP) of epithelium, leukocyte, pyocyte, mildew, and erythrocyte was 96.76, 83.50, 74.20, 89.66, and 88.80%, respectively. The average test time for a microscopic leucorrhea image is approximately 72.3 ms. Currently, this cell detection method represents state-of-the-art performance.
Microscopic laser engraving surface defect classification plays an important role in the industrial quality inspection field. The key challenges of accurate surface defect classification are the complete description of the defect and the correct distinction into categories in the feature space. Traditional classification methods focus on the terms of feature extraction and independent classification; therefore, feed handcrafted features may result in useful feature loss. In recent years, convolutional neural networks (CNNs) have achieved excellent results in image classification tasks with the development of deep learning. Deep convolutional networks integrate feature extraction and classification into self-learning, but require large datasets. The training datasets for microscopic laser engraving image classification are small; therefore, we used pre-trained CNN models and applied two fine-tuning strategies. Transfer learning proved to perform well even on small future datasets. The proposed method was evaluated on the datasets consisting of 1986 laser engraving images captured by a metallographic microscope and annotated by experienced staff. Because handcrafted features were not used, our method is more robust and achieves better results than traditional classification methods. Under five-fold-validation, the average accuracy of the best model based on DenseNet121 is 96.72%.
27 February 2022 in Journal of Healthcare Engineering
Vaginitis is a gynecological disease affecting the health of millions of women all over the world. The traditional diagnosis of vaginitis is based on manual microscopy, which is time-consuming and tedious. The deep learning method offers a fast and reliable solution for an automatic early diagnosis of vaginitis. However, deep neural networks require massive well-annotated data. Manual annotation of microscopic images is highly cost extensive because it not only is a time-consuming process but also needs highly trained people (doctors, pathologists, or technicians). Most existing active learning approaches are not applicable in microscopic images due to the nature of complex backgrounds and numerous formed elements. To address the problem of high cost of labeling microscopic images, we present a data-efficient framework for the identification of vaginitis based on transfer learning and active learning strategies. The proposed informative sample selection strategy selected the minimal training subset, and then the pretrained convolutional neural network (CNN) was fine-tuned on the selected subset. The experiment results show that the proposed pipeline can save 37.5% annotation cost while maintaining competitive performance. The proposed promising novel framework can significantly save the annotation cost and has the potential of extending widely to other microscopic imaging applications, such as blood microscopic image analysis.