The classification of six types of white blood cells (WBCs) is considered essential for leukemia diagnosis, while the classification is labor-intensive and strict with the clinical experience. To relieve the complicated process with an efficient and automatic method, we propose the Attention-aware Residual Network based Manifold Learning model (ARML) to classify WBCs. The proposed ARML model leverages the adaptive attention-aware residual learning to exploit the category-relevant image-level features and strengthen the first-order feature representation ability. To learn more discriminatory information than the first-order ones, the second-order features are characterized. Afterwards, ARML encodes both the first- and second-order features with Gaussian embedding into the Riemannian manifold to learn the underlying non-linear structure of the features for classification. ARML can be trained in an end-to-end fashion, and the learnable parameters are iteratively optimized. 10800 WBCs images (1800 images for each type) is collected, 9000 images and five-fold cross-validation are used for training and validation of the model, while additional 1800 images for testing. The results show that ARML achieving average classification accuracy of 0.953 outperforms other state-of-the-art methods with fewer trainable parameters. In the ablation study, ARML achieves improved accuracy against its three variants: without manifold learning (AR), without attention-aware learning (RML), and AR without attention-aware learning. The t-SNE results illustrate that ARML has learned more distinguishable features than the comparison methods, which benefits the WBCs classification. ARML provides a clinically feasible WBCs classification solution for leukemia diagnose with an efficient manner.
Surgical smoke caused poor visibility during laparoscopic surgery, the smoke removal is important to improve the safety and efficiency of the surgery. We propose the Multilevel-feature-learning Attention-aware based Generative Adversarial Network for Removing Surgical Smoke (MARS-GAN) in this work. MARS-GAN incorporates multilevel smoke feature learning, smoke attention learning, and multi-task learning together. Specifically, the multilevel smoke feature learning adopts the multilevel strategy to adaptively learn non-homogeneity smoke intensity and area features with specific branches and integrates comprehensive features to preserve both semantic and textural information with pyramidal connections. The smoke attention learning extends the smoke segmentation module with the dark channel prior module to provide the pixel-wise measurement for focusing on the smoke features while preserving the smokeless details. And the multi-task learning strategy fuses the adversarial loss, cyclic consistency loss, smoke perception loss, dark channel prior loss, and contrast enhancement loss to help the model optimization. Furthermore, a paired smokeless/smoky dataset is synthesized for elevating smoke recognition ability. The experimental results show that MARS-GAN outperforms the comparative methods for removing surgical smoke on both synthetic/real laparoscopic surgical images, with the potential to be embedded in laparoscopic devices for smoke removal.
Clinically, red blood cell abnormalities are closely related to tumor diseases, red blood cell diseases, internal medicine, and other diseases. Red blood cell classification is the key to detecting red blood cell abnormalities. Traditional red blood cell classification is done manually by doctors, which requires a lot of manpower produces subjective results. This paper proposes an Attention-based Residual Feature Pyramid Network (ARFPN) to classify 14 types of red blood cells to assist the diagnosis of related diseases. The model performs classification directly on the entire red blood cell image. Meanwhile, a spatial attention mechanism and channel attention mechanism are combined with residual units to improve the expression of category-related features and achieve accurate extraction of features. Besides, the RoI align method is used to reduce the loss of spatial symmetry and improve classification accuracy. Five hundred and eighty eight red blood cell images are used to train and verify the effectiveness of the proposed method. The Channel Attention Residual Feature Pyramid Network (C-ARFPN) model achieves an mAP of 86%; the Channel and Spatial Attention Residual Feature Pyramid Network (CS-ARFPN) model achieves an mAP of 86.9%. The experimental results indicate that our method can classify more red blood cell types and better adapt to the needs of doctors, thus reducing the doctor's time and improving the diagnosis efficiency.