Chromosome karyotype analysis is of great clinical importance in the diagnosis and treatment of diseases. Since manual analysis is highly time and effort consuming, computer-assisted automatic chromosome karyotype analysis based on images is routinely used to improve the efficiency and accuracy of the analysis. However, the strip-shaped chromosomes easily overlap each other when imaged, significantly affecting the accuracy of the subsequent analysis and hindering the development of chromosome analysis instruments. In this paper, we present an adversarial, multiscale feature learning framework to improve the accuracy and adaptability of overlapping chromosome segmentation. We first adopt the nested U-shaped network with dense skip connections as the generator to explore the optimal representation of the chromosome images by exploiting multiscale features. Then we use the conditional generative adversarial network (cGAN) to generate images similar to the original ones; the training stability of the network is enhanced by applying the least-square GAN objective. Finally, we replace the common cross-entropy loss with the advanced Lovász-Softmax loss to improve the model’s optimization and accelerate the model’s convergence. Comparing with the established algorithms, the performance of our framework is proven superior by using public datasets in eight evaluation criteria, showing its great potential in overlapping chromosome segmentation.
Acute leukemia (AL) is one of the top life-threatening diseases. Accurate typing of AL can significantly improve its prognosis. However, conventional methods for AL typing often require cell staining, which is time-consuming and labor-intensive. Furthermore, their performance is highly limited by the specificity and availability of fluorescent labels, which can hardly meet the requirements of AL typing in clinical settings. Here, we demonstrate AL typing by intelligent optical time-stretch (OTS) imaging flow cytometry on a microfluidic chip. Specifically, we employ OTS microscopy to capture the images of cells in clinical bone marrow samples with a spatial resolution of 780 nm at a high flowing speed of 1 m s−1 in a label-free manner. Then, to show the clinical utility of our method for which the features of clinical samples are diverse, we design and construct a deep convolutional neural network (CNN) to analyze the cellular images and determine the AL type of each sample. We measure 30 clinical samples composed of 7 acute lymphoblastic leukemia (ALL) samples, 17 acute myelogenous leukemia (AML) samples, and 6 samples from healthy donors, resulting in a total of 227 620 images acquired. Results show that our method can distinguish ALL and AML with an accuracy of 95.03%, which, to the best of our knowledge, is a record in label-free AL typing. In addition to AL typing, we believe that the high throughput, high accuracy, and label-free operation of our method make it a potential solution for cell analysis in scientific research and clinical settings.
We optimized the microfluidic chip of imaging flow cytometry by setting horizontal connections; By OTS microscopy, cells can be imaged at 40 m s−1in our device.
Sequentially timed all-optical mapping photography (STAMP) is a promising technology for observing ultrafast phenomena. Increasing the frame number during one shot is critical to enhance the capability of STAMP, but the rearrangement of the frames significantly intensifies the complexity of the system. In this work, we design a spectrum-slicing method, allowing for the separation and arrangement of the frames simultaneously in a two-dimensional manner. The experimental results show that our system can capture 25 images in one shot with a spatial resolution of 2.46 μm and a frame rate of 2.5 Tfps, indicating its potential for the observation of highly dynamic events.
Multiple myeloma (MM) is a type of blood cancer where plasma cells abnormally multiply and crowd out regular blood cells in the bones. Automated analysis of bone marrow smear examination is considered promising to improve the performance and reduce the labor cost in MM diagnosis. To address the drawbacks in established methods, which mainly aim at identifying monoclonal plasma cells (monoclonal PCs) via binary classification, in this work, considering that monoclonal PCs is not the only basis in MM diagnosis, for the first we construct a multi-object detection model for MM diagnosis. The experimental results show that our model can handle the images at a throughput of 80 slides/s and identify six lineages of bone marrow cells with an average accuracy of 90.8%. This work makes a step further toward full-automatic and high-efficiency MM diagnosis.