In the field of regenerative medicine, tremendous numbers of cells are necessary for tissue/organ regeneration. Today automatic cell-culturing system has been developed. The next step is constructing a non-invasive method to monitor the conditions of cells automatically. As an image analysis method, convolutional neural network (CNN), one of the deep learning method, is approaching human recognition level. We constructed and applied the CNN algorithm for automatic cellular differentiation recognition of myogenic C2C12 cell line. Phase-contrast images of cultured C2C12 are prepared as input dataset. In differentiation process from myoblasts to myotubes, cellular morphology changes from round shape to elongated tubular shape due to fusion of the cells. CNN abstract the features of the shape of the cells and classify the cells depending on the culturing days from when differentiation is induced. Changes in cellular shape depending on the number of days of culture (Day 0, Day 3, Day 6) are classified with 91.3% accuracy. Image analysis with CNN has a potential to realize regenerative medicine industry.
12 July 2004 in Angewandte Chemie International Edition
It is known that single or isolated tumor cells enter cancer patients’ circulatory systems. These circulating tumor cells (CTCs) are thought to be an effective tool for diagnosing cancer malignancy. However, handling CTC samples and evaluating CTC sequence analysis results are challenging. Recently, the convolutional neural network (CNN) model, a type of deep learning model, has been increasingly adopted for medical image analyses. However, it is controversial whether cell characteristics can be identified at the single-cell level by using machine learning methods. This study intends to verify whether an AI system could classify the sensitivity of anticancer drugs, based on cell morphology during culture. We constructed a CNN based on the VGG16 model that could predict the efficiency of antitumor drugs at the single-cell level. The machine learning revealed that our model could identify the effects of antitumor drugs with ~0.80 accuracies. Our results show that, in the future, realizing precision medicine to identify effective antitumor drugs for individual patients may be possible by extracting CTCs from blood and performing classification by using an AI system.
Comprehensive imaging of a biological individual can be achieved by utilizing the variation in spatial resolution, the scale of cathodoluminescence (CL), and near-infrared (NIR), as favored by imaging probe Gd2O3 co-doped lanthanide nanophosphors (NPPs). A series of Gd2O3:Ln3+/Yb3+ (Ln3+: Tm3+, Ho3+, Er3+) NPPs with multispectral emission are prepared by the sol-gel method. The NPPs show a wide range of emissions spanning from the visible to the NIR region under 980 nm excitation. The dependence of the upconverting (UC)/downconverting (DC) emission intensity on the dopant ratio is investigated. The optimum ratios of dopants obtained for emissions in the NIR regions at 810 nm, 1200 nm, and 1530 nm are applied to produce nanoparticles by the homogeneous precipitation (HP) method. The nanoparticles produced from the HP method are used to investigate the dual NIR and CL imaging modalities. The results indicate the possibility of using Gd2O3 co-doped Ln3+/Yb3+ (Ln3+: Tm3+, Ho3+, Er3+) in correlation with NIR and CL imaging. The use of Gd2O3 promises an extension of the object dimension to the whole-body level by employing magnetic resonance imaging (MRI).
Semantic segmentation with deep learning to extract nerves from label-free endoscopic images obtained using coherent anti-Stokes Raman scattering (CARS) for nerve-sparing surgery is described. We developed a CARS rigid endoscope in order to identify the exact location of peripheral nerves in surgery. Myelinated nerves are visualized with a CARS lipid signal in a label-free manner. Because the lipid distribution includes other tissues as well as nerves, nerve segmentation is required to achieve nerve-sparing surgery. We propose using U-Net with a VGG16 encoder as a deep learning model and pre-training with fluorescence images, which visualize the lipid distribution similar to CARS images, before fine-tuning with a small dataset of CARS endoscopy images. For nerve segmentation, we used 24 CARS and 1,818 fluorescence nerve images of three rabbit prostates. We achieved label-free nerve segmentation with a mean accuracy of 0.962 and an value of 0.860. Pre-training on fluorescence images significantly improved the performance of nerve segmentation in terms of the mean accuracy and value ( ). Nerve segmentation of label-free endoscopic images will allow for safer endoscopic surgery, while reducing dysfunction and improving prognosis after surgery.
Bioimaging probes, which can emit near-infrared (NIR) light and are excitable with NIR light, are promising for deep tissue imaging in vivo. Lanthanide-doped phosphors, such as Y2O3:Tm,Yb; Y2O3:Ho,Yb; and Y2O3:Er,Yb, are candidates for the probes. We enhanced the NIR emission of the three kinds of lanthanide-doped phosphor by using Li-ion doping. The probes were applied to cellular imaging. Bioimaging probes which can emit near-infrared (NIR) light and excitable with NIR light is promising for deep tissue imaging in vivo. Lanthanide-doped phosphor probe, such as Y2O3:Tm,Yb; Y2O3:Ho,Yb; Y2O3:Er,Yb, are candidates for the probes. We enhanced the NIR emission of the three kinds of lanthanide-doped phosphor by using Li-ion doping. And the probes are applied to cellular imaging.