Infectious diseases have always been a major threat to the survival of humanity. Additionally, they bring an enormous economic burden to society. The conventional methods for bacteria identification are expensive, time-consuming and laborious. Therefore, it is of great importance to automatically rapidly identify pathogenic bacteria in a short time. Here, we constructed an AI-assisted system for automating rapid bacteria genus identification, combining the hyperspectral microscopic technology and a deep-learning-based algorithm Buffer Net. After being trained and validated in the self-built dataset, which consists of 11 genera with over 130,000 hyperspectral images, the accuracy of the algorithm could achieve 94.9%, which outperformed 1D-CNN, 2D-CNN and 3D-ResNet. The AI-assisted system we developed has great potential in assisting clinicians in identifying pathogenic bacteria at the single-cell level with high accuracy in a cheap, rapid and automatic way. Since the AI-assisted system can identify the pathogenic genus rapidly (about 30 s per hyperspectral microscopic image) at the single-cell level, it can shorten the time or even eliminate the demand for cultivating. Additionally, the system is user-friendly for novices.

Identifying infectious pathogens quickly and accurately is significant for patients and doctors. Identifying single bacterial strains is significant in eliminating culture and speeding up diagnosis. We present an advanced optical method for the rapid detection of infectious (including common and uncommon) pathogens by combining hyperspectral microscopic imaging and deep learning. To acquire more information regarding the pathogens, we developed a hyperspectral microscopic imaging system with a wide wavelength range and fine spectral resolution. Furthermore, an end-to-end deep learning network based on feature fusion, called BI-Net, was designed to extract the species-dependent features encoded in cell-level hyperspectral images as the fingerprints for species differentiation. After being trained based on a large-scale dataset that we built to identify common pathogens, BI-Net was used to classify uncommon pathogens via transfer learning. An extensive analysis demonstrated that BI-Net was able to learn species-dependent characteristics, with the classification accuracy and Kappa coefficients being 92% and 0.92, respectively, for both common and uncommon species. Our method outperformed state-of-the-art methods by a large margin and its excellent performance demonstrates its excellent potential in clinical practice.

In recent years, the incidence of thyroid cancer has rapidly increased. To address the issue of the inefficient diagnosis of thyroid cancer during surgery, we propose a rapid method for the diagnosis of benign and malignant thyroid nodules based on hyperspectral technology. Firstly, using our self-developed thyroid nodule hyperspectral acquisition system, data for a large number of diverse thyroid nodule samples were obtained, providing a foundation for subsequent diagnosis. Secondly, to better meet clinical practical needs, we address the current situation of medical hyperspectral image classification research being mainly focused on pixel-based region segmentation, by proposing a method for nodule classification as benign or malignant based on thyroid nodule hyperspectral data blocks. Using 3D CNN and VGG16 networks as a basis, we designed a neural network algorithm (V3Dnet) for classification based on three-dimensional hyperspectral data blocks. In the case of a dataset with a block size of 50 × 50 × 196, the classification accuracy for benign and malignant samples reaches 84.63%. We also investigated the impact of data block size on the classification performance and constructed a classification model that includes thyroid nodule sample acquisition, hyperspectral data preprocessing, and an algorithm for thyroid nodule classification as benign and malignant based on hyperspectral data blocks. The proposed model for thyroid nodule classification is expected to be applied in thyroid surgery, thereby improving surgical accuracy and providing strong support for scientific research in related fields.