6 October 2021 in IEEE Transactions on Instrumentation and Measurement
Glioblastoma (GBM) tumor is the most common primary brain malignant tumor. The precise identification of GBM tumors is very important for diagnosis and treatment. Hyperspectral imaging is a fast, noncontact, accurate, and safe modern medical detection technology, which is expected to be a new tool of intraoperative diagnosis. In order to make full use of the spectral and spatial information of hyperspectral images (HSIs) to achieve accurate GBM tumor identification, a method based on the fusion of multiple deep models is proposed for in vivo human brain HSI classification. The proposed method includes the following major steps: 1) spectral phasor analysis and data oversampling; 2) 1-D deep neural network (1D-DNN)-based spectral HSI feature extraction and classification; 3) 2-D convolution neural network (2D-CNN)-based spectral–spatial HSI feature extraction and classification; 4) edge-preserving filtering-based classification result fusion and optimization; and 5) fully convolutional network (FCN)-based background segmentation. To verify the capabilities of the proposed method, experiments are performed on two real human brain hyperspectral datasets, including 36 in vivo HSIs captured from 16 different patients. The proposed method can achieve an overall accuracy of 96.69% for four-class classification and overall accuracy of 96.34% for GBM tumor identification. Experimental results demonstrate that the proposed method exhibits competitive classification performance and can generate satisfactory thematic maps of the location of the GBM tumor, which can provide the surgeon with guidance on successful and precise tumor resection.
2 April 2021 in IEEE Transactions on Instrumentation and Measurement
Real-time driving scene parsing using semantic segmentation is an essential yet challenging task for an autonomous driving system, where both efficiency and accuracy need to be considered simultaneously. In this article, we propose an efficient and high-performance deep neural network called feature selective fusion network (FSFnet) for robust semantic segmentation of road scenes. Since the complex driving scene parsing usually requires the fusion of features in different levels or scales, we propose a feature selective fusion module (FSFM) to adaptively merge these features by generating correlated weight maps in both spatial and channelwise. Furthermore, a multiscale context enhancement module is designed based on an asymmetric nonlocal neural network to aggregate both multiscale and global context information. The proposed FSFnet obtains precise segmentation results in real time on Cityscapes and CamVid data sets. Specifically, the architecture achieves 77.1% mean pixel intersection-over-union (mIoU) on the Cityscapes test set at a speed of 53 frames per second (FPS) for a $1024\times 2048$ input and 75.1% mIoU on the CamVid test set at a speed of 123 FPS for a $960\times 720$ input on a single NVIDIA 2080 TI GPU.