4 January 2024 in IEEE Sensors Journal
Due to the irregular distribution of 3D point clouds and the random movement of the passengers, it is difficult to accurately and rapidly determine the passenger occupancy based on the multiple-input and multiple-output (MIMO) radar. In this study, we present a lightweight neural network, dubbed PTFNet, that fuses the PointNet and Transformer to quickly and accurately detect the occupancy of three rear seats and two footwells. PTFNet adapts an input transform block to encode the 3D point cloud directly, which makes it more lightweight than conventional voxelization, heatmap, and PointNet based algorithms. Meanwhile, a cross-attention mechanism block inspired by Transformer is employed to efficiently extract features from 3D point clouds, resulting in an improvement in detection accuracy. An in-cabin occupancy monitoring system is implemented in a real vehicle to obtain 3D point cloud datasets, which are then used to evaluate the detection performance of PTFNet. Our datasets cover both the rear seat area and the footwell area. The footwell space is considered for the first time in the point cloud datasets. The experimental results demonstrate that PTFNet outperforms other popular approaches in terms of detection accuracy by at least 1.6%, while the consumption of memory and running time are reduced by at least 44% and 34%, respectively.
13 December 2023 in IEEE Transactions on Instrumentation and Measurement
Overfitting and inadequate ability of feature extraction result in low classification accuracy when fulfilling hyperspectral image (HSI) classification tasks by deep learning models (DLMs). Unfortunately, it is very common that insufficient labeled training samples of HSI lead to overfitting and that redundant spectral information of HSI asks for high feature extraction ability in classification tasks. In general, reducing model complexity helps alleviate overfitting, whereas increasing the number of convolutional layers and kernel size helps enhance feature extraction ability. Designing DLMs for better classification accuracy requires balancing model complexity and feature extraction ability. To achieve this balance, we present a network model of differential self-feedback dilated convolution with dual-tree channel attention mechanism (DSDC-DCAM) model. In this model, a differential self-feedback dilated convolution (DSDC) block is proposed with high extraction ability and low model complexity by connecting 3-D dilated convolutions and the differential self-feedback (DSF) module as a tree structure. A dual-tree channel attention mechanism (DCAM) block is also proposed in DSDC-DCAM to form a better attention mechanism in order to exploit useful features and suppress unfavorable ones while reducing model complexity. Experimental results show that DSDC-DCAM has the best performance consistency compared with the other nine state-of-the-art models, indicating that it is least influenced by overfitting. Meanwhile, the results show that DSDC-DCAM achieves the highest overall accuracy (OA) with a smaller number of model parameters than the other seven models.