15 October 2021 in IEEE Transactions on Cybernetics
Understanding the private car aggregation effect is conducive to a broad range of applications, from intelligent transportation management to urban planning. However, this work is challenging, especially on weekends, due to the inefficient representations of spatiotemporal features for such aggregation effect and the considerable randomness of private car mobility on weekends. In this article, we propose a deep learning framework for a spatiotemporal attention network (STANet) with a neural algorithm logic unit (NALU), the so-called STANet-NALU, to understand the dynamic aggregation effect of private cars on weekends. Specifically: 1) we design an improved kernel density estimator (KDE) by defining a log-cosh loss function to calculate the spatial distribution of the aggregation effect with guaranteed robustness and 2) we utilize the stay time of private cars as a temporal feature to represent the nonlinear temporal correlation of the aggregation effect. Next, we propose a spatiotemporal attention module that separately captures the dynamic spatial correlation and nonlinear temporal correlation of the private car aggregation effect, and then we design a gate control unit to fuse spatiotemporal features adaptively. Further, we establish the STANet-NALU structure, which provides the model with numerical extrapolation ability to generate promising prediction results of the private car aggregation effect on weekends. We conduct extensive experiments based on real-world private car trajectories data. The results reveal that the proposed STANet-NALU outperforms the well-known existing methods in terms of various metrics, including the mean absolute error (MAE), root mean square error (RMSE), Kullback–Leibler divergence (KL), and R2.
4 October 2021 in IEEE Transactions on Cybernetics
Convolutional neural networks (CNNs) have achieved remarkable performance in driver drowsiness detection based on the extraction of deep features of drivers’ faces. However, the performance of driver drowsiness detection methods decreases sharply when complications, such as illumination changes in the cab, occlusions and shadows on the driver’s face, and variations in the driver’s head pose, occur. In addition, current driver drowsiness detection methods are not capable of distinguishing between driver states, such as talking versus yawning or blinking versus closing eyes. Therefore, technical challenges remain in driver drowsiness detection. In this article, we propose a novel and robust two-stream spatial–temporal graph convolutional network (2s-STGCN) for driver drowsiness detection to solve the above-mentioned challenges. To take advantage of the spatial and temporal features of the input data, we use a facial landmark detection method to extract the driver’s facial landmarks from real-time videos and then obtain the driver drowsiness detection result by 2s-STGCN. Unlike existing methods, our proposed method uses videos rather than consecutive video frames as processing units. This is the first effort to exploit these processing units in the field of driver drowsiness detection. Moreover, the two-stream framework not only models both the spatial and temporal features but also models both the first-order and second-order information simultaneously, thereby notably improving driver drowsiness detection. Extensive experiments have been performed on the yawn detection dataset (YawDD) and the National TsingHua University drowsy driver detection (NTHU-DDD) dataset. The experimental results validate the feasibility of the proposed method. This method achieves an average accuracy of 93.4% on the YawDD dataset and an average accuracy of 92.7% on the evaluation set of the NTHU-DDD dataset.
1 January 2019 in Knowledge-Based Systems
2 March 2022 in IEEE Journal on Selected Areas in Communications
In this paper, we investigate the precoder design for multiple-input multiple-output (MIMO) dual-functional radar-communication (DFRC) system with one-bit digital-to-analog converters (DACs). In order to form the dual-functional beam-pattern, we formulate the precoding problem as a weighted optimization problem with the constant modulus constraint, which aims at minimizing the average error power and guaranteeing radar waveform similarity. The problem is divided into three sub-problems corresponding to the multiple variables, i.e., the precoding factor, transmit signal matrix, and radar waveform matrix. Due to the discrete and non-convex properties of the optimization problem, we propose a multi-variable alternating minimization (MVAM) framework to achieve the near-optimal solutions. The precoding factor and radar waveform can be solved in closed-forms. For the transmit signal matrix, we devise a binary particle swarm optimization-simulated annealing (BPSO-SA) algorithm to obtain it under the MVAM framework. Extensive simulations validate the effectiveness of the proposed approach under various scenarios, including the case without perfect channel state information. The simulation results show that, compared with existing non-linear precoders, the proposed approach achieves 7dB SNR gain at the bit error rate of 10 −4 in the 8-antenna system, and the gain of SNR is 0.2dB in the massive MIMO system with 128 antennas.
20 April 2021 in IEEE Transactions on Intelligent Transportation Systems
Vehicle trajectory collection usually faces challenges such as inaccurate and incomplete trajectory data, mainly due to missing trajectories caused by Global Navigation Satellite System (GNSS) outages. In this paper, a novel ensemble transfer regression framework is proposed for urban environments with transfer learning as the primary solution for constructing a fine-grained trajectory dataset during GNSS outages. First, GNSS and motion information are fused for the training process. Then, a regression-to-classification (R2C) process is employed to implement incremental training to adapt to dynamically changing environments. Third, to account for GNSS outages, transfer learning is integrated to construct a data filtering strategy that minimizes negative sample weights during the current scenario. Finally, a more accurate classification-type loss function for ensemble learning is designed to obtain the ensemble transfer regression model. We utilize real-world datasets to verify the accuracy of the comparative methods and the proposed framework in trajectory interpolation prediction. The experimental results show that our framework is significantly superior to the comparative methods.
1 May 2018 in Information Fusion