11 July 2024 in IEEE Transactions on Intelligent Transportation Systems
Detecting driver fatigue is critical for ensuring traffic safety. Electroencephalography (EEG) is the golden standard for brain activity measurement and is considered a good indicator of detecting driver fatigue. However, the current driver fatigue detection algorithm has limitations in mining and fusing the spatiotemporal characteristics of EEG signals. In this paper, we propose a multi-branch deep learning network named spatio-temporal fusion network with brain region partitioning strategy (STFN-BRPS) to improve the accuracy and robustness of driver fatigue recognition. Initially, we develop a recurrent multi-scale convolution module (RMSCM) comprising a multi-scale convolution sub-module, a CNN-Bi-LSTM sub-module, and a residual structure branch. RMSCM effectively extracts highly discriminative long short-term temporal feature information. Secondly, we propose a dynamic graph convolution module and a spatial graph edges’ importance weight assignment method based on brain region partitioning strategy, which can acquire intrinsic spatial feature information between electrodes. Thirdly, we design a feature fusion module (FFM) that utilizes channel attention to fuse long short-term temporal and spatial features. FFM learns and prioritizes the significance and relevance of each channel in the fused features. Finally, the fused spatio-temporal features are passed into the classification module to obtain the predicted driver fatigue state. Extensive comparison and ablation studies are conducted on EEG signals collected from real-world driving scenarios. The results demonstrate that the proposed STFN-BRPS model delivers superior classification performance compared to the mainstream methods. This study establishes a benchmark for EEG-based driver fatigue detection and related deep-learning modeling work.
25 July 2019 in IEEE Transactions on Industrial Electronics
This article presents a sequential fusion approach for state estimation of networked multisensor nonlinear systems, where sensors and estimators are allowed to work asynchronously. Both sequential measurement fusion (SMF) and sequential state fusion (SSF) estimators are designed, where the unscented filtering method is used in the design of the local SMF estimator, and the matrix weighting method is applied in the design of the SSF estimator. It is shown that the proposed SSF estimators provide a satisfactory estimation precision that is close to the centralized batch state fusion (BSF) estimator, while requiring smaller computation burden as compared with the BSF estimator. Both simulations and experiments of a moving target tracking system are presented to show the effectiveness of the proposed sequential fusion methods.
26 November 2019 in IEEE Transactions on Industrial Informatics
This paper is concerned with the multisensor fusion estimation for target tracking with range-only wireless sensor networks (WSNs). By employing a nonlinear transformation and a measurement fusion, the nonlinear distance measurements are transformed into a linear measurement with respect to the position of the target, which avoids the instability problem of nonlinear filtering. However, after the transformation, the new measurement noises are no longer Gaussian and cross-uncorrelated. Taking the unmodeled disturbances into account, as well as the new noise properties, an adaptive factor is introduced by hypothesis test based on the posterior residual to improve the estimation performance, where only the root of a quadratic equation is required to be solved. Finally, both simulations and experiments of a target tracking example are presented to show the effectiveness of the proposed methods.
28 October 2024 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Effectively integrating the time-space-frequency information of multi-modal signals from armband sensor, including surface electromyogram (sEMG) and accelerometer data, is critical for accurate gesture recognition. Existing approaches often neglect the abundant spatial relationships inherent in multi-channel sEMG signals obtained via armband sensors and face challenges in harnessing the correlations across multiple feature domains. To address this issue, we propose a novel multi-feature fusion network with spatial partitioning strategy and cross-attention (MFN-SPSCA) to improve the accuracy and robustness of gesture recognition. Specifically, a spatiotemporal graph convolution module with a spatial partitioning strategy is designed to capture potential spatial feature of multi-channel sEMG signals. Additionally, we design a cross-attention fusion module to learn and prioritize the importance and correlation of multi-feature domain. Extensive experiment demonstrate that the MFN-SPSCA method outperforms other state-of-the-art methods on self-collected dataset and the Ninapro DB5 dataset. Our work addresses the challenge of recognizing gestures from the multi-modal data collected by armband sensor, emphasizing the importance of integrating time-space-frequency information. Codes are available at https://github.com/ZJUTofBrainIntelligence/MFN-SPSCA.
30 January 2019 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
6 July 2018 in IEEE Transactions on Aerospace and Electronic Systems
This paper presents an adaptive sequential fusion estimation method for the target tracking with nonsynchronous measurements in wireless sensor networks (WSNs). Based on Gaussian assumption and Bayesian inference, a sequential cubature Kalman filtering (SCKF) method, as well as its square root form (SR-SCKF), is presented by applying the cubature rule to approximate the function × Gaussian integrals. By taking into consideration the time-varying properties of the measurement noise and the linearization errors, some adaptive factors are introduced into the SCKF to compensate for the measurement uncertainties based on Chi-square tests. The convergence analysis of the SCKF is presented. It is proved that the adaptive SCKF (ASCKF) has a better convergence property than the SCKF. Both simulations and experiments of a target tracking example are presented to show the effectiveness and superiority of the proposed ASCKF method.