5 November 2024 in IEEE Internet of Things Journal
As the Internet of Things (IoT) technology advances, human activity recognition (HAR) using IoT devices, including wearable sensors has become prevalent in various applications. Nevertheless, many sensor-based HAR methods still struggle to balance recognition accuracy with network complexity. Meanwhile, most existing sensor-based HAR networks fail to achieve an effective fusion of multidimensional features. To address the above issues, a hierarchical multiscale time-frequency and channel feature adaptive fusion (HMTF-CFAF) network is put forward. The HMTF-CFAF efficiently extracts unique multiscale time-frequency and channel features in sensor data using hierarchical connectivity. Furthermore, it incorporates a feature fusion mechanism to integrate and exchange multiscale and multidimensional features, providing more comprehensive and richer features. To evaluate the HMTF-CFAF network, we utilize three datasets: 1) the University of California Irvine HAR (UCI-HAR); 2) physical activity monitoring for aging people (PAMAP2); and 3) self-collected household behavior (HB) dataset. The HMTF-CFAF network achieves the accuracies of 97.66%, 98.75%, and 98.80% on the above three datasets, respectively, demonstrating its excellent performance.
11 November 2024 in IEEE Internet of Things Journal
Due to the flourishing of Internet of Things (IoT) technology, radar-based human activity recognition (HAR) technology has made significant progress and has become an indispensable research area. Many radar systems use multiple feature maps and handle them directly in image format. However, the generation of multiple forms of feature maps requires heavy computational resources, which makes it impractical for real-world applications. Additionally, many networks fail to fully extract temporal information from the time-Doppler (TD) map during the feature extraction. Therefore, a time-weighted network based on strip pooling (TWN-SP) using the TD map is proposed in this article. The TWN-SP consists of two time-weighted modules based on fire (TWMs-F) and a feature fusion module based on temporal and channel attention (FFM-TCA). Due to the application of depthwise separable convolution (DSC) and placing the feature fusion step at the forefront, the proposed network has fewer parameters. Moreover, a radar dataset named RadSet is constructed, containing TD maps of six daily activities. To validate the performance of the TWN-SP, a ten-fold cross-validation (CV) on the public dataset named Radar848 and a leave-one-subject-out (LOSO) CV on the RadSet dataset are carried out, respectively. To further validate the generalization performance of TWN-SP, a comparative analysis was conducted on another public dataset, Ci4R. The TWN-SP achieves an accuracy of 99.28% on the RadSet dataset. Experimental results indicate that the TWN-SP surpasses the current leading networks in both performance and complexity.
28 August 2025 in IEEE Sensors Journal
Recent years have witnessed the conspicuous prosperity of deep neural networks in sensor-based human activity recognition (HAR). Nonetheless, some existing HAR frameworks based on deep learning (DL) architectures still face challenges in effectively extracting valid features and adaptively capturing complex dynamic information. Accordingly, most of the methods struggle to classify confusable activities. To settle the above challenges, a novel HAR framework for multidimensional feature extraction and fusion based on aggregation and temporal adaptation (MFEF-ATA) is proposed in this paper. To construct the framework, initially, an aggregation transformation based dual path module (ATDPM) is developed. Besides, a module called ResTBM is presented, which is the residual connection of the temporal adaptive module (TAM) and bidirectional gated recurrent unit (Bi-GRU). Meanwhile, we construct a smart home activity (SHA) dataset to enrich the HAR sensor datasets from different application scenarios. The evaluation experiments of the MFEF-ATA framework are carried out on the wireless sensor data mining (WISDM) dataset, the University of California, Irvine HAR (UCI-HAR) dataset, and the SHA dataset. The experimental results show that the MFEF-ATA framework can derive better recognition performance than other state-of-the-art HAR frameworks with recognition accuracies of 99.12%, 97.77%, and 98.52% on the WISDM dataset, the UCI-HAR dataset, and the SHA dataset, respectively, which proves the effectiveness and superiority of the proposed framework.