Sensor-based human activity recognition (HAR) has attracted enormous interests due to its wide applications in the Internet of Things (IoT), smart homes and healthcare. In this paper, a low-resolution infrared array sensor-based HAR approach is proposed using the deep learning framework. The device-free sensing system leverages the infrared array sensor of pixels to collect the infrared signals, which can ensure users’ privacy and effectively reduce the deployment cost of the network. To reduce the influence of temperature variations, a combination of the J-filter noise reduction method and the Butterworth filter is performed to preprocess the infrared signals. Long short-term memory (LSTM), a representative recurrent neural network, is utilized to automatically extract characteristics from the infrared signal and build the recognition model. In addition, the real-time HAR interface is designed by embedding the LSTM model. Experimental results show that the typical daily activities can be classified with the recognition accuracy of 98.287%. The proposed approach yields a better result compared to the existing machine learning methods, and it provides a low-cost yet promising solution for privacy-preserving scenarios.
10 February 2023 in IEEE Internet of Things Journal
Low-resolution infrared-based human activity recognition (HAR) attracted enormous interests due to its low cost and private. In this article, a novel semi-supervised cross-domain neural network (SCDNN) based on $8\times8$ low-resolution infrared sensor is proposed for accurately identifying human activity despite changes in the environment at a low cost. The SCDNN consists of feature extractor, domain discriminator, and label classifier. In the feature extractor, the unlabeled and minimal labeled target domain data are trained for domain adaptation to achieve a mapping of the source domain and target domain data. The domain discriminator employs the unsupervised learning to migrate data from the source domain to the target domain. The label classifier obtained from training the source domain data improves the recognition of target domain activities due to the semi-supervised learning utilized in training the target domain data. Experimental results show that the proposed method achieves 92.12% accuracy for recognition of activities in the target domain by migrating the source and target domains. The proposed approach adapts superior to cross-domain scenarios compared to the existing deep learning methods, and it provides a low cost yet highly adaptable solution for cross-domain scenarios.
26 February 2024 in IEEE Internet of Things Journal
Safety monitoring of power operations in power stations is crucial for preventing accidents and ensuring stable power supply. However, conventional methods such as wearable devices and video surveillance have limitations, such as high cost, dependence on light, and visual blind spots. WiFi-based human pose estimation is a suitable method for monitoring power operations due to its low cost, device-free, and robustness to various illumination conditions. In this article, a novel channel state information (CSI)-based pose estimation framework, namely, PowerSkel, is developed to address these challenges. PowerSkel utilizes self-developed CSI sensors to form a mutual sensing network and constructs a CSI acquisition scheme specialized for power scenarios. It significantly reduces the deployment cost and complexity compared to the existing solutions. To reduce interference with CSI in the electricity scenario, a sparse adaptive filtering algorithm is designed to preprocess the CSI. CKDformer, a knowledge distillation network based on collaborative learning and self-attention, is proposed to extract the features from CSI and establish the mapping relationship between CSI and keypoints. The experiments are conducted in a real-world power station, and the results show that the PowerSkel achieves high performance with a PCK@50 of 96.27% and realizes a significant visualization on pose estimation, even in dark environments. Our work provides a novel low-cost and high-precision pose estimation solution for power operation.
18 November 2023 in International Journal of Machine Learning and Cybernetics
Accurate and scalable indoor localization for uncrewed aerial vehicles (UAVs) is essential for Internet of Things (IoT) applications such as autonomous logistics, infrastructure inspection, and emergency response in GPS-denied environments. However, traditional methods often struggle with cost, deployment complexity, and sensitivity to environmental dynamics, limiting their practicality for large-scale IoT scenarios. This article presents a method in which channel state information (CSI) from low-cost IoT sensors enables robust, device-free 3-D UAV localization while optimizing accuracy, sensor adaptability, and data efficiency. We propose CiUAV, leveraging CSI captured by ESP32-S3 sensors, with a robust CSI signal enhancement (RCSE) framework integrating dynamic automatic gain control (AGC) compensation (DAC) and adaptive noise suppression and outlier removal (ANSOR), alongside a sensor-in-sample (SiS) multiobjective optimization (MOO) model for adaptive multisensor fusion. Experimental evaluations in realistic indoor settings achieve a 3-D root-mean-squared error (RMSE) of 0.2659 m, outperforming baselines by up to 35% in accuracy and 50% in data efficiency. CiUAV offers a lightweight, scalable, and infrastructure-compatible solution for future IoT-enabled UAV systems.