18 August 2021 in IEEE Transactions on Pattern Analysis and Machine Intelligence
With the development of signal processing technology, the ubiquitous Wi-Fi devices open an unprecedented opportunity to solve the challenging human gesture recognition problem by learning motion representations from wireless signals. Wi-Fi-based gesture recognition systems, although yield good performance on specific data domains, are still practically difficult to be used without explicit adaptation efforts to new domains. Various pioneering approaches have been proposed to resolve this contradiction but extra training efforts are still necessary for either data collection or model re-training when new data domains appear. To advance cross-domain recognition and achieve fully zero-effort recognition, we propose Widar3.0, a Wi-Fi-based zero-effort cross-domain gesture recognition system. The key insight of Widar3.0 is to derive and extract domain-independent features of human gestures at the lower signal level, which represent unique kinetic characteristics of gestures and are irrespective of domains. On this basis, we develop a one-fits-all general model that requires only one-time training but can adapt to different data domains. Experiments on various domain factors (i.e. environments, locations, and orientations of persons) demonstrate the accuracy of 92.7% for in-domain recognition and 82.6%-92.4% for cross-domain recognition without model re-training, outperforming the state-of-the-art solutions.
5 October 2021 in ACM Transactions on Sensor Networks
Gait, the walking manner of a person, has been perceived as a physical and behavioral trait for human identification. Compared with cameras and wearable sensors, Wi-Fi-based gait recognition is more attractive because Wi-Fi infrastructure is almost available everywhere and is able to sense passively without the requirement of on-body devices. However, existing Wi-Fi sensing approaches impose strong assumptions of fixed user walking trajectories, sufficient training data, and identification of already known users. In this article, we present GaitSense , a Wi-Fi-based human identification system, to overcome the above unrealistic assumptions. To deal with various walking trajectories and speeds, GaitSense first extracts target specific features that best characterize gait patterns and applies novel normalization algorithms to eliminate gait irrelevant perturbation in signals. On this basis, GaitSense reduces the training efforts in new deployment scenarios by transfer learning and data augmentation techniques. GaitSense also enables a distinct feature of illegal user identification by anomaly detection, making the system readily available for real-world deployment. Our implementation and evaluation with commodity Wi-Fi devices demonstrate a consistent identification accuracy across various deployment scenarios with little training samples, pushing the limit of gait recognition with Wi-Fi signals.
6 July 2022 in IEEE Transactions on Mobile Computing
The past decades have witnessed a surge in human fall detection with sensors, cameras, and wireless signals. Among them, Wi-Fi-based fall detection has been one of the most attractive solutions due to the ubiquitous and pervasive deployment of Wi-Fi infrastructures. However, these approaches are still difficult to be put into practical use. To push forward Wi-Fi-based fall detection for wide deployment, three major limitations concerning environmental diversity , motion diversity , and user diversity are required to be resolved. In this paper, we propose FallDar, a Wi-Fi-based deep learning-assisted fall detection system that outperforms state-of-the-art works on the three criteria simultaneously. First, to deal with environmental diversity, FallDar characterizes falls with the speed of the body, which is the most relevant and inherent feature of falling activities, making the system resilient to environmental changes. Second, to deal with motion diversity, FallDar simulates a large amount of fall data of various falling types with a DNN-based generative model. Training with these data, FallDar is endowed the capability of detecting more types of falls. Third, to deal with user diversity, FallDar proposes to incorporate the fall detection network with a user identification network. The network is designed to extract user-independent features, requiring no fall data from new users for system adjustment. We implement FallDar on commercial Wi-Fi devices and conduct experiments in home and office environments for six months. The evaluation results show that FallDar achieves a false alarm rate of 5.7% and a missed alarm rate of 3.4% across all factors, making a fundamental step towards ubiquitous fall detection with Wi-Fi.
17 April 2023 in ACM Transactions on Sensor Networks
Existing device-free localization systems have achieved centimeter-level accuracy and show their potential in a wide range of applications. However, today’s radio-based solutions fail to locate the target in millimeter-level due to their limited bandwidth and sampling rate, which constrains their applications in high-accuracy demand scenarios. We find an opportunity to break the bottleneck of existing radio-based localization systems by reconstructing the accurate signal spectral peak from the discrete samples, without changing either the bandwidth or the sampling rate of the radio hardware. This study proposes milliLoc , a millimeter-level radio-based localization system. We first derive a spectral peak reconstruction algorithm to reduce the ranging error from the previous centimeter-level to millimeter-level. Then, we improve the AoA measurement accuracy by leveraging the signal amplitude information. To ensure the practicality of milliLoc , we further extend our system to handle multi-target situations. We fully implement milliLoc on a commercial mmWave radar. Experiments show that milliLoc achieves a median ranging accuracy of 5.5 mm and decreases the AoA measurement error by 31.2% compared with the baseline. Our system fulfills the accuracy requirements of most application scenarios and can be easily integrated with other existing solutions, shedding light on high-accuracy location-based applications.