14 July 2020 in IEEE Transactions on Geoscience and Remote Sensing
Human sensing using WiFi signal transmissions is attracting significant attention for future applications in e-healthcare, security, and the Internet of Things (IoT). The majority of WiFi sensing systems are based around processing of channel state information (CSI) data which originates from commodity WiFi access points (APs) that have been primed to transmit high data-rate signals with high repetition frequencies. However, in reality, WiFi APs do not transmit in such a continuous uninterrupted fashion, especially when there are no users on the communication network. To this end, we have developed a passive WiFi radar system for human sensing which exploits WiFi signals irrespective of whether the WiFi AP is transmitting continuous high data-rate Orthogonal Frequency-Division Multiplexing (OFDM) signals, or periodic WiFi beacon signals while in an idle status (no users on the WiFi network). In a data transmission phase, we employ the standard cross ambiguity function (CAF) processing to extract Doppler information relating to the target, while a modified version is used for lower data-rate signals. In addition, we investigate the utility of an external device that has been developed to stimulate idle WiFi APs to transmit usable signals without requiring any type of user authentication on the WiFi network. In this article, we present experimental data which verifies our proposed methods for using any type of signal transmission from a standalone WiFi device, and demonstrate the capability for human activity sensing.
28 December 2021 in IEEE Aerospace and Electronic Systems Magazine
Radio-frequency-based noncooperative monitoring of humans has numerous applications ranging from law enforcement to ubiquitous sensing applications such as ambient assisted living and biomedical applications for nonintrusively monitoring patients. Large training datasets, almost unlimited memory capacity, and ever-increasing processing speeds of computers could drive forward the data-driven deep-learning-focused research in the abovementioned applications. However, generating and labeling large volumes of high-quality, diverse radar datasets is an onerous task. Furthermore, unlike the fields of vision and image processing, the radar community has limited access to databases that contain large volumes of experimental data. Therefore, in this article, we present an open-source motion capture data-driven simulation tool, SimHumalator, that can generate large volumes of human micro-Doppler radar data in passive WiFi scenarios. The simulator integrates IEEE 802.11 WiFi Standards (IEEE 802.11 g, n, and ad) compliant transmissions with the human animation data to generate the micro-Doppler features that incorporate the diversity of human motion characteristics and the sensor parameters. The simulated signatures have been validated with experimental data gathered using an in-house-built hardware prototype. This article describes simulation methodology in detail and provides case studies on the feasibility of using simulated micro-Doppler spectrograms for data augmentation tasks.
27 July 2021 in IEEE Transactions on Wireless Communications
The use of Wi-Fi signals for human sensing has gained significant interest over the past decade. Such techniques provide affordable and reliable solutions for healthcare-focused events such as vital sign detection, prevention of falls and long-term monitoring of chronic diseases, among others. Currently, there are two major approaches for Wi-Fi sensing: (1) passive Wi-Fi radar (PWR) which uses well established techniques from bistatic radar, and channel state information (CSI) based wireless sensing (SENS) which exploits human-induced variations in the communication channel between a pair of transmitter and receiver. However, there has not been a comprehensive study to understand and compare the differences in terms of effectiveness and limitations in real-world deployment. In this paper, we present the fundamentals of the two systems with associated methodologies and signal processing. A thorough measurement campaign was carried out to evaluate the human activity detection performance of both systems. Experimental results show that SENS system provides better detection performance in a line-of-sight (LoS) condition, whereas PWR system performs better in a non-LoS (NLoS) setting. Furthermore, based on our findings, we recommend that future Wi-Fi sensing applications should leverage the advantages from both PWR and SENS systems.
14 March 2023 in IEEE Transactions on Aerospace and Electronic Systems
Motion tracking systems based on optical sensors typically suffer from poor lighting conditions, occlusion, limited coverage, and may raise privacy concerns. More recently, radiofrequency (RF) based approaches using commercial WiFi devices have emerged which offer low-cost ubiquitous sensing whilst preservin privacy. However, RF sensing systems typically output range-Doppler maps, time-frequency spectrograms, cross-range plots etc which cannot represent human motion intuitively and usually requires further processing. In this study, we propose MDPose, a novel framework for human skeletal motion reconstruction base on WiFi micro-Doppler signatures. MDPose provides an effective solution to represent human activity by reconstructing a skeleton model with 17 key points, which can assist with the interpretation of conventional RF sensing outputs in a more understandable way. Specifically, MDPose is implemented over three sequential stage to address a series of challenges: First, a denoising algorithm is employed to remove any unwanted noise that may affect feature extraction and enhance weak Doppler measurements. Secondly, a convolutional neural network (CNN)-recurrent neural network (RNN) architecture is applied to learn temporal spatial dependenc from clean micro-Doppler signatures and restore velocity information to key points under the supervision of the motion capture (Mocap) system. Finally, a pose optimisation mechanism based on learning optimisation vectors is employed to estimate the initial state of the skeleton and to limit additional errors. We hav conducted a comprehensive set of tests in a variety of environments using numerous subjects with a single receiver radar system to demonstrate the performance of MDPose, and report 29.4mm mean absolute error over all key points positions on several common daily activities, which has performance comparable to that of state-ofthe- art RF-based pose estimation systems.
10 December 2021 in IEEE Sensors Journal
IoT ecosystems consist of a range of smart devices that generated a plethora of Radio Frequency (RF) transmissions. This provides an attractive opportunity to exploit already-existing signals for various sensing applications such as e-Healthcare, security and smart home. In this paper, we present Passive IoT Radar (PIoTR), a system that passively uses RF transmissions from IoT devices for human monitoring. PIoTR is designed based on passive radar technology, with a generic architecture to utilize various signal sources including the WiFi signal and wireless energy at the Industrial, Scientific and Medical (ISM) band. PIoTR calculates the phase shifts caused by human motions and generates Doppler spectrogram as the representative. To verify the proposed concepts and test in a more realistic environment, we evaluate PIoTR with four commercial IoT devices for home use. Depending on the effective signal and power strength, PIoTR performs two modes: coarse sensing and fine-grained sensing. Experimental results show that PIoTR can achieve an average of 91% in occupancy detection (coarse sensing) and 91.3% in activity recognition (fine-grained sensing).