The integrated sensing and communication (ISAC), in which the sensing and communication share the same frequency band and hardware, has emerged as a key technology in future wireless systems due to two main reasons. First, many important application scenarios in fifth generation (5G) and beyond, such as autonomous vehicles, Wi-Fi sensing and extended reality, requires both high-performance sensing and wireless communications. Second, with millimeter wave and massive multiple-input multiple-output (MIMO) technologies widely employed in 5G and beyond, the future communication signals tend to have high-resolution in both time and angular domain, opening up the possibility for ISAC. As such, ISAC has attracted tremendous research interest and attentions in both academia and industry. Early works on ISAC have been focused on the design, analysis and optimization of practical ISAC technologies for various ISAC systems. While this line of works are necessary, it is equally important to study the fundamental limits of ISAC in order to understand the gap between the current state-of-the-art technologies and the performance limits, and provide useful insights and guidance for the development of better ISAC technologies that can approach the performance limits. In this paper, we aim to provide a comprehensive survey for the current research progress on the fundamental limits of ISAC. Particularly, we first propose a systematic classification method for both traditional radio sensing (such as radar sensing and wireless localization) and ISAC so that they can be naturally incorporated into a unified framework. Then we summarize the major performance metrics and bounds used in sensing, communications and ISAC, respectively. After that, we present the current research progresses on fundamental limits of each class of the traditional sensing and ISAC systems. Finally, the open problems and future research directions are discussed.
14 July 2020 in IEEE Transactions on Geoscience and Remote Sensing
Human sensing using WiFi signal transmissions is attracting significant attention for future applications in e-healthcare, security, and the Internet of Things (IoT). The majority of WiFi sensing systems are based around processing of channel state information (CSI) data which originates from commodity WiFi access points (APs) that have been primed to transmit high data-rate signals with high repetition frequencies. However, in reality, WiFi APs do not transmit in such a continuous uninterrupted fashion, especially when there are no users on the communication network. To this end, we have developed a passive WiFi radar system for human sensing which exploits WiFi signals irrespective of whether the WiFi AP is transmitting continuous high data-rate Orthogonal Frequency-Division Multiplexing (OFDM) signals, or periodic WiFi beacon signals while in an idle status (no users on the WiFi network). In a data transmission phase, we employ the standard cross ambiguity function (CAF) processing to extract Doppler information relating to the target, while a modified version is used for lower data-rate signals. In addition, we investigate the utility of an external device that has been developed to stimulate idle WiFi APs to transmit usable signals without requiring any type of user authentication on the WiFi network. In this article, we present experimental data which verifies our proposed methods for using any type of signal transmission from a standalone WiFi device, and demonstrate the capability for human activity sensing.
28 December 2021 in IEEE Aerospace and Electronic Systems Magazine
Radio-frequency-based noncooperative monitoring of humans has numerous applications ranging from law enforcement to ubiquitous sensing applications such as ambient assisted living and biomedical applications for nonintrusively monitoring patients. Large training datasets, almost unlimited memory capacity, and ever-increasing processing speeds of computers could drive forward the data-driven deep-learning-focused research in the abovementioned applications. However, generating and labeling large volumes of high-quality, diverse radar datasets is an onerous task. Furthermore, unlike the fields of vision and image processing, the radar community has limited access to databases that contain large volumes of experimental data. Therefore, in this article, we present an open-source motion capture data-driven simulation tool, SimHumalator, that can generate large volumes of human micro-Doppler radar data in passive WiFi scenarios. The simulator integrates IEEE 802.11 WiFi Standards (IEEE 802.11 g, n, and ad) compliant transmissions with the human animation data to generate the micro-Doppler features that incorporate the diversity of human motion characteristics and the sensor parameters. The simulated signatures have been validated with experimental data gathered using an in-house-built hardware prototype. This article describes simulation methodology in detail and provides case studies on the feasibility of using simulated micro-Doppler spectrograms for data augmentation tasks.
27 July 2021 in IEEE Transactions on Wireless Communications
The use of Wi-Fi signals for human sensing has gained significant interest over the past decade. Such techniques provide affordable and reliable solutions for healthcare-focused events such as vital sign detection, prevention of falls and long-term monitoring of chronic diseases, among others. Currently, there are two major approaches for Wi-Fi sensing: (1) passive Wi-Fi radar (PWR) which uses well established techniques from bistatic radar, and channel state information (CSI) based wireless sensing (SENS) which exploits human-induced variations in the communication channel between a pair of transmitter and receiver. However, there has not been a comprehensive study to understand and compare the differences in terms of effectiveness and limitations in real-world deployment. In this paper, we present the fundamentals of the two systems with associated methodologies and signal processing. A thorough measurement campaign was carried out to evaluate the human activity detection performance of both systems. Experimental results show that SENS system provides better detection performance in a line-of-sight (LoS) condition, whereas PWR system performs better in a non-LoS (NLoS) setting. Furthermore, based on our findings, we recommend that future Wi-Fi sensing applications should leverage the advantages from both PWR and SENS systems.
The ability to detect the presence as well as classify the activities of individuals behind visually obscuring structures is of significant benefit to police, security and emergency services in many situations. This paper presents the analysis from a series of experimental results generated using a through-the-wall (TTW) Frequency Modulated Continuous Wave (FMCW) C-Band radar system named Soprano. The objective of this analysis was to classify whether an individual was carrying an item in both hands or not using micro-Doppler information from a FMCW sensor. The radar was deployed at a standoff distance, of approximately 0.5 m, outside a residential building and used to detect multiple people walking within a room. Through the application of digital filtering, it was shown that significant suppression of the primary wall reflection is possible, significantly enhancing the target signal to clutter ratio. Singular Value Decomposition (SVD) signal processing techniques were then applied to the micro-Doppler signatures from different individuals. Features from the SVD information have been used to classify whether the person was carrying an item or walking free handed. Excellent performance of the classifier was achieved in this challenging scenario with accuracies up to 94%, suggesting that future through wall radar sensors may have the ability to reliably recognize many different types of activities in TTW scenarios using these techniques.
14 March 2023 in IEEE Transactions on Aerospace and Electronic Systems
Motion tracking systems based on optical sensors typically suffer from poor lighting conditions, occlusion, limited coverage, and may raise privacy concerns. More recently, radiofrequency (RF) based approaches using commercial WiFi devices have emerged which offer low-cost ubiquitous sensing whilst preservin privacy. However, RF sensing systems typically output range-Doppler maps, time-frequency spectrograms, cross-range plots etc which cannot represent human motion intuitively and usually requires further processing. In this study, we propose MDPose, a novel framework for human skeletal motion reconstruction base on WiFi micro-Doppler signatures. MDPose provides an effective solution to represent human activity by reconstructing a skeleton model with 17 key points, which can assist with the interpretation of conventional RF sensing outputs in a more understandable way. Specifically, MDPose is implemented over three sequential stage to address a series of challenges: First, a denoising algorithm is employed to remove any unwanted noise that may affect feature extraction and enhance weak Doppler measurements. Secondly, a convolutional neural network (CNN)-recurrent neural network (RNN) architecture is applied to learn temporal spatial dependenc from clean micro-Doppler signatures and restore velocity information to key points under the supervision of the motion capture (Mocap) system. Finally, a pose optimisation mechanism based on learning optimisation vectors is employed to estimate the initial state of the skeleton and to limit additional errors. We hav conducted a comprehensive set of tests in a variety of environments using numerous subjects with a single receiver radar system to demonstrate the performance of MDPose, and report 29.4mm mean absolute error over all key points positions on several common daily activities, which has performance comparable to that of state-ofthe- art RF-based pose estimation systems.