27 March 2023 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Falls are the leading cause of fatal injuries to elders in modern society, which has motivated researchers to propose various fall detection technologies. We observe that most of the existing fall detection solutions are diverging from the purpose of fall detection: timely alarming the family members, medical staff or first responders to save the life of the human with severe injury caused by fall. Instead, they focus on detecting the behavior of human falls, which does not necessarily mean a human is in real danger. The real critical situation is when a human cannot get up without assistance and is thus lying on the ground after the fall because of losing consciousness or becoming incapacitated due to severe injury. In this paper, we define a life-threatening fall as a behavior that involves a falling down followed by a long-lie of humans on the ground, and for the first time point out that a fall detection system should focus on detecting life-threatening falls instead of detecting any random falls. Accordingly, we design and implement LT-Fall, a mmWave-based life-threatening fall detection and alarming system. LT-Fall detects and reports both fall and fall-like behaviors in the first stage and then identifies life-threatening falls by continuously monitoring the human status after fall in the second stage. We propose a joint spatio-temporal localization technique to detect and locate the micro-motions of the human, which solves the challenge of mmWave's insufficient spatial resolution when the human is static, i.e., lying on the ground. Extensive evaluation on 15 volunteers demonstrates that compared to the state-of-the-art work (92% precision and 94% recall), LT-Fall achieves zero false alarms as well as a precision of 100% and a recall of 98.8%.
26 August 2024 in IEEE Transactions on Mobile Computing
Long-term monitoring of human vital signs like respiration and heartbeat is crucial for the early detection of diverse diseases and overall health monitoring. Contact-free vital signs monitoring using wireless signals, particularly mmWave-based methods, has gained attention due to its sensitivity and privacy-preserving benefits. However, we observe that even minor human movements could lead to significant mutations in the signal-to-noise ratio (SNR) of the wireless signal, which cannot be explained by the commonly used model that represents the human chest as a single reflection point. These fluctuations challenge the robustness of heart rate and heart rate variability (HRV) monitoring due to the vulnerability of faint heartbeats to noise interference. To tackle this, we introduce a multi-point reflection model to understand the underlying causes of SNR fluctuations and propose a frequency diversity based algorithm to enhance sensing SNR. Our solution, Robust-Vital, was rigorously evaluated using commercial mmWave radar systems and demonstrated superior performance on long-term heart rate and heart rate variability tracking in a user study with 12 participants.
19 December 2023 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
The bathroom has consistently ranked among the most perilous rooms in households, with slip and fall incidents during showers posing a critical threat, particularly to the elders. To address this concern while ensuring privacy and accuracy, the mmWave-based sensing system has emerged as a promising solution. Capable of precisely detecting human activities and promptly triggering alarms in response to critical events, it has proved especially valuable within bathroom environments. However, deploying such a system in bathrooms faces a significant challenge: interference from running water. Similar to the human body, water droplets reflect substantial mmWave signals, presenting a major obstacle to accurate sensing. Through rigorous empirical study, we confirm that the interference caused by running water adheres to a Weibull distribution, offering insight into its behavior. Leveraging this understanding, we propose a customized Constant False Alarm Rate (CFAR) detector, specifically tailored to handle the interference from running water. This innovative detector effectively isolates human-generated signals, thus enabling accurate human detection even in the presence of running water interference. Our implementation of "Waffle" on a commercial off-the-shelf mmWave radar demonstrates exceptional sensing performance. It achieves median errors of 1.8cm and 6.9cm for human height estimation and tracking, respectively, even in the presence of running water. Furthermore, our fall detection system, built upon this technique, achieves remarkable performance (a recall of 97.2% and an accuracy of 97.8%), surpassing the state-of-the-art method.
9 June 2025 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Point clouds are a crucial data type for mmWave radar and are widely used in sensing applications such as human tracking and activity recognition. However, for indoor human sensing, the point clouds obtained by mmWave radar are often sparse. Previous studies attribute the sparsity to the limited sensing capabilities of mmWave radar, underestimating the impact of CFAR---a key algorithmic component of mmWave systems---on point cloud quality. Through empirical studies, we find that the spatial-based CFAR widely used in existing works suffers from a severe energy masking issue. This is because these algorithms work well when the target is far away enough to be approximated as a point. In short-range indoor sensing, the human body can not be considered as a point but an extended target, causing the spatial-based CFAR to calculate the noise power wrongly and accordingly a miss-generation of the point cloud. To fundamentally solve the problem, this paper proposes a temporal-based CFAR named ETCM-CFAR. We address multiple issues such as lacking initial noise power and the absence of a closed-form threshold solution to make the proposed algorithm work. Based on ETCM-CFAR, this paper proposes a point cloud generation system named mmPC. mmPC is implemented on three different types of commercial-off-the-shelf mmWave radars and extensive experiments demonstrate that mmPC significantly improves point cloud quality, increasing the number of cloud points by 148.6% compared to the state-of-the-art systems. Two representative sensing applications, i.e., fitness activity recognition and human-pet classification are further employed to demonstrate the effectiveness of mmPC on sensing.
19 December 2023 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Millimeter wave (mmWave) radar excels in accurately estimating the distance, speed, and angle of the signal reflectors relative to the radar. However, for diverse sensing applications reliant on radar's tracking capability, these estimates must be transformed from radar to room coordinates. This transformation hinges on the mmWave radar's location attribute, encompassing its position and orientation in room coordinates. Traditional outdoor calibration solutions for autonomous driving utilize corner reflectors as static reference points to derive the location attribute. When deployed in the indoor environment, it is challenging, even for the mmWave radar with GHz bandwidth and a large antenna array, to separate the static reference points from other multipath reflectors. To tackle the static multipath, we propose to deploy a moving reference point (a moving robot) to fully harness the velocity resolution of mmWave radar. Specifically, we select a SLAM-capable robot to accurately obtain its locations under room coordinates during motion, without requiring human intervention. Accurately pairing the locations of the robot under two coordinate systems requires tight synchronization between the mmWave radar and the robot. We therefore propose a novel trajectory correspondence based calibration algorithm that takes the estimated trajectories of two systems as input, decoupling the operations of two systems to the maximum. Extensive experimental results demonstrate that the proposed calibration solution exhibits very high accuracy (1.74 cm and 0.43° accuracy for location and orientation respectively) and could ensure outstanding performance in three representative applications: fall detection, point cloud fusion, and long-distance human tracking.
7 February 2025 in IEEE Transactions on Mobile Computing
Indoor mmWave-based sensing technologies have garnered substantial interest from both the industrial and academic. Yet, the intrinsic challenge posed by the limited Field-of-View (FOV) of mmWave radars significantly restricts their coverage. This limitation necessitates careful selection of installation positions and orientations to optimize performance, thereby severely curtailing the versatility and widespread adoption of these systems. Traditionally, expanding coverage involved increasing the number of radar units. This paper introduces a novel approach to enhance the FOV by incorporating mobility, achieved by affixing the radar onto a pan-tilt unit capable of rotating along both the horizontal and azimuthal. Nevertheless, the disparity between the pan-tilt and the radar presents significant challenges for accurately rotating the radar's orientation. To mitigate this, we propose an automated calibration algorithm for radar and pan-tilt, ensuring precise calibration. Additionally, we have devised a radar orientation adjustment algorithm intended to automatically align the radar's FOV with the positions of detected objects to facilitate various applications. Through three case studies, we have demonstrated that mmRotation can greatly expand the sensing range, enabling support for multiple applications on a single radar, such as vital signs monitoring and fall detection. Comprehensive experimental results underscore that our system surpasses the current state-of-the-art (SOTA).