As an application of fine-grained wireless sensing, RF-based material identification follows the paradigm of RF computing that fetches the information during RF signal propagation. Specifically, the RF signal accesses the objects’ material-related information and carries the information with its electromagnetic properties. With a variety of important applications, research on RF-based material identification has gained significant progress in recent years. However, several fundamental problems remain insufficiently studied, such as the sensing models, signal processing approaches, performance and future extensions. This paper presents the first comprehensive survey of RF-based material identification. According to the basic sensing model used for sensing, we propose a taxonomy to classify the existing works into two categories: reflection-based and penetration-based. The works in each category are further grouped by the type of RF signals used, with elaborated discussion of the detailed approaches and the common challenges. We provide a framework that benchmarks the performance of the existing works, followed by a thorough discussion of future extensions.
10 June 2022 in IEEE Transactions on Mobile Computing
The signal phase is one of the most important metrics in RFID-based sensing, which is a useful technique enabling many significant applications. However, existing approaches of RFID-based sensing are often restricted in terms of the sensing capability or accuracy, due to the phase entanglement problem: the phase of the RFID signal is jointly affected by multiple factors, and the change in the signal phase cannot be directly attributed to any one of them. In order to tackle this problem, we propose RF-Prism, a versatile sensing approach that can simultaneously infer multiple physical factors (i.e., location, orientation, and material of targets), purely based on the phase readings. RF-Prism includes a comprehensive model to describe how different physical factors affect the phase of the received signal, and a complete design to disentangle the phase in the multi-frequency and multi-antenna scenario. We implement RF-Prism and evaluate its performance with extensive experiments. The results show that RF-Prism simultaneously achieves a mean localization error of $\text{7.61}~cm$ , a mean orientation error of 9.83 degrees, a mean tracking error of $\text{6.12}~cm$ , and 87.9% material identification accuracy, which outperforms state-of-the-art approaches.
21 June 2022 in IEEE Transactions on Mobile Computing
Gaze tracking is a useful human-to-computer interface, which plays an increasingly important role in a range of mobile applications. Gaze calibration is an indispensable component of gaze tracking, which transforms the eye coordinates to the screen coordinates. The existing approaches of gaze tracking either have limited accuracy or require the user's cooperation in calibration and in turn hurt the quality of experience. We in this paper propose vGaze, continuous gaze tracking with implicit saliency-aware calibration on mobile devices. The design of vGaze stems from our insight on the temporal and spatial dependent relation between the visual saliency and the user's gaze. vGaze is implemented as a light-weight software that identifies video frames with “useful” saliency information, sensing the user's head movement, performs opportunistic calibration using only those “useful” frames, and leverages historical information for accelerating saliency detection. We implement vGaze on a commercial mobile device and evaluate its performance in various scenarios. The results show that vGaze can work at real time with video playback applications. The average error of gaze tracking is 1.51cm (2.884 $^{\circ }$ ) which decreases to 0.99cm (1.891 $^{\circ }$ ) with historical information and 0.57cm (1.089 $^{\circ }$ ) with an indicator.
This paper proposes Meta-Speaker, an innovative speaker capable of projecting audible sources into the air with a high level of manipulability. Unlike traditional speakers that emit sound waves in all directions, Meta-Speaker can manipulate the granularity of the audible region, down to a single point, and can manipulate the location of the source. Additionally, the source projected by Meta-Speaker is a physical presence in space, allowing both humans and machines to perceive it with spatial awareness. Meta-Speaker achieves this by leveraging the fact that air is a nonlinear medium, which enables the reproduction of audible sources from ultrasounds. Meta-Speaker comprises two distributed ultrasonic arrays, each transmitting a narrow ultrasonic beam. The audible source can be reproduced at the intersection of the beams. We present a comprehensive profiling of Meta-Speaker to validate the high manipulability it offers. We prototype Meta-Speaker and demonstrate its potential through three applications: anchor-free localization with a median error of 0.13 m, location-aware communication with a throughput of 1.28 Kbps, and acoustic augmented reality where users can perceive source direction with a mean error of 9.8 degrees.
This paper presents FaB, a frequency-agile backscatter system that can optionally leverage OFDM signals on different bands as carriers for backscatter communication. Compared with existing backscatter systems that are tailored to a specific frequency band, a frequency-agile backscatter yields two critical benefits: i) it can leverage the increased availability of "free rides" across a broad range of frequency band to improve its transmission efficiency; and ii) it becomes compatible with mainstream wireless communication standards, making it applicable to heterogeneous wireless networks. Based on these two features, FaB's circuits can be migrated to various types of backscatter communication nodes without any modification, significantly reducing design and deployment costs. To show the efficacy of our design, we implement a PCB prototype of FaB and showcase its capability of leveraging OFDM Wi-Fi and LTE signals as carrier waves. Our extensive field studies show that FaB's multi-band modulator can produce an error vector magnitude of under -15dB in any band below 6GHz with a precision of 10mV.