Jiao LI

Dr. Jiao LI

orcid

Research Focus & Metrics

Academic Career Length

1Year (2026-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
2 May 2024 in Sensors
Verified
Journal Article
Open access
PDF file
YSYinhe Sheng
Yinhe Sheng
JLJiao LI
Jiao LI
YMYongyu Ma
Yongyu Ma
AZAndrew Zhang
Andrew Zhang
Within the context of a smart home, detecting the operating status of appliances in the environment plays a pivotal role, estimating power consumption, issuing overuse reminders, and identifying faults. The traditional contact-based approaches require equipment updates such as incorporating smart sockets or high-precision electric meters. Non-constant approaches involve the use of technologies like laser and Ultra-Wideband (UWB) radar. The former can only monitor one appliance at a time, and the latter is unable to detect appliances with extremely tiny vibrations and tends to be susceptible to interference from human activities. To address these challenges, we introduce HomeOSD, an advanced appliance status-detection system that uses mmWave radar. This innovative solution simultaneously tracks multiple appliances without human activity interference by measuring their extremely tiny vibrations. To reduce interference from other moving objects, like people, we introduce a Vibration-Intensity Metric based on periodic signal characteristics. We present the Adaptive Weighted Minimum Distance Classifier (AWMDC) to counteract appliance vibration fluctuations. Finally, we develop a system using a common mmWave radar and carry out real-world experiments to evaluate HomeOSD’s performance. The detection accuracy is 95.58%, and the promising results demonstrate the feasibility and reliability of our proposed system.

30 October 2026
Verified
Book Chapter
Open access
PDF file
AZAndrew Zhang
Andrew Zhang
YZYankai Zhao
Yankai Zhao
WXWentao Xie
Wentao Xie
JLJiao LI
Jiao LI
This chapter presents three acoustic sensing systems that enable hands-free, silent interaction with smart glasses and earphones by repurposing the speakers and microphones already embedded in these wearable devices to capture body motions and finger gestures through sound. The three systems operate on distinct sensing principles: the first tracks eye movements by transmitting inaudible ultrasonic tones along the glasses frame and measuring how facial skin deformations alter the acoustic propagation path; the second detects tongue–palate contact events inside the oral cavity by monitoring ear canal shape changes caused by jaw and tongue articulation; and the third recognizes mid-air finger gestures performed near the ear by analyzing the friction sounds and micro-Doppler signatures they produce. For each system, we detail the signal processing pipeline—including filtering, feature extraction, and spectral analysis—and the machine learning models used for gesture classification or motion regression. We also discuss practical deployment challenges such as robustness to ambient noise, inter-user variability in anatomy and behavior, sensitivity to device placement, and power consumption constraints that affect always-on operation. Furthermore, we identify open research problems for future wearable acoustic interfaces, including user-independent model generalization, low-latency on-device inference, long-term wearing comfort, and integration with complementary sensing modalities. Taken together, the three systems demonstrate that acoustic sensing alone—without any additional dedicated hardware beyond what commercial wearables already provide—can support practical, real-time, and always-available interaction, establishing a promising foundation for the next generation of wearable computing interfaces.