Qiancheng Jin

Qiancheng Jin

Auto-generated profile, based on publicly available information

Qiancheng Jin

State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
21 November 2024 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Verified
Journal Article
Open access
YLYi Li
Yi Li
CWChuyu Wang
Chuyu Wang
LXLei Xie
Lei Xie
QJQiancheng Jin
Qiancheng Jin
LFLong Fan
Long Fan
SLSanglu Lu
Sanglu Lu
Facial landmark has become one of the most widely-used and intuitive feature of the face. Traditional methods for Facial Landmark Detection (FLD) are primarily based on cameras, which are limited by their sensitivity to light conditions, inability to penetrate obstructions, and potential privacy leaks. In this paper, we propose mmFLD to estimate the facial landmark positions using millimeter-wave (mmWave) radar with mm-level accuracy. By simultaneously applying the range estimation capability and angle estimation capability of mmWave radar, we are able to spatially sample face reflection signals with high resolution. In particular, we propose a velocity-based method for head detection and tracking, and then we build two generalized models to extract effective facial motion features from different facial regions. Moreover, we design an end-to-end neural network to extract the face structure and the motion coherence implicit in mmWave data. Experiment results show that mmFLD can estimate the facial landmark positions with high accuracy, e.g., the average Mean Absolute Error (MAE) is 2.81 mm with eight kinds of different facial expressions, and extended experiment also demonstrates the generalizability and robustness of mmFLD for different experiment conditions.